I've found more info about this. You were right that it was remembering previously paired devices. Logitech has a utility that allows removing pairings (for Windows) and I was able to remove the keyboard.