After deleting ~/.gconf/desktop/gnome/peripherals/keyboard/kbd/% gconf.xml, keyboard works better. It looks like this is not the xkb problem but problem with gconf settings from older version of gnome.