Bug#605673: linux-2.6: 2.6.26-2-amd64 KVM host crash at kvm:gfn_to_rmap+0x17/0x49
Package: linux-2.6
Severity: important
System was rebooted 3 days ago. There are about 8 virtual machines. One of them was doing heavy I/O during the crash.
After a cold-reboot everything worked ok and the heavy I/O task has been re-run and completed successfully.
Syslog:
Dec 2 10:53:40 camelot kernel: [498738.031444] BUG: unable to handle kernel NULL pointer dereference at 0000000000000000
Dec 2 10:53:40 camelot kernel: [498738.031444] IP: [<ffffffffa025e963>] :kvm:gfn_to_rmap+0x17/0x49
Dec 2 10:53:40 camelot kernel: [498738.031444] PGD 338c91067 PUD 338cc9067 PMD 0
Dec 2 10:53:40 camelot kernel: [498738.031444] Oops: 0000 [1] SMP
Dec 2 10:53:40 camelot kernel: [498738.031444] CPU 3
Dec 2 10:53:40 camelot kernel: [498738.031444] Modules linked in: tun kvm_intel kvm ipv6 bridge loop snd_pcm snd_timer snd sou
ndcore snd_page_alloc i2c_i801 i2c_core parport_pc parport shpchp pcspkr rng_core i5000_edac container button pci_hotplug edac_
core evdev ext3 jbd mbcache dm_mirror dm_log dm_snapshot dm_mod ide_cd_mod cdrom piix ide_pci_generic ide_core ses enclosure sd
_mod ata_generic libata dock ehci_hcd uhci_hcd tg3 aacraid scsi_mod thermal processor fan thermal_sys [last unloaded: scsi_wait
_scan]
Dec 2 10:53:40 camelot kernel: [498738.031444] Pid: 3275, comm: kvm Not tainted 2.6.26-2-amd64 #1
Dec 2 10:53:40 camelot kernel: [498738.031444] RIP: 0010:[<ffffffffa025e963>] [<ffffffffa025e963>] :kvm:gfn_to_rmap+0x17/0x49
Dec 2 10:53:40 camelot kernel: [498738.031444] RSP: 0018:ffff8103379f9a38 EFLAGS: 00010246
Dec 2 10:53:40 camelot kernel: [498738.031444] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000
Dec 2 10:53:40 camelot kernel: [498738.031444] RDX: 00000000000fee01 RSI: fffffffffffff001 RDI: ffff8103379d4000
Dec 2 10:53:40 camelot kernel: [498738.031444] RBP: fffffffffffff001 R08: 000000000000000a R09: 000000000000000a
Dec 2 10:53:40 camelot kernel: [498738.031444] R10: ffff8103379fa100 R11: ffffffffa026100f R12: ffff8101b7cd8b88
Dec 2 10:53:40 camelot kernel: [498738.031444] R13: ffff8103379d4000 R14: ffff81001c2e3000 R15: ffffffffa0275680
Dec 2 10:53:40 camelot kernel: [498738.031444] FS: 0000000000000000(0000) GS:ffff81033e4c17c0(0000) knlGS:000000009a2fbb90
Dec 2 10:53:40 camelot kernel: [498738.031444] CS: 0010 DS: 002b ES: 002b CR0: 0000000080050033
Dec 2 10:53:40 camelot kernel: [498738.031444] CR2: 0000000000000000 CR3: 0000000338cc7000 CR4: 00000000000026e0
Dec 2 10:53:40 camelot kernel: [498738.031444] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Dec 2 10:53:40 camelot kernel: [498738.031444] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Dec 2 10:53:40 camelot kernel: [498738.031444] Process kvm (pid: 3275, threadinfo ffff8103379f8000, task ffff81033e734fa0)
Dec 2 10:53:40 camelot kernel: [498738.031444] Stack: 000000000029c544 000000000029c544 ffff81001c2e30a8 ffffffffa025ea44
Dec 2 10:53:40 camelot kernel: [498738.031444] ffff8103379fb488 ffff81001c2e30a8 ffff8101b7cd8b88 ffff8103379d4000
Dec 2 10:53:40 camelot kernel: [498738.031444] 00000000000000a8 ffffffffa025ebd9 00000000000000a8 000000000029c544
Dec 2 10:53:40 camelot kernel: [498738.031444] Call Trace:
Dec 2 10:53:40 camelot kernel: [498738.031444] [<ffffffffa025ea44>] ? :kvm:rmap_remove+0xaf/0x198
Dec 2 10:53:40 camelot kernel: [498738.031444] [<ffffffffa025ebd9>] ? :kvm:kvm_mmu_zap_page+0x8a/0x270
Dec 2 10:53:40 camelot kernel: [498738.031444] [<ffffffffa02602c2>] ? :kvm:kvm_mmu_pte_write+0x2aa/0x721
Dec 2 10:53:40 camelot kernel: [498738.031444] [<ffffffffa026104e>] ? :kvm:paging64_gva_to_gpa+0x3f/0x75
Dec 2 10:53:40 camelot kernel: [498738.031444] [<ffffffffa025779b>] ? :kvm:mark_page_dirty+0x1c/0x3f
Dec 2 10:53:40 camelot kernel: [498738.031444] [<ffffffffa025a7d4>] ? :kvm:emulator_write_phys+0x36/0x45
Dec 2 10:53:40 camelot kernel: [498738.031444] [<ffffffffa025bd34>] ? :kvm:emulator_write_emulated_onepage+0x6f/0xf0
Dec 2 10:53:40 camelot kernel: [498738.031444] [<ffffffffa0261b15>] ? :kvm:do_insn_fetch+0x89/0xcc
Dec 2 10:53:40 camelot kernel: [498738.031444] [<ffffffffa02660f7>] ? :kvm:x86_emulate_insn+0x3915/0x45da
Dec 2 10:53:40 camelot kernel: [498738.031444] [<ffffffffa02625cf>] ? :kvm:x86_decode_insn+0x8cd/0xae0
Dec 2 10:53:40 camelot kernel: [498738.031444] [<ffffffffa0257965>] ? :kvm:kvm_read_guest_page+0x34/0x46
Dec 2 10:53:40 camelot kernel: [498738.031444] [<ffffffffa025a66b>] ? :kvm:emulate_instruction+0x1a0/0x2d3
Dec 2 10:53:40 camelot kernel: [498738.031444] [<ffffffffa025ffdd>] ? :kvm:kvm_mmu_page_fault+0x46/0x81
Dec 2 10:53:40 camelot kernel: [498738.031444] [<ffffffffa025d4d5>] ? :kvm:kvm_arch_vcpu_ioctl_run+0x463/0x615
Dec 2 10:53:40 camelot kernel: [498738.031444] [<ffffffff8021a51e>] ? apic_wait_icr_idle+0xe/0x15
Dec 2 10:53:40 camelot kernel: [498738.031444] [<ffffffffa02586cc>] ? :kvm:kvm_vcpu_ioctl+0xf3/0x3a9
Dec 2 10:53:40 camelot kernel: [498738.031444] [<ffffffff80231997>] ? check_preempt_wakeup+0xc4/0xf0
Dec 2 10:53:40 camelot kernel: [498738.031444] [<ffffffff8021a51e>] ? apic_wait_icr_idle+0xe/0x15
Dec 2 10:53:40 camelot kernel: [498738.031444] [<ffffffff8022c157>] ? try_to_wake_up+0x118/0x129
Dec 2 10:53:40 camelot kernel: [498738.031444] [<ffffffff8024fb2f>] ? futex_wake+0x74/0xfa
Dec 2 10:53:40 camelot kernel: [498738.031444] [<ffffffff80250724>] ? do_futex+0xa6/0x78a
Dec 2 10:53:40 camelot kernel: [498738.031444] [<ffffffff8023de77>] ? recalc_sigpending+0xe/0x38
Dec 2 10:53:40 camelot kernel: [498738.031444] [<ffffffff8023f16b>] ? dequeue_signal+0x8d/0x111
Dec 2 10:53:40 camelot kernel: [498738.031444] [<ffffffffa0258362>] ? :kvm:kvm_vm_ioctl+0x19c/0x1b5
Dec 2 10:53:40 camelot kernel: [498738.031444] [<ffffffff8025d4ed>] ? compat_sys_rt_sigtimedwait+0xfc/0x267
Dec 2 10:53:40 camelot kernel: [498738.031444] [<ffffffff80212507>] ? read_tsc+0x9/0x20
Dec 2 10:53:40 camelot kernel: [498738.031444] [<ffffffff802c8763>] ? compat_sys_ioctl+0xc8/0x330
Dec 2 10:53:40 camelot kernel: [498738.031444] [<ffffffff80251360>] ? compat_sys_futex+0xf8/0x116
Dec 2 10:53:40 camelot kernel: [498738.031444] [<ffffffff80244d7c>] ? posix_ktime_get_ts+0xc/0x10
Dec 2 10:53:40 camelot kernel: [498738.031444] [<ffffffff80224cc4>] ? sysenter_do_call+0x1e/0x75
Dec 2 10:53:40 camelot kernel: [498738.031444]
Dec 2 10:53:40 camelot kernel: [498738.031444]
Dec 2 10:53:40 camelot kernel: [498738.031444] Code: 48 98 48 8b 7c c3 08 e8 b4 82 03 e0 8b 03 85 c0 75 ea 5b c3 55 48 89 f5 53 89 d3 48 83 ec 08 e8 c3 90 ff ff 85 db 48 89 c1 75 11 <48> 2b 28 48 8d 14 ed 00 00 00 00 48 03 50 18 eb 19 48 8b 00 48
Dec 2 10:53:40 camelot kernel: [498738.031444] RIP [<ffffffffa025e963>] :kvm:gfn_to_rmap+0x17/0x49
Dec 2 10:53:40 camelot kernel: [498738.031444] RSP <ffff8103379f9a38>
Dec 2 10:53:40 camelot kernel: [498738.031444] CR2: 0000000000000000
Dec 2 10:53:40 camelot kernel: [498738.033427] ---[ end trace 49a18a74b58293ce ]---
Dec 2 10:54:44 camelot kernel: [498804.618141] BUG: soft lockup - CPU#2 stuck for 61s! [kvm:3276]
Dec 2 10:54:44 camelot kernel: [498804.618141] Modules linked in: tun kvm_intel kvm ipv6 bridge loop snd_pcm snd_timer snd soundcore snd_page_alloc i2c_i801 i2c_core parport_pc parport shpchp pcspkr rng_core i5000_edac container button pci_hotplug edac_core evdev ext3 jbd mbcache dm_mirror dm_log dm_snapshot dm_mod ide_cd_mod cdrom piix ide_pci_generic ide_core ses enclosure sd_mod ata_generic libata dock ehci_hcd uhci_hcd tg3 aacraid scsi_mod thermal processor fan thermal_sys [last unloaded: scsi_wait_scan]
Dec 2 10:54:44 camelot kernel: [498804.618141] CPU 2:
Dec 2 10:54:44 camelot kernel: [498804.618141] Modules linked in: tun kvm_intel kvm ipv6 bridge loop snd_pcm snd_timer snd soundcore snd_page_alloc i2c_i801 i2c_core parport_pc parport shpchp pcspkr rng_core i5000_edac container button pci_hotplug edac_core evdev ext3 jbd mbcache dm_mirror dm_log dm_snapshot dm_mod ide_cd_mod cdrom piix ide_pci_generic ide_core ses enclosure sd_mod ata_generic libata dock ehci_hcd uhci_hcd tg3 aacraid scsi_mod thermal processor fan thermal_sys [last unloaded: scsi_wait_scan]
Dec 2 10:54:44 camelot kernel: [498804.618141] Pid: 3276, comm: kvm Tainted: G D 2.6.26-2-amd64 #1
Dec 2 10:54:44 camelot kernel: [498804.618141] RIP: 0010:[<ffffffff8042a52a>] [<ffffffff8042a52a>] _spin_lock+0x10/0x15
Dec 2 10:54:44 camelot kernel: [498804.618141] RSP: 0018:ffff8103379fdb80 EFLAGS: 00000297
Dec 2 10:54:44 camelot kernel: [498804.618141] RAX: 000000000000a6a5 RBX: 000000000000001d RCX: ffff810000000000
Dec 2 10:54:44 camelot kernel: [498804.618141] RDX: 00000000002c128d RSI: 0000000000000286 RDI: ffff8103379d4018
Dec 2 10:54:44 camelot kernel: [498804.618141] RBP: 0000000100000007 R08: 0000000000000001 R09: 0000000000128063
Dec 2 10:54:44 camelot kernel: [498804.618141] R10: 0000000000000000 R11: ffffffffa027afa3 R12: ffff8103379fe140
Dec 2 10:54:44 camelot kernel: [498804.618141] R13: ffff8103379fdbd8 R14: ffffffff8028223a R15: 0000000000000000
Dec 2 10:54:44 camelot kernel: [498804.618141] FS: 0000000000000000(0000) GS:ffff81033e48b0c0(0000) knlGS:0000000099af7b90
Dec 2 10:54:44 camelot kernel: [498804.618141] CS: 0010 DS: 002b ES: 002b CR0: 000000008005003b
Dec 2 10:54:44 camelot kernel: [498804.618141] CR2: 0000000017c36018 CR3: 0000000338cc7000 CR4: 00000000000026e0
Dec 2 10:54:44 camelot kernel: [498804.618141] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Dec 2 10:54:44 camelot kernel: [498804.618141] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Dec 2 10:54:44 camelot kernel: [498804.618141]
Dec 2 10:54:44 camelot kernel: [498804.618141] Call Trace:
Dec 2 10:54:44 camelot kernel: [498804.618141] [<ffffffffa02613c1>] ? :kvm:paging64_page_fault+0x146/0x3bf
Dec 2 10:54:44 camelot kernel: [498804.618141] [<ffffffff80248d7b>] ? ktime_get+0xc/0x41
Dec 2 10:54:44 camelot kernel: [498804.618141] [<ffffffffa0278ea8>] ? :kvm_intel:vmx_vcpu_load+0x17/0x134
Dec 2 10:54:44 camelot kernel: [498804.618141] [<ffffffff80229020>] ? hrtick_start_fair+0xfb/0x144
Dec 2 10:54:44 camelot kernel: [498804.618141] [<ffffffff8022efd6>] ? hrtick_set+0x88/0xf7
Dec 2 10:54:44 camelot kernel: [498804.618141] [<ffffffffa025ffb0>] ? :kvm:kvm_mmu_page_fault+0x19/0x81
Dec 2 10:54:44 camelot kernel: [498804.618141] [<ffffffffa025d4d5>] ? :kvm:kvm_arch_vcpu_ioctl_run+0x463/0x615
Dec 2 10:54:44 camelot kernel: [498804.618141] [<ffffffff8022c157>] ? try_to_wake_up+0x118/0x129
Dec 2 10:54:44 camelot kernel: [498804.618141] [<ffffffffa02586cc>] ? :kvm:kvm_vcpu_ioctl+0xf3/0x3a9
Dec 2 10:54:44 camelot kernel: [498804.618141] [<ffffffff802283fa>] ? __wake_up_common+0x41/0x74
Dec 2 10:54:44 camelot kernel: [498804.618141] [<ffffffff8024fb2f>] ? futex_wake+0x74/0xfa
Dec 2 10:54:44 camelot kernel: [498804.618141] [<ffffffff80250724>] ? do_futex+0xa6/0x78a
Dec 2 10:54:44 camelot kernel: [498804.618141] [<ffffffff80248d46>] ? ktime_get_ts+0x22/0x4b
Dec 2 10:54:44 camelot kernel: [498804.618141] [<ffffffffa0258362>] ? :kvm:kvm_vm_ioctl+0x19c/0x1b5
Dec 2 10:54:44 camelot kernel: [498804.618141] [<ffffffff8022efd6>] ? hrtick_set+0x88/0xf7
Dec 2 10:54:44 camelot kernel: [498804.618141] [<ffffffff80212507>] ? read_tsc+0x9/0x20
Dec 2 10:54:44 camelot kernel: [498804.618141] [<ffffffff802c8763>] ? compat_sys_ioctl+0xc8/0x330
Dec 2 10:54:44 camelot kernel: [498804.618141] [<ffffffff80251360>] ? compat_sys_futex+0xf8/0x116
Dec 2 10:54:44 camelot kernel: [498804.618141] [<ffffffff80244d7c>] ? posix_ktime_get_ts+0xc/0x10
Dec 2 10:54:44 camelot kernel: [498804.618141] [<ffffffff80224cc4>] ? sysenter_do_call+0x1e/0x75
Dec 2 10:54:44 camelot kernel: [498804.618141]
-- System Information:
Debian Release: 5.0.6
APT prefers stable
APT policy: (500, 'stable')
Architecture: i386 (x86_64)
Kernel: Linux 2.6.26-2-amd64 (SMP w/4 CPU cores)
Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8)
Shell: /bin/sh linked to /bin/bash
Reply to: