Bug#501465: linux-image-2.6.26-1-xen-amd64: Eeek! page_mapcount(page) went negative! (-1), kernel BUG at mm/rmap.c:669!
Package: linux-image-2.6.26-1-xen-amd64
Version: 2.6.26-7
Severity: normal
Hi folks,
Yesterday I converted one of our mail filtering machines (XEN domU) to Lenny and
restarted it with the new 2.6.26-1-xen-amd64 kernel from unstable. This
afternoon the system died, producing some famous last words at the console and
in /var/log/syslog [1].
The dom0 system is based on Etch, running xen-linux-system-2.6.18-xen-3.1-2-amd64
version 2.6.18.dfsg.1-22etch2+xen.1 with xen-hypervisor-3.2-1-amd64 and
xen-utils-3.2-1 3.2.1-2 from unstable, which I backported to Etch [2].
Greetings,
Hans van Kranenburg
[1] http://packages.mendix.com/debian/pool/main/x/xen-3/
[2] Messages from syslog, without hostname/timestamp:
kernel: [54485.642631] Eeek! page_mapcount(page) went negative! (-1)
kernel: [54485.642643] page pfn = 3
kernel: [54485.642646] page->flags = 0
kernel: [54485.642649] page->count = 1
kernel: [54485.642652] page->mapping = 0000000000000000
kernel: [54485.642663] vma->vm_ops = 0x0
kernel: [54485.642681] ------------[ cut here ]------------
kernel: [54485.642684] kernel BUG at mm/rmap.c:669!
kernel: [54485.642687] invalid opcode: 0000 [1] SMP
kernel: [54485.642692] CPU 0
kernel: [54485.642696] Modules linked in: ip6table_filter xt_multiport ip6t_LOG ip6_tables xt_tcpudp iptable_nat nf_nat ipt_REJECT xt_owner xt_state
xt_limit ipt_LOG iptable_mangle iptable_filter nf_conntrack_ipv4 nf_conntrack ip_tables x_tables ipv6 evdev reiserfs dm_mirror dm_log dm_snapshot
dm_mod raid1 md_mod thermal_sys
kernel: [54485.642733] Pid: 6449, comm: clamd Not tainted 2.6.26-1-xen-amd64 #1
kernel: [54485.642736] RIP: e030:[<ffffffff8027c464>] [<ffffffff8027c464>] page_remove_rmap+0xfb/0x117
kernel: [54485.642747] RSP: e02b:ffff88001e93fdf8 EFLAGS: 00010246
kernel: [54485.642750] RAX: 0000000000000000 RBX: ffff8800019650a8 RCX: ffffffffff5f7000
kernel: [54485.642754] RDX: ffffffffff5f7000 RSI: 0000000000000001 RDI: ffffffff80501fc0
kernel: [54485.642758] RBP: ffff88001e01e7c8 R08: ffffffff80501fb0 R09: ffff88001e01e701
kernel: [54485.642762] R10: 0000000000000024 R11: 000000000000add8 R12: ffff8800019650a8
kernel: [54485.642765] R13: 0000000000000008 R14: ffff88001e00b7c0 R15: ffff88001e01e7c8
kernel: [54485.642772] FS: 0000000000000000(0063) GS:ffffffff80539000(0000) knlGS:0000000000000000
kernel: [54485.642776] CS: e033 DS: 0000 ES: 0000
kernel: [54485.642779] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
kernel: [54485.642784] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
kernel: [54485.642788] Process clamd (pid: 6449, threadinfo ffff88001e93e000, task ffff880001183410)
kernel: [54485.642791] Stack: 0000000007c8b000 800000025186c067 ffff880001c8f828 ffffffff80272468
kernel: [54485.642799] ffff88001c4ee440 ffff88001e4501f0 ffff8800007b3458 ffff88000197ff38
kernel: [54485.642806] ffff8800007b3458 ffff88000197ff38 ffff8800007b3458 0000000000000006
kernel: [54485.642812] Call Trace:
kernel: [54485.642819] [<ffffffff80272468>] ? do_wp_page+0x6cf/0x789
kernel: [54485.642827] [<ffffffff80276c1c>] ? handle_mm_fault+0xbcb/0xc49
kernel: [54485.642835] [<ffffffff802181fd>] ? do_page_fault+0xb73/0xf50
kernel: [54485.642843] [<ffffffff804361f7>] ? error_exit+0x0/0x69
kernel: [54485.642851]
kernel: [54485.642852]
kernel: [54485.642854] Code: 80 e8 3c 0c fd ff 48 8b 85 90 00 00 00 48 85 c0 74 19 48 8b 40 20 48 85 c0 74 10 48 8b 70 58 48 c7 c7 4e 52 4b 80 e8 17 0c
fd ff <0f> 0b eb fe 8b 77 18 41 58 5b 5d 83 e6 01 f7 de 83 c6 04 e9 6c
kernel: [54485.642908] RIP [<ffffffff8027c464>] page_remove_rmap+0xfb/0x117
kernel: [54485.642913] RSP <ffff88001e93fdf8>
kernel: [54485.642923] ---[ end trace 214fecd260858cd4 ]---
kernel: [54939.763806] Bad page state in process 'sshd'
kernel: [54939.763806] page:ffff8800019652a0 flags:0x0000000000040000 mapping:0000000000000000 mapcount:0 count:0
kernel: [54939.763806] Trying to fix it up, but a reboot is needed
kernel: [54939.763806] Backtrace:
kernel: [54939.763806] Pid: 6471, comm: sshd Tainted: G D 2.6.26-1-xen-amd64 #1
kernel: [54939.763806]
kernel: [54939.763806] Call Trace:
kernel: [54939.763806] [<ffffffff802683e4>] bad_page+0x6b/0x95
kernel: [54939.763806] [<ffffffff80268b33>] free_hot_cold_page+0x89/0x1ba
kernel: [54939.763806] [<ffffffff80268c85>] __pagevec_free+0x21/0x2e
kernel: [54939.763822] [<ffffffff8026bcb7>] release_pages+0x160/0x172
kernel: [54939.763841] [<ffffffff8027f52a>] free_pages_and_swap_cache+0x72/0x8e
kernel: [54939.763861] [<ffffffff802784d0>] exit_mmap+0xc8/0xf7
kernel: [54939.763881] [<ffffffff8022a6bd>] mmput+0x2c/0xc0
kernel: [54939.763905] [<ffffffff8028f07f>] flush_old_exec+0x6df/0xa45
kernel: [54939.763918] [<ffffffff8028aa40>] vfs_read+0x11e/0x152
kernel: [54939.763926] [<ffffffff802bce9b>] load_elf_binary+0x341/0x16c4
kernel: [54939.763933] [<ffffffff8028dc9e>] get_arg_page+0x46/0xa5
kernel: [54939.763940] [<ffffffff80313b95>] __strnlen_user+0xe/0x27
kernel: [54939.763946] [<ffffffff8028df8d>] copy_strings+0x1b8/0x1c9
kernel: [54939.763952] [<ffffffff8028e086>] search_binary_handler+0xb0/0x1e5
kernel: [54939.763958] [<ffffffff8028f6cf>] do_execve+0x168/0x215
kernel: [54939.763963] [<ffffffff80209425>] sys_execve+0x35/0x4c
kernel: [54939.763969] [<ffffffff8020b950>] stub_execve+0x40/0x70
kernel: [54939.763976]
kernel: [54939.763981] Bad page state in process 'sshd'
kernel: [54939.763982] page:ffff880001965268 flags:0x0000000000040000 mapping:0000000000000000 mapcount:0 count:0
kernel: [54939.763987] Trying to fix it up, but a reboot is needed
kernel: [54939.763989] Backtrace:
kernel: [54939.764000] Pid: 6471, comm: sshd Tainted: G B D 2.6.26-1-xen-amd64 #1
kernel: [54939.764002]
kernel: [54939.764003] Call Trace:
kernel: [54939.764006] [<ffffffff802683e4>] bad_page+0x6b/0x95
kernel: [54939.764010] [<ffffffff80268b33>] free_hot_cold_page+0x89/0x1ba
kernel: [54939.764014] [<ffffffff80268c85>] __pagevec_free+0x21/0x2e
kernel: [54939.764020] [<ffffffff8026bcb7>] release_pages+0x160/0x172
kernel: [54939.764028] [<ffffffff8027f52a>] free_pages_and_swap_cache+0x72/0x8e
kernel: [54939.764035] [<ffffffff802784d0>] exit_mmap+0xc8/0xf7
kernel: [54939.764040] [<ffffffff8022a6bd>] mmput+0x2c/0xc0
kernel: [54939.764045] [<ffffffff8028f07f>] flush_old_exec+0x6df/0xa45
kernel: [54939.764051] [<ffffffff8028aa40>] vfs_read+0x11e/0x152
kernel: [54939.764057] [<ffffffff802bce9b>] load_elf_binary+0x341/0x16c4
kernel: [54939.764063] [<ffffffff8028dc9e>] get_arg_page+0x46/0xa5
kernel: [54939.764067] [<ffffffff80313b95>] __strnlen_user+0xe/0x27
kernel: [54939.764071] [<ffffffff8028df8d>] copy_strings+0x1b8/0x1c9
kernel: [54939.764077] [<ffffffff8028e086>] search_binary_handler+0xb0/0x1e5
kernel: [54939.764082] [<ffffffff8028f6cf>] do_execve+0x168/0x215
kernel: [54939.764088] [<ffffffff80209425>] sys_execve+0x35/0x4c
kernel: [54939.764094] [<ffffffff8020b950>] stub_execve+0x40/0x70
kernel: [54939.764101]
kernel: [54995.809577] Bad page state in process 'sshd'
kernel: [54995.809579] page:ffff8800019652a0 flags:0x0000000000040000 mapping:0000000000000000 mapcount:0 count:0
kernel: [54995.809607] Trying to fix it up, but a reboot is needed
kernel: [54995.809609] Backtrace:
kernel: [54995.809626] Pid: 6475, comm: sshd Tainted: G B D 2.6.26-1-xen-amd64 #1
kernel: [54995.809639]
kernel: [54995.809640] Call Trace:
kernel: [54995.810093] [<ffffffff802683e4>] bad_page+0x6b/0x95
kernel: [54995.810108] [<ffffffff80268b33>] free_hot_cold_page+0x89/0x1ba
kernel: [54995.810123] [<ffffffff80268c85>] __pagevec_free+0x21/0x2e
kernel: [54995.810138] [<ffffffff8026bcb7>] release_pages+0x160/0x172
kernel: [54995.810157] [<ffffffff8027f52a>] free_pages_and_swap_cache+0x72/0x8e
kernel: [54995.810172] [<ffffffff802784d0>] exit_mmap+0xc8/0xf7
kernel: [54995.810187] [<ffffffff8022a6bd>] mmput+0x2c/0xc0
kernel: [54995.810203] [<ffffffff8028f07f>] flush_old_exec+0x6df/0xa45
kernel: [54995.810218] [<ffffffff8028aa40>] vfs_read+0x11e/0x152
kernel: [54995.810235] [<ffffffff802bce9b>] load_elf_binary+0x341/0x16c4
kernel: [54995.810251] [<ffffffff8028dc9e>] get_arg_page+0x46/0xa5
kernel: [54995.810258] [<ffffffff80313b95>] __strnlen_user+0xe/0x27
kernel: [54995.810263] [<ffffffff8028df8d>] copy_strings+0x1b8/0x1c9
kernel: [54995.810270] [<ffffffff8028e086>] search_binary_handler+0xb0/0x1e5
kernel: [54995.810276] [<ffffffff8028f6cf>] do_execve+0x168/0x215
kernel: [54995.810282] [<ffffffff80209425>] sys_execve+0x35/0x4c
kernel: [54995.810288] [<ffffffff8020b950>] stub_execve+0x40/0x70
kernel: [54995.810295]
kernel: [54995.810300] Bad page state in process 'sshd'
kernel: [54995.810302] page:ffff880001965268 flags:0x0000000000040000 mapping:0000000000000000 mapcount:0 count:0
kernel: [54995.810306] Trying to fix it up, but a reboot is needed
kernel: [54995.810308] Backtrace:
kernel: [54995.810312] Pid: 6475, comm: sshd Tainted: G B D 2.6.26-1-xen-amd64 #1
kernel: [54995.810316]
kernel: [54995.810317] Call Trace:
kernel: [54995.810321] [<ffffffff802683e4>] bad_page+0x6b/0x95
kernel: [54995.810326] [<ffffffff80268b33>] free_hot_cold_page+0x89/0x1ba
kernel: [54995.810331] [<ffffffff80268c85>] __pagevec_free+0x21/0x2e
kernel: [54995.810336] [<ffffffff8026bcb7>] release_pages+0x160/0x172
kernel: [54995.810345] [<ffffffff8027f52a>] free_pages_and_swap_cache+0x72/0x8e
kernel: [54995.810351] [<ffffffff802784d0>] exit_mmap+0xc8/0xf7
kernel: [54995.810356] [<ffffffff8022a6bd>] mmput+0x2c/0xc0
kernel: [54995.810361] [<ffffffff8028f07f>] flush_old_exec+0x6df/0xa45
kernel: [54995.810367] [<ffffffff8028aa40>] vfs_read+0x11e/0x152
kernel: [54995.810373] [<ffffffff802bce9b>] load_elf_binary+0x341/0x16c4
kernel: [54995.810380] [<ffffffff8028dc9e>] get_arg_page+0x46/0xa5
kernel: [54995.810385] [<ffffffff80313b95>] __strnlen_user+0xe/0x27
kernel: [54995.810390] [<ffffffff8028df8d>] copy_strings+0x1b8/0x1c9
kernel: [54995.810397] [<ffffffff8028e086>] search_binary_handler+0xb0/0x1e5
kernel: [54995.810402] [<ffffffff8028f6cf>] do_execve+0x168/0x215
kernel: [54995.810408] [<ffffffff80209425>] sys_execve+0x35/0x4c
kernel: [54995.810413] [<ffffffff8020b950>] stub_execve+0x40/0x70
kernel: [54995.810420]
... dead, had to do xm destroy on the dom0 host ...
-- System Information:
Debian Release: lenny/sid
APT prefers testing
APT policy: (900, 'testing'), (800, 'unstable')
Architecture: amd64 (x86_64)
Kernel: Linux 2.6.26-1-xen-amd64 (SMP w/2 CPU cores)
Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8)
Shell: /bin/sh linked to /bin/bash
Reply to: