Bug#574348: Kernel 2.6.32-9: crash
Package: linux-2.6
Version: 2.6.32-9
Hi all,
we have numerous fileservers currently running variants of 2.6.30,
2.6.32 and 2.6.33. When we used 2.6.32-9 (with ABI version 3), we got
repeated crashes on one server in kswapd and flush. Three hours after
these traces, the machine crashed hard (no console, no sysrq). A day
later, the machine crashed again with 2.6.32-9, albeit leaving no
messages in syslog. We're now back to using 2.6.30, which seems more
stable.
The server is moderatly loaded with nfs3/4 traffic and has 151 exports
and has 4 ext4-filesystems (1.5TiB in total).
Mar 11 06:45:14 river kernel: [40200.628071] kswapd0 D 0000000000000002 0 47 2 0x00000000
Mar 11 06:45:14 river kernel: [40200.628076] ffff88022f073880 0000000000000046 0000000000000000 ffffffff810114ce
Mar 11 06:45:14 river kernel: [40200.628080] ffffffffb468199e 000000000000f8a0 ffff88022c8e3fd8 00000000000155c0
Mar 11 06:45:14 river kernel: [40200.628084] 00000000000155c0 ffff88022f135bd0 ffff88022f135ec8 0000000100000000
Mar 11 06:45:14 river kernel: [40200.628088] Call Trace:
Mar 11 06:45:14 river kernel: [40200.628112] [<ffffffff810114ce>] ? common_interrupt+0xe/0x13
Mar 11 06:45:14 river kernel: [40200.628116] [<ffffffff81098e5e>] ? delayacct_end+0x74/0x7f
Mar 11 06:45:14 river kernel: [40200.628129] [<ffffffffa038dc38>] ? nfs_wait_bit_uninterruptible+0x0/0xd [nfs]
Mar 11 06:45:14 river kernel: [40200.628134] [<ffffffff812ee03d>] ? io_schedule+0x73/0xb7
Mar 11 06:45:14 river kernel: [40200.628140] [<ffffffffa038dc41>] ? nfs_wait_bit_uninterruptible+0x9/0xd [nfs]
Mar 11 06:45:14 river kernel: [40200.628143] [<ffffffff812ee53d>] ? __wait_on_bit+0x41/0x70
Mar 11 06:45:14 river kernel: [40200.628148] [<ffffffff8118a10f>] ? __lookup_tag+0xad/0x11b
Mar 11 06:45:14 river kernel: [40200.628154] [<ffffffffa038dc38>] ? nfs_wait_bit_uninterruptible+0x0/0xd [nfs]
Mar 11 06:45:14 river kernel: [40200.628157] [<ffffffff812ee5d7>] ? out_of_line_wait_on_bit+0x6b/0x77
Mar 11 06:45:14 river kernel: [40200.628161] [<ffffffff81064a64>] ? wake_bit_function+0x0/0x23
Mar 11 06:45:14 river kernel: [40200.628168] [<ffffffffa0391bc3>] ? nfs_sync_mapping_wait+0xfa/0x227 [nfs]
Mar 11 06:45:14 river kernel: [40200.628175] [<ffffffffa0391d84>] ? nfs_wb_page+0x94/0xc3 [nfs]
Mar 11 06:45:14 river kernel: [40200.628179] [<ffffffff810b4968>] ? __remove_from_page_cache+0x33/0xb6
Mar 11 06:45:14 river kernel: [40200.628185] [<ffffffffa0384e54>] ? nfs_release_page+0x3a/0x57 [nfs]
Mar 11 06:45:14 river kernel: [40200.628189] [<ffffffff810bd244>] ? shrink_page_list+0x481/0x617
Mar 11 06:45:14 river kernel: [40200.628192] [<ffffffff8101166e>] ? apic_timer_interrupt+0xe/0x20
Mar 11 06:45:14 river kernel: [40200.628195] [<ffffffff810bc317>] ? isolate_pages_global+0x1a0/0x20f
Mar 11 06:45:14 river kernel: [40200.628198] [<ffffffff810bdaf1>] ? shrink_list+0x44a/0x725
Mar 11 06:45:14 river kernel: [40200.628206] [<ffffffffa0276828>] ? jbd2_journal_release_jbd_inode+0x55/0x10e [jbd2]
Mar 11 06:45:14 river kernel: [40200.628211] [<ffffffff810e2fd7>] ? add_partial+0x11/0x58
Mar 11 06:45:14 river kernel: [40200.628214] [<ffffffff810be04c>] ? shrink_zone+0x280/0x342
Mar 11 06:45:14 river kernel: [40200.628216] [<ffffffff810be24f>] ? shrink_slab+0x141/0x153
Mar 11 06:45:14 river kernel: [40200.628219] [<ffffffff810bea71>] ? kswapd+0x4b9/0x683
Mar 11 06:45:14 river kernel: [40200.628222] [<ffffffff810bc177>] ? isolate_pages_global+0x0/0x20f
Mar 11 06:45:14 river kernel: [40200.628224] [<ffffffff81064a36>] ? autoremove_wake_function+0x0/0x2e
Mar 11 06:45:14 river kernel: [40200.628227] [<ffffffff810be5b8>] ? kswapd+0x0/0x683
Mar 11 06:45:14 river kernel: [40200.628229] [<ffffffff81064769>] ? kthread+0x79/0x81
Mar 11 06:45:14 river kernel: [40200.628232] [<ffffffff81011baa>] ? child_rip+0xa/0x20
Mar 11 06:45:14 river kernel: [40200.628234] [<ffffffff810646f0>] ? kthread+0x0/0x81
Mar 11 06:45:14 river kernel: [40200.628237] [<ffffffff81011ba0>] ? child_rip+0x0/0x20
Mar 11 06:45:14 river kernel: [40200.628409] flush-0:24 D 0000000000000002 0 4682 2 0x00000000
Mar 11 06:45:14 river kernel: [40200.628412] ffff88022f0754c0 0000000000000046 0000000000000000 ffff88020bfbf1ac
Mar 11 06:45:14 river kernel: [40200.628415] 0000000000000000 000000000000f8a0 ffff88020bfbffd8 00000000000155c0
Mar 11 06:45:14 river kernel: [40200.628418] 00000000000155c0 ffff880203973170 ffff880203973468 0000000200000000
Mar 11 06:45:14 river kernel: [40200.628421] Call Trace:
Mar 11 06:45:14 river kernel: [40200.628423] [<ffffffff81098e5e>] ? delayacct_end+0x74/0x7f
Mar 11 06:45:14 river kernel: [40200.628430] [<ffffffffa038dc38>] ? nfs_wait_bit_uninterruptible+0x0/0xd [nfs]
Mar 11 06:45:14 river kernel: [40200.628433] [<ffffffff812ee03d>] ? io_schedule+0x73/0xb7
Mar 11 06:45:14 river kernel: [40200.628439] [<ffffffffa038dc41>] ? nfs_wait_bit_uninterruptible+0x9/0xd [nfs]
Mar 11 06:45:14 river kernel: [40200.628442] [<ffffffff812ee53d>] ? __wait_on_bit+0x41/0x70
Mar 11 06:45:14 river kernel: [40200.628445] [<ffffffff8118a10f>] ? __lookup_tag+0xad/0x11b
Mar 11 06:45:14 river kernel: [40200.628451] [<ffffffffa038dc38>] ? nfs_wait_bit_uninterruptible+0x0/0xd [nfs]
Mar 11 06:45:14 river kernel: [40200.628454] [<ffffffff812ee5d7>] ? out_of_line_wait_on_bit+0x6b/0x77
Mar 11 06:45:14 river kernel: [40200.628456] [<ffffffff81064a64>] ? wake_bit_function+0x0/0x23
Mar 11 06:45:14 river kernel: [40200.628464] [<ffffffffa0391bc3>] ? nfs_sync_mapping_wait+0xfa/0x227 [nfs]
Mar 11 06:45:14 river kernel: [40200.628471] [<ffffffffa0391d84>] ? nfs_wb_page+0x94/0xc3 [nfs]
Mar 11 06:45:14 river kernel: [40200.628473] [<ffffffff810b4968>] ? __remove_from_page_cache+0x33/0xb6
Mar 11 06:45:14 river kernel: [40200.628479] [<ffffffffa0384e54>] ? nfs_release_page+0x3a/0x57 [nfs]
Mar 11 06:45:14 river kernel: [40200.628482] [<ffffffff810bd244>] ? shrink_page_list+0x481/0x617
Mar 11 06:45:14 river kernel: [40200.628486] [<ffffffff812564c7>] ? sch_direct_xmit+0x7f/0x14c
Mar 11 06:45:14 river kernel: [40200.628489] [<ffffffff810bc317>] ? isolate_pages_global+0x1a0/0x20f
Mar 11 06:45:14 river kernel: [40200.628492] [<ffffffff810bdaf1>] ? shrink_list+0x44a/0x725
Mar 11 06:45:14 river kernel: [40200.628495] [<ffffffff810b9dfc>] ? determine_dirtyable_memory+0xd/0x1d
Mar 11 06:45:14 river kernel: [40200.628498] [<ffffffff810b9e74>] ? get_dirty_limits+0x1d/0x259
Mar 11 06:45:14 river kernel: [40200.628500] [<ffffffff810be04c>] ? shrink_zone+0x280/0x342
Mar 11 06:45:14 river kernel: [40200.628504] [<ffffffff810c63ac>] ? zone_statistics+0x3c/0x5d
Mar 11 06:45:14 river kernel: [40200.628507] [<ffffffff810bf110>] ? try_to_free_pages+0x232/0x38e
Mar 11 06:45:14 river kernel: [40200.628510] [<ffffffff810bc177>] ? isolate_pages_global+0x0/0x20f
Mar 11 06:45:14 river kernel: [40200.628512] [<ffffffff810b92c5>] ? __alloc_pages_nodemask+0x3bb/0x5ce
Mar 11 06:45:14 river kernel: [40200.628516] [<ffffffff810e5190>] ? new_slab+0x42/0x1ca
Mar 11 06:45:14 river kernel: [40200.628519] [<ffffffff810e5508>] ? __slab_alloc+0x1f0/0x39b
Mar 11 06:45:14 river kernel: [40200.628526] [<ffffffffa03924c9>] ? nfs_writedata_alloc+0x74/0x98 [nfs]
Mar 11 06:45:14 river kernel: [40200.628530] [<ffffffff810e67eb>] ? __kmalloc+0xf1/0x141
Mar 11 06:45:14 river kernel: [40200.628532] [<ffffffff8118a10f>] ? __lookup_tag+0xad/0x11b
Mar 11 06:45:14 river kernel: [40200.628539] [<ffffffffa03924c9>] ? nfs_writedata_alloc+0x74/0x98 [nfs]
Mar 11 06:45:14 river kernel: [40200.628546] [<ffffffffa03924c9>] ? nfs_writedata_alloc+0x74/0x98 [nfs]
Mar 11 06:45:14 river kernel: [40200.628553] [<ffffffffa0392501>] ? nfs_flush_one+0x14/0xce [nfs]
Mar 11 06:45:14 river kernel: [40200.628559] [<ffffffffa038daf0>] ? nfs_pageio_doio+0x2a/0x51 [nfs]
Mar 11 06:45:14 river kernel: [40200.628566] [<ffffffffa038dbdc>] ? nfs_pageio_add_request+0xc5/0xd5 [nfs]
Mar 11 06:45:14 river kernel: [40200.628573] [<ffffffffa0390dfd>] ? nfs_do_writepage+0x100/0x122 [nfs]
Mar 11 06:45:14 river kernel: [40200.628580] [<ffffffffa0391316>] ? nfs_writepages_callback+0xf/0x21 [nfs]
Mar 11 06:45:14 river kernel: [40200.628583] [<ffffffff810b9b69>] ? write_cache_pages+0x20b/0x327
Mar 11 06:45:14 river kernel: [40200.628590] [<ffffffffa0391307>] ? nfs_writepages_callback+0x0/0x21 [nfs]
Mar 11 06:45:14 river kernel: [40200.628597] [<ffffffffa03912c6>] ? nfs_writepages+0xef/0x130 [nfs]
Mar 11 06:45:14 river kernel: [40200.628604] [<ffffffffa03924ed>] ? nfs_flush_one+0x0/0xce [nfs]
Mar 11 06:45:14 river kernel: [40200.628607] [<ffffffff81064957>] ? bit_waitqueue+0x10/0xa0
Mar 11 06:45:14 river kernel: [40200.628611] [<ffffffff8110637e>] ? writeback_single_inode+0xe7/0x2da
Mar 11 06:45:14 river kernel: [40200.628614] [<ffffffff81107057>] ? writeback_inodes_wb+0x423/0x4fe
Mar 11 06:45:14 river kernel: [40200.628617] [<ffffffff8110725e>] ? wb_writeback+0x12c/0x1ab
Mar 11 06:45:14 river kernel: [40200.628620] [<ffffffff811073f2>] ? wb_do_writeback+0x73/0x15b
Mar 11 06:45:14 river kernel: [40200.628622] [<ffffffff8110750b>] ? bdi_writeback_task+0x31/0x9d
Mar 11 06:45:14 river kernel: [40200.628626] [<ffffffff810c7c1e>] ? bdi_start_fn+0x0/0xca
Mar 11 06:45:14 river kernel: [40200.628628] [<ffffffff810c7c8e>] ? bdi_start_fn+0x70/0xca
Mar 11 06:45:14 river kernel: [40200.628631] [<ffffffff810c7c1e>] ? bdi_start_fn+0x0/0xca
Mar 11 06:45:14 river kernel: [40200.628633] [<ffffffff81064769>] ? kthread+0x79/0x81
Mar 11 06:45:14 river kernel: [40200.628636] [<ffffffff81011baa>] ? child_rip+0xa/0x20
Mar 11 06:45:14 river kernel: [40200.628638] [<ffffffff810646f0>] ? kthread+0x0/0x81
Mar 11 06:45:14 river kernel: [40200.628640] [<ffffffff81011ba0>] ? child_rip+0x0/0x20
Mar 11 06:47:14 river kernel: [40320.628074] kswapd0 D 0000000000000002 0 47 2 0x00000000
Mar 11 06:47:14 river kernel: [40320.628079] ffff88022f073880 0000000000000046 0000000000000000 ffffffff810114ce
Mar 11 06:47:14 river kernel: [40320.628083] ffffffffb468199e 000000000000f8a0 ffff88022c8e3fd8 00000000000155c0
Mar 11 06:47:14 river kernel: [40320.628087] 00000000000155c0 ffff88022f135bd0 ffff88022f135ec8 0000000100000000
Mar 11 06:47:14 river kernel: [40320.628101] Call Trace:
Mar 11 06:47:14 river kernel: [40320.628114] [<ffffffff810114ce>] ? common_interrupt+0xe/0x13
Mar 11 06:47:14 river kernel: [40320.628118] [<ffffffff81098e5e>] ? delayacct_end+0x74/0x7f
Mar 11 06:47:14 river kernel: [40320.628131] [<ffffffffa038dc38>] ? nfs_wait_bit_uninterruptible+0x0/0xd [nfs]
Mar 11 06:47:14 river kernel: [40320.628135] [<ffffffff812ee03d>] ? io_schedule+0x73/0xb7
Mar 11 06:47:14 river kernel: [40320.628142] [<ffffffffa038dc41>] ? nfs_wait_bit_uninterruptible+0x9/0xd [nfs]
Mar 11 06:47:14 river kernel: [40320.628144] [<ffffffff812ee53d>] ? __wait_on_bit+0x41/0x70
Mar 11 06:47:14 river kernel: [40320.628149] [<ffffffff8118a10f>] ? __lookup_tag+0xad/0x11b
Mar 11 06:47:14 river kernel: [40320.628156] [<ffffffffa038dc38>] ? nfs_wait_bit_uninterruptible+0x0/0xd [nfs]
Mar 11 06:47:14 river kernel: [40320.628158] [<ffffffff812ee5d7>] ? out_of_line_wait_on_bit+0x6b/0x77
Mar 11 06:47:14 river kernel: [40320.628162] [<ffffffff81064a64>] ? wake_bit_function+0x0/0x23
Mar 11 06:47:14 river kernel: [40320.628169] [<ffffffffa0391bc3>] ? nfs_sync_mapping_wait+0xfa/0x227 [nfs]
Mar 11 06:47:14 river kernel: [40320.628176] [<ffffffffa0391d84>] ? nfs_wb_page+0x94/0xc3 [nfs]
Mar 11 06:47:14 river kernel: [40320.628180] [<ffffffff810b4968>] ? __remove_from_page_cache+0x33/0xb6
Mar 11 06:47:14 river kernel: [40320.628186] [<ffffffffa0384e54>] ? nfs_release_page+0x3a/0x57 [nfs]
Mar 11 06:47:14 river kernel: [40320.628190] [<ffffffff810bd244>] ? shrink_page_list+0x481/0x617
Mar 11 06:47:14 river kernel: [40320.628193] [<ffffffff8101166e>] ? apic_timer_interrupt+0xe/0x20
Mar 11 06:47:14 river kernel: [40320.628196] [<ffffffff810bc317>] ? isolate_pages_global+0x1a0/0x20f
Mar 11 06:47:14 river kernel: [40320.628199] [<ffffffff810bdaf1>] ? shrink_list+0x44a/0x725
Mar 11 06:47:14 river kernel: [40320.628207] [<ffffffffa0276828>] ? jbd2_journal_release_jbd_inode+0x55/0x10e [jbd2]
Mar 11 06:47:14 river kernel: [40320.628211] [<ffffffff810e2fd7>] ? add_partial+0x11/0x58
Mar 11 06:47:14 river kernel: [40320.628214] [<ffffffff810be04c>] ? shrink_zone+0x280/0x342
Mar 11 06:47:14 river kernel: [40320.628217] [<ffffffff810be24f>] ? shrink_slab+0x141/0x153
Mar 11 06:47:14 river kernel: [40320.628219] [<ffffffff810bea71>] ? kswapd+0x4b9/0x683
Mar 11 06:47:14 river kernel: [40320.628222] [<ffffffff810bc177>] ? isolate_pages_global+0x0/0x20f
Mar 11 06:47:14 river kernel: [40320.628225] [<ffffffff81064a36>] ? autoremove_wake_function+0x0/0x2e
Mar 11 06:47:14 river kernel: [40320.628228] [<ffffffff810be5b8>] ? kswapd+0x0/0x683
Mar 11 06:47:14 river kernel: [40320.628230] [<ffffffff81064769>] ? kthread+0x79/0x81
Mar 11 06:47:14 river kernel: [40320.628232] [<ffffffff81011baa>] ? child_rip+0xa/0x20
Mar 11 06:47:14 river kernel: [40320.628235] [<ffffffff810646f0>] ? kthread+0x0/0x81
Mar 11 06:47:14 river kernel: [40320.628237] [<ffffffff81011ba0>] ? child_rip+0x0/0x20
Mar 11 06:47:14 river kernel: [40320.628407] flush-0:24 D 0000000000000002 0 4682 2 0x00000000
Mar 11 06:47:14 river kernel: [40320.628410] ffff88022f0754c0 0000000000000046 0000000000000000 ffff88020bfbf1ac
Mar 11 06:47:14 river kernel: [40320.628413] 0000000000000000 000000000000f8a0 ffff88020bfbffd8 00000000000155c0
Mar 11 06:47:14 river kernel: [40320.628416] 00000000000155c0 ffff880203973170 ffff880203973468 0000000200000000
Mar 11 06:47:14 river kernel: [40320.628419] Call Trace:
Mar 11 06:47:14 river kernel: [40320.628422] [<ffffffff81098e5e>] ? delayacct_end+0x74/0x7f
Mar 11 06:47:14 river kernel: [40320.628428] [<ffffffffa038dc38>] ? nfs_wait_bit_uninterruptible+0x0/0xd [nfs]
Mar 11 06:47:14 river kernel: [40320.628431] [<ffffffff812ee03d>] ? io_schedule+0x73/0xb7
Mar 11 06:47:14 river kernel: [40320.628438] [<ffffffffa038dc41>] ? nfs_wait_bit_uninterruptible+0x9/0xd [nfs]
Mar 11 06:47:14 river kernel: [40320.628440] [<ffffffff812ee53d>] ? __wait_on_bit+0x41/0x70
Mar 11 06:47:14 river kernel: [40320.628443] [<ffffffff8118a10f>] ? __lookup_tag+0xad/0x11b
Mar 11 06:47:14 river kernel: [40320.628450] [<ffffffffa038dc38>] ? nfs_wait_bit_uninterruptible+0x0/0xd [nfs]
Mar 11 06:47:14 river kernel: [40320.628453] [<ffffffff812ee5d7>] ? out_of_line_wait_on_bit+0x6b/0x77
Mar 11 06:47:14 river kernel: [40320.628455] [<ffffffff81064a64>] ? wake_bit_function+0x0/0x23
Mar 11 06:47:14 river kernel: [40320.628462] [<ffffffffa0391bc3>] ? nfs_sync_mapping_wait+0xfa/0x227 [nfs]
Mar 11 06:47:14 river kernel: [40320.628469] [<ffffffffa0391d84>] ? nfs_wb_page+0x94/0xc3 [nfs]
Mar 11 06:47:14 river kernel: [40320.628472] [<ffffffff810b4968>] ? __remove_from_page_cache+0x33/0xb6
Mar 11 06:47:14 river kernel: [40320.628477] [<ffffffffa0384e54>] ? nfs_release_page+0x3a/0x57 [nfs]
Mar 11 06:47:14 river kernel: [40320.628480] [<ffffffff810bd244>] ? shrink_page_list+0x481/0x617
Mar 11 06:47:14 river kernel: [40320.628485] [<ffffffff812564c7>] ? sch_direct_xmit+0x7f/0x14c
Mar 11 06:47:14 river kernel: [40320.628487] [<ffffffff810bc317>] ? isolate_pages_global+0x1a0/0x20f
Mar 11 06:47:14 river kernel: [40320.628490] [<ffffffff810bdaf1>] ? shrink_list+0x44a/0x725
Mar 11 06:47:14 river kernel: [40320.628493] [<ffffffff810b9dfc>] ? determine_dirtyable_memory+0xd/0x1d
Mar 11 06:47:14 river kernel: [40320.628496] [<ffffffff810b9e74>] ? get_dirty_limits+0x1d/0x259
Mar 11 06:47:14 river kernel: [40320.628499] [<ffffffff810be04c>] ? shrink_zone+0x280/0x342
Mar 11 06:47:14 river kernel: [40320.628502] [<ffffffff810c63ac>] ? zone_statistics+0x3c/0x5d
Mar 11 06:47:14 river kernel: [40320.628505] [<ffffffff810bf110>] ? try_to_free_pages+0x232/0x38e
Mar 11 06:47:14 river kernel: [40320.628508] [<ffffffff810bc177>] ? isolate_pages_global+0x0/0x20f
Mar 11 06:47:14 river kernel: [40320.628511] [<ffffffff810b92c5>] ? __alloc_pages_nodemask+0x3bb/0x5ce
Mar 11 06:47:14 river kernel: [40320.628514] [<ffffffff810e5190>] ? new_slab+0x42/0x1ca
Mar 11 06:47:14 river kernel: [40320.628517] [<ffffffff810e5508>] ? __slab_alloc+0x1f0/0x39b
Mar 11 06:47:14 river kernel: [40320.628524] [<ffffffffa03924c9>] ? nfs_writedata_alloc+0x74/0x98 [nfs]
Mar 11 06:47:14 river kernel: [40320.628528] [<ffffffff810e67eb>] ? __kmalloc+0xf1/0x141
Mar 11 06:47:14 river kernel: [40320.628531] [<ffffffff8118a10f>] ? __lookup_tag+0xad/0x11b
Mar 11 06:47:14 river kernel: [40320.628538] [<ffffffffa03924c9>] ? nfs_writedata_alloc+0x74/0x98 [nfs]
Mar 11 06:47:14 river kernel: [40320.628545] [<ffffffffa03924c9>] ? nfs_writedata_alloc+0x74/0x98 [nfs]
Mar 11 06:47:14 river kernel: [40320.628552] [<ffffffffa0392501>] ? nfs_flush_one+0x14/0xce [nfs]
Mar 11 06:47:14 river kernel: [40320.628558] [<ffffffffa038daf0>] ? nfs_pageio_doio+0x2a/0x51 [nfs]
Mar 11 06:47:14 river kernel: [40320.628564] [<ffffffffa038dbdc>] ? nfs_pageio_add_request+0xc5/0xd5 [nfs]
Mar 11 06:47:14 river kernel: [40320.628571] [<ffffffffa0390dfd>] ? nfs_do_writepage+0x100/0x122 [nfs]
Mar 11 06:47:14 river kernel: [40320.628578] [<ffffffffa0391316>] ? nfs_writepages_callback+0xf/0x21 [nfs]
Mar 11 06:47:14 river kernel: [40320.628581] [<ffffffff810b9b69>] ? write_cache_pages+0x20b/0x327
Mar 11 06:47:14 river kernel: [40320.628588] [<ffffffffa0391307>] ? nfs_writepages_callback+0x0/0x21 [nfs]
Mar 11 06:47:14 river kernel: [40320.628595] [<ffffffffa03912c6>] ? nfs_writepages+0xef/0x130 [nfs]
Mar 11 06:47:14 river kernel: [40320.628603] [<ffffffffa03924ed>] ? nfs_flush_one+0x0/0xce [nfs]
Mar 11 06:47:14 river kernel: [40320.628605] [<ffffffff81064957>] ? bit_waitqueue+0x10/0xa0
Mar 11 06:47:14 river kernel: [40320.628609] [<ffffffff8110637e>] ? writeback_single_inode+0xe7/0x2da
Mar 11 06:47:14 river kernel: [40320.628612] [<ffffffff81107057>] ? writeback_inodes_wb+0x423/0x4fe
Mar 11 06:47:14 river kernel: [40320.628615] [<ffffffff8110725e>] ? wb_writeback+0x12c/0x1ab
Mar 11 06:47:14 river kernel: [40320.628618] [<ffffffff811073f2>] ? wb_do_writeback+0x73/0x15b
Mar 11 06:47:14 river kernel: [40320.628621] [<ffffffff8110750b>] ? bdi_writeback_task+0x31/0x9d
Mar 11 06:47:14 river kernel: [40320.628624] [<ffffffff810c7c1e>] ? bdi_start_fn+0x0/0xca
Mar 11 06:47:14 river kernel: [40320.628627] [<ffffffff810c7c8e>] ? bdi_start_fn+0x70/0xca
Mar 11 06:47:14 river kernel: [40320.628629] [<ffffffff810c7c1e>] ? bdi_start_fn+0x0/0xca
Mar 11 06:47:14 river kernel: [40320.628631] [<ffffffff81064769>] ? kthread+0x79/0x81
Mar 11 06:47:14 river kernel: [40320.628634] [<ffffffff81011baa>] ? child_rip+0xa/0x20
Mar 11 06:47:14 river kernel: [40320.628636] [<ffffffff810646f0>] ? kthread+0x0/0x81
Mar 11 06:47:14 river kernel: [40320.628639] [<ffffffff81011ba0>] ? child_rip+0x0/0x20
Mar 11 06:49:14 river kernel: [40440.628074] kswapd0 D 0000000000000002 0 47 2 0x00000000
Mar 11 06:49:14 river kernel: [40440.628078] ffff88022f073880 0000000000000046 0000000000000000 ffffffff810114ce
Mar 11 06:49:14 river kernel: [40440.628083] ffffffffb468199e 000000000000f8a0 ffff88022c8e3fd8 00000000000155c0
Mar 11 06:49:14 river kernel: [40440.628087] 00000000000155c0 ffff88022f135bd0 ffff88022f135ec8 0000000100000000
Mar 11 06:49:14 river kernel: [40440.628096] Call Trace:
Mar 11 06:49:14 river kernel: [40440.628114] [<ffffffff810114ce>] ? common_interrupt+0xe/0x13
Mar 11 06:49:14 river kernel: [40440.628118] [<ffffffff81098e5e>] ? delayacct_end+0x74/0x7f
Mar 11 06:49:14 river kernel: [40440.628131] [<ffffffffa038dc38>] ? nfs_wait_bit_uninterruptible+0x0/0xd [nfs]
Mar 11 06:49:14 river kernel: [40440.628135] [<ffffffff812ee03d>] ? io_schedule+0x73/0xb7
Mar 11 06:49:14 river kernel: [40440.628142] [<ffffffffa038dc41>] ? nfs_wait_bit_uninterruptible+0x9/0xd [nfs]
Mar 11 06:49:14 river kernel: [40440.628144] [<ffffffff812ee53d>] ? __wait_on_bit+0x41/0x70
Mar 11 06:49:14 river kernel: [40440.628149] [<ffffffff8118a10f>] ? __lookup_tag+0xad/0x11b
Mar 11 06:49:14 river kernel: [40440.628155] [<ffffffffa038dc38>] ? nfs_wait_bit_uninterruptible+0x0/0xd [nfs]
Mar 11 06:49:14 river kernel: [40440.628158] [<ffffffff812ee5d7>] ? out_of_line_wait_on_bit+0x6b/0x77
Mar 11 06:49:14 river kernel: [40440.628162] [<ffffffff81064a64>] ? wake_bit_function+0x0/0x23
Mar 11 06:49:14 river kernel: [40440.628169] [<ffffffffa0391bc3>] ? nfs_sync_mapping_wait+0xfa/0x227 [nfs]
Mar 11 06:49:14 river kernel: [40440.628176] [<ffffffffa0391d84>] ? nfs_wb_page+0x94/0xc3 [nfs]
Mar 11 06:49:14 river kernel: [40440.628180] [<ffffffff810b4968>] ? __remove_from_page_cache+0x33/0xb6
Mar 11 06:49:14 river kernel: [40440.628186] [<ffffffffa0384e54>] ? nfs_release_page+0x3a/0x57 [nfs]
Mar 11 06:49:14 river kernel: [40440.628190] [<ffffffff810bd244>] ? shrink_page_list+0x481/0x617
Mar 11 06:49:14 river kernel: [40440.628193] [<ffffffff8101166e>] ? apic_timer_interrupt+0xe/0x20
Mar 11 06:49:14 river kernel: [40440.628196] [<ffffffff810bc317>] ? isolate_pages_global+0x1a0/0x20f
Mar 11 06:49:14 river kernel: [40440.628198] [<ffffffff810bdaf1>] ? shrink_list+0x44a/0x725
Mar 11 06:49:14 river kernel: [40440.628206] [<ffffffffa0276828>] ? jbd2_journal_release_jbd_inode+0x55/0x10e [jbd2]
Mar 11 06:49:14 river kernel: [40440.628211] [<ffffffff810e2fd7>] ? add_partial+0x11/0x58
Mar 11 06:49:14 river kernel: [40440.628214] [<ffffffff810be04c>] ? shrink_zone+0x280/0x342
Mar 11 06:49:14 river kernel: [40440.628216] [<ffffffff810be24f>] ? shrink_slab+0x141/0x153
Mar 11 06:49:14 river kernel: [40440.628219] [<ffffffff810bea71>] ? kswapd+0x4b9/0x683
Mar 11 06:49:14 river kernel: [40440.628222] [<ffffffff810bc177>] ? isolate_pages_global+0x0/0x20f
Mar 11 06:49:14 river kernel: [40440.628224] [<ffffffff81064a36>] ? autoremove_wake_function+0x0/0x2e
Mar 11 06:49:14 river kernel: [40440.628227] [<ffffffff810be5b8>] ? kswapd+0x0/0x683
Mar 11 06:49:14 river kernel: [40440.628229] [<ffffffff81064769>] ? kthread+0x79/0x81
Mar 11 06:49:14 river kernel: [40440.628232] [<ffffffff81011baa>] ? child_rip+0xa/0x20
Mar 11 06:49:14 river kernel: [40440.628234] [<ffffffff810646f0>] ? kthread+0x0/0x81
Mar 11 06:49:14 river kernel: [40440.628237] [<ffffffff81011ba0>] ? child_rip+0x0/0x20
Mar 11 06:49:14 river kernel: [40440.628401] flush-0:24 D 0000000000000002 0 4682 2 0x00000000
Mar 11 06:49:14 river kernel: [40440.628404] ffff88022f0754c0 0000000000000046 0000000000000000 ffff88020bfbf1ac
Mar 11 06:49:14 river kernel: [40440.628406] 0000000000000000 000000000000f8a0 ffff88020bfbffd8 00000000000155c0
Mar 11 06:49:14 river kernel: [40440.628409] 00000000000155c0 ffff880203973170 ffff880203973468 0000000200000000
Mar 11 06:49:14 river kernel: [40440.628412] Call Trace:
Mar 11 06:49:14 river kernel: [40440.628415] [<ffffffff81098e5e>] ? delayacct_end+0x74/0x7f
Mar 11 06:49:14 river kernel: [40440.628422] [<ffffffffa038dc38>] ? nfs_wait_bit_uninterruptible+0x0/0xd [nfs]
Mar 11 06:49:14 river kernel: [40440.628425] [<ffffffff812ee03d>] ? io_schedule+0x73/0xb7
Mar 11 06:49:14 river kernel: [40440.628431] [<ffffffffa038dc41>] ? nfs_wait_bit_uninterruptible+0x9/0xd [nfs]
Mar 11 06:49:14 river kernel: [40440.628434] [<ffffffff812ee53d>] ? __wait_on_bit+0x41/0x70
Mar 11 06:49:14 river kernel: [40440.628437] [<ffffffff8118a10f>] ? __lookup_tag+0xad/0x11b
Mar 11 06:49:14 river kernel: [40440.628443] [<ffffffffa038dc38>] ? nfs_wait_bit_uninterruptible+0x0/0xd [nfs]
Mar 11 06:49:14 river kernel: [40440.628446] [<ffffffff812ee5d7>] ? out_of_line_wait_on_bit+0x6b/0x77
Mar 11 06:49:14 river kernel: [40440.628449] [<ffffffff81064a64>] ? wake_bit_function+0x0/0x23
Mar 11 06:49:14 river kernel: [40440.628455] [<ffffffffa0391bc3>] ? nfs_sync_mapping_wait+0xfa/0x227 [nfs]
Mar 11 06:49:14 river kernel: [40440.628463] [<ffffffffa0391d84>] ? nfs_wb_page+0x94/0xc3 [nfs]
Mar 11 06:49:14 river kernel: [40440.628465] [<ffffffff810b4968>] ? __remove_from_page_cache+0x33/0xb6
Mar 11 06:49:14 river kernel: [40440.628471] [<ffffffffa0384e54>] ? nfs_release_page+0x3a/0x57 [nfs]
Mar 11 06:49:14 river kernel: [40440.628474] [<ffffffff810bd244>] ? shrink_page_list+0x481/0x617
Mar 11 06:49:14 river kernel: [40440.628479] [<ffffffff812564c7>] ? sch_direct_xmit+0x7f/0x14c
Mar 11 06:49:14 river kernel: [40440.628481] [<ffffffff810bc317>] ? isolate_pages_global+0x1a0/0x20f
Mar 11 06:49:14 river kernel: [40440.628484] [<ffffffff810bdaf1>] ? shrink_list+0x44a/0x725
Mar 11 06:49:14 river kernel: [40440.628487] [<ffffffff810b9dfc>] ? determine_dirtyable_memory+0xd/0x1d
Mar 11 06:49:14 river kernel: [40440.628490] [<ffffffff810b9e74>] ? get_dirty_limits+0x1d/0x259
Mar 11 06:49:14 river kernel: [40440.628493] [<ffffffff810be04c>] ? shrink_zone+0x280/0x342
Mar 11 06:49:14 river kernel: [40440.628496] [<ffffffff810c63ac>] ? zone_statistics+0x3c/0x5d
Mar 11 06:49:14 river kernel: [40440.628499] [<ffffffff810bf110>] ? try_to_free_pages+0x232/0x38e
Mar 11 06:49:14 river kernel: [40440.628502] [<ffffffff810bc177>] ? isolate_pages_global+0x0/0x20f
Mar 11 06:49:14 river kernel: [40440.628505] [<ffffffff810b92c5>] ? __alloc_pages_nodemask+0x3bb/0x5ce
Mar 11 06:49:14 river kernel: [40440.628508] [<ffffffff810e5190>] ? new_slab+0x42/0x1ca
Mar 11 06:49:14 river kernel: [40440.628511] [<ffffffff810e5508>] ? __slab_alloc+0x1f0/0x39b
Mar 11 06:49:14 river kernel: [40440.628518] [<ffffffffa03924c9>] ? nfs_writedata_alloc+0x74/0x98 [nfs]
Mar 11 06:49:14 river kernel: [40440.628522] [<ffffffff810e67eb>] ? __kmalloc+0xf1/0x141
Mar 11 06:49:14 river kernel: [40440.628525] [<ffffffff8118a10f>] ? __lookup_tag+0xad/0x11b
Mar 11 06:49:14 river kernel: [40440.628532] [<ffffffffa03924c9>] ? nfs_writedata_alloc+0x74/0x98 [nfs]
Mar 11 06:49:14 river kernel: [40440.628539] [<ffffffffa03924c9>] ? nfs_writedata_alloc+0x74/0x98 [nfs]
Mar 11 06:49:14 river kernel: [40440.628546] [<ffffffffa0392501>] ? nfs_flush_one+0x14/0xce [nfs]
Mar 11 06:49:14 river kernel: [40440.628552] [<ffffffffa038daf0>] ? nfs_pageio_doio+0x2a/0x51 [nfs]
Mar 11 06:49:14 river kernel: [40440.628558] [<ffffffffa038dbdc>] ? nfs_pageio_add_request+0xc5/0xd5 [nfs]
Mar 11 06:49:14 river kernel: [40440.628565] [<ffffffffa0390dfd>] ? nfs_do_writepage+0x100/0x122 [nfs]
Mar 11 06:49:14 river kernel: [40440.628572] [<ffffffffa0391316>] ? nfs_writepages_callback+0xf/0x21 [nfs]
Mar 11 06:49:14 river kernel: [40440.628575] [<ffffffff810b9b69>] ? write_cache_pages+0x20b/0x327
Mar 11 06:49:14 river kernel: [40440.628582] [<ffffffffa0391307>] ? nfs_writepages_callback+0x0/0x21 [nfs]
Mar 11 06:49:14 river kernel: [40440.628589] [<ffffffffa03912c6>] ? nfs_writepages+0xef/0x130 [nfs]
Mar 11 06:49:14 river kernel: [40440.628596] [<ffffffffa03924ed>] ? nfs_flush_one+0x0/0xce [nfs]
Mar 11 06:49:14 river kernel: [40440.628598] [<ffffffff81064957>] ? bit_waitqueue+0x10/0xa0
Mar 11 06:49:14 river kernel: [40440.628602] [<ffffffff8110637e>] ? writeback_single_inode+0xe7/0x2da
Mar 11 06:49:14 river kernel: [40440.628606] [<ffffffff81107057>] ? writeback_inodes_wb+0x423/0x4fe
Mar 11 06:49:14 river kernel: [40440.628609] [<ffffffff8110725e>] ? wb_writeback+0x12c/0x1ab
Mar 11 06:49:14 river kernel: [40440.628612] [<ffffffff811073f2>] ? wb_do_writeback+0x73/0x15b
Mar 11 06:49:14 river kernel: [40440.628614] [<ffffffff8110750b>] ? bdi_writeback_task+0x31/0x9d
Mar 11 06:49:14 river kernel: [40440.628618] [<ffffffff810c7c1e>] ? bdi_start_fn+0x0/0xca
Mar 11 06:49:14 river kernel: [40440.628620] [<ffffffff810c7c8e>] ? bdi_start_fn+0x70/0xca
Mar 11 06:49:14 river kernel: [40440.628623] [<ffffffff810c7c1e>] ? bdi_start_fn+0x0/0xca
Mar 11 06:49:14 river kernel: [40440.628625] [<ffffffff81064769>] ? kthread+0x79/0x81
Mar 11 06:49:14 river kernel: [40440.628628] [<ffffffff81011baa>] ? child_rip+0xa/0x20
Mar 11 06:49:14 river kernel: [40440.628630] [<ffffffff810646f0>] ? kthread+0x0/0x81
Mar 11 06:49:14 river kernel: [40440.628632] [<ffffffff81011ba0>] ? child_rip+0x0/0x20
Mar 11 06:51:14 river kernel: [40560.628083] kswapd0 D 0000000000000002 0 47 2 0x00000000
Mar 11 06:51:14 river kernel: [40560.628088] ffff88022f073880 0000000000000046 0000000000000000 ffffffff810114ce
Mar 11 06:51:14 river kernel: [40560.628102] ffffffffb468199e 000000000000f8a0 ffff88022c8e3fd8 00000000000155c0
Mar 11 06:51:14 river kernel: [40560.628105] 00000000000155c0 ffff88022f135bd0 ffff88022f135ec8 0000000100000000
Mar 11 06:51:14 river kernel: [40560.628113] Call Trace:
Mar 11 06:51:14 river kernel: [40560.628120] [<ffffffff810114ce>] ? common_interrupt+0xe/0x13
Mar 11 06:51:14 river kernel: [40560.628124] [<ffffffff81098e5e>] ? delayacct_end+0x74/0x7f
Mar 11 06:51:14 river kernel: [40560.628136] [<ffffffffa038dc38>] ? nfs_wait_bit_uninterruptible+0x0/0xd [nfs]
Mar 11 06:51:14 river kernel: [40560.628140] [<ffffffff812ee03d>] ? io_schedule+0x73/0xb7
Mar 11 06:51:14 river kernel: [40560.628147] [<ffffffffa038dc41>] ? nfs_wait_bit_uninterruptible+0x9/0xd [nfs]
Mar 11 06:51:14 river kernel: [40560.628150] [<ffffffff812ee53d>] ? __wait_on_bit+0x41/0x70
Mar 11 06:51:14 river kernel: [40560.628154] [<ffffffff8118a10f>] ? __lookup_tag+0xad/0x11b
Mar 11 06:51:14 river kernel: [40560.628160] [<ffffffffa038dc38>] ? nfs_wait_bit_uninterruptible+0x0/0xd [nfs]
Mar 11 06:51:14 river kernel: [40560.628163] [<ffffffff812ee5d7>] ? out_of_line_wait_on_bit+0x6b/0x77
Mar 11 06:51:14 river kernel: [40560.628167] [<ffffffff81064a64>] ? wake_bit_function+0x0/0x23
Mar 11 06:51:14 river kernel: [40560.628174] [<ffffffffa0391bc3>] ? nfs_sync_mapping_wait+0xfa/0x227 [nfs]
Mar 11 06:51:14 river kernel: [40560.628181] [<ffffffffa0391d84>] ? nfs_wb_page+0x94/0xc3 [nfs]
Mar 11 06:51:14 river kernel: [40560.628185] [<ffffffff810b4968>] ? __remove_from_page_cache+0x33/0xb6
Mar 11 06:51:14 river kernel: [40560.628190] [<ffffffffa0384e54>] ? nfs_release_page+0x3a/0x57 [nfs]
Mar 11 06:51:14 river kernel: [40560.628194] [<ffffffff810bd244>] ? shrink_page_list+0x481/0x617
Mar 11 06:51:14 river kernel: [40560.628197] [<ffffffff8101166e>] ? apic_timer_interrupt+0xe/0x20
Mar 11 06:51:14 river kernel: [40560.628200] [<ffffffff810bc317>] ? isolate_pages_global+0x1a0/0x20f
Mar 11 06:51:14 river kernel: [40560.628203] [<ffffffff810bdaf1>] ? shrink_list+0x44a/0x725
Mar 11 06:51:14 river kernel: [40560.628210] [<ffffffffa0276828>] ? jbd2_journal_release_jbd_inode+0x55/0x10e [jbd2]
Mar 11 06:51:14 river kernel: [40560.628214] [<ffffffff810e2fd7>] ? add_partial+0x11/0x58
Mar 11 06:51:14 river kernel: [40560.628217] [<ffffffff810be04c>] ? shrink_zone+0x280/0x342
Mar 11 06:51:14 river kernel: [40560.628220] [<ffffffff810be24f>] ? shrink_slab+0x141/0x153
Mar 11 06:51:14 river kernel: [40560.628223] [<ffffffff810bea71>] ? kswapd+0x4b9/0x683
Mar 11 06:51:14 river kernel: [40560.628226] [<ffffffff810bc177>] ? isolate_pages_global+0x0/0x20f
Mar 11 06:51:14 river kernel: [40560.628228] [<ffffffff81064a36>] ? autoremove_wake_function+0x0/0x2e
Mar 11 06:51:14 river kernel: [40560.628231] [<ffffffff810be5b8>] ? kswapd+0x0/0x683
Mar 11 06:51:14 river kernel: [40560.628233] [<ffffffff81064769>] ? kthread+0x79/0x81
Mar 11 06:51:14 river kernel: [40560.628236] [<ffffffff81011baa>] ? child_rip+0xa/0x20
Mar 11 06:51:14 river kernel: [40560.628238] [<ffffffff810646f0>] ? kthread+0x0/0x81
Mar 11 06:51:14 river kernel: [40560.628241] [<ffffffff81011ba0>] ? child_rip+0x0/0x20
Mar 11 06:51:14 river kernel: [40560.628432] flush-0:24 D 0000000000000002 0 4682 2 0x00000000
Mar 11 06:51:14 river kernel: [40560.628435] ffff88022f0754c0 0000000000000046 0000000000000000 ffff88020bfbf1ac
Mar 11 06:51:14 river kernel: [40560.628438] 0000000000000000 000000000000f8a0 ffff88020bfbffd8 00000000000155c0
Mar 11 06:51:14 river kernel: [40560.628441] 00000000000155c0 ffff880203973170 ffff880203973468 0000000200000000
Mar 11 06:51:14 river kernel: [40560.628444] Call Trace:
Mar 11 06:51:14 river kernel: [40560.628447] [<ffffffff81098e5e>] ? delayacct_end+0x74/0x7f
Mar 11 06:51:14 river kernel: [40560.628454] [<ffffffffa038dc38>] ? nfs_wait_bit_uninterruptible+0x0/0xd [nfs]
Mar 11 06:51:14 river kernel: [40560.628457] [<ffffffff812ee03d>] ? io_schedule+0x73/0xb7
Mar 11 06:51:14 river kernel: [40560.628463] [<ffffffffa038dc41>] ? nfs_wait_bit_uninterruptible+0x9/0xd [nfs]
Mar 11 06:51:14 river kernel: [40560.628466] [<ffffffff812ee53d>] ? __wait_on_bit+0x41/0x70
Mar 11 06:51:14 river kernel: [40560.628469] [<ffffffff8118a10f>] ? __lookup_tag+0xad/0x11b
Mar 11 06:51:14 river kernel: [40560.628475] [<ffffffffa038dc38>] ? nfs_wait_bit_uninterruptible+0x0/0xd [nfs]
Mar 11 06:51:14 river kernel: [40560.628478] [<ffffffff812ee5d7>] ? out_of_line_wait_on_bit+0x6b/0x77
Mar 11 06:51:14 river kernel: [40560.628480] [<ffffffff81064a64>] ? wake_bit_function+0x0/0x23
Mar 11 06:51:14 river kernel: [40560.628487] [<ffffffffa0391bc3>] ? nfs_sync_mapping_wait+0xfa/0x227 [nfs]
Mar 11 06:51:14 river kernel: [40560.628495] [<ffffffffa0391d84>] ? nfs_wb_page+0x94/0xc3 [nfs]
Mar 11 06:51:14 river kernel: [40560.628497] [<ffffffff810b4968>] ? __remove_from_page_cache+0x33/0xb6
Mar 11 06:51:14 river kernel: [40560.628503] [<ffffffffa0384e54>] ? nfs_release_page+0x3a/0x57 [nfs]
Mar 11 06:51:14 river kernel: [40560.628506] [<ffffffff810bd244>] ? shrink_page_list+0x481/0x617
Mar 11 06:51:14 river kernel: [40560.628510] [<ffffffff812564c7>] ? sch_direct_xmit+0x7f/0x14c
Mar 11 06:51:14 river kernel: [40560.628513] [<ffffffff810bc317>] ? isolate_pages_global+0x1a0/0x20f
Mar 11 06:51:14 river kernel: [40560.628516] [<ffffffff810bdaf1>] ? shrink_list+0x44a/0x725
Mar 11 06:51:14 river kernel: [40560.628519] [<ffffffff810b9dfc>] ? determine_dirtyable_memory+0xd/0x1d
Mar 11 06:51:14 river kernel: [40560.628522] [<ffffffff810b9e74>] ? get_dirty_limits+0x1d/0x259
Mar 11 06:51:14 river kernel: [40560.628525] [<ffffffff810be04c>] ? shrink_zone+0x280/0x342
Mar 11 06:51:14 river kernel: [40560.628528] [<ffffffff810c63ac>] ? zone_statistics+0x3c/0x5d
Mar 11 06:51:14 river kernel: [40560.628531] [<ffffffff810bf110>] ? try_to_free_pages+0x232/0x38e
Mar 11 06:51:14 river kernel: [40560.628534] [<ffffffff810bc177>] ? isolate_pages_global+0x0/0x20f
Mar 11 06:51:14 river kernel: [40560.628537] [<ffffffff810b92c5>] ? __alloc_pages_nodemask+0x3bb/0x5ce
Mar 11 06:51:14 river kernel: [40560.628540] [<ffffffff810e5190>] ? new_slab+0x42/0x1ca
Mar 11 06:51:14 river kernel: [40560.628543] [<ffffffff810e5508>] ? __slab_alloc+0x1f0/0x39b
Mar 11 06:51:14 river kernel: [40560.628550] [<ffffffffa03924c9>] ? nfs_writedata_alloc+0x74/0x98 [nfs]
Mar 11 06:51:14 river kernel: [40560.628554] [<ffffffff810e67eb>] ? __kmalloc+0xf1/0x141
Mar 11 06:51:14 river kernel: [40560.628556] [<ffffffff8118a10f>] ? __lookup_tag+0xad/0x11b
Mar 11 06:51:14 river kernel: [40560.628563] [<ffffffffa03924c9>] ? nfs_writedata_alloc+0x74/0x98 [nfs]
Mar 11 06:51:14 river kernel: [40560.628570] [<ffffffffa03924c9>] ? nfs_writedata_alloc+0x74/0x98 [nfs]
Mar 11 06:51:14 river kernel: [40560.628577] [<ffffffffa0392501>] ? nfs_flush_one+0x14/0xce [nfs]
Mar 11 06:51:14 river kernel: [40560.628584] [<ffffffffa038daf0>] ? nfs_pageio_doio+0x2a/0x51 [nfs]
Mar 11 06:51:14 river kernel: [40560.628590] [<ffffffffa038dbdc>] ? nfs_pageio_add_request+0xc5/0xd5 [nfs]
Mar 11 06:51:14 river kernel: [40560.628597] [<ffffffffa0390dfd>] ? nfs_do_writepage+0x100/0x122 [nfs]
Mar 11 06:51:14 river kernel: [40560.628604] [<ffffffffa0391316>] ? nfs_writepages_callback+0xf/0x21 [nfs]
Mar 11 06:51:14 river kernel: [40560.628607] [<ffffffff810b9b69>] ? write_cache_pages+0x20b/0x327
Mar 11 06:51:14 river kernel: [40560.628614] [<ffffffffa0391307>] ? nfs_writepages_callback+0x0/0x21 [nfs]
Mar 11 06:51:14 river kernel: [40560.628621] [<ffffffffa03912c6>] ? nfs_writepages+0xef/0x130 [nfs]
Mar 11 06:51:14 river kernel: [40560.628628] [<ffffffffa03924ed>] ? nfs_flush_one+0x0/0xce [nfs]
Mar 11 06:51:14 river kernel: [40560.628630] [<ffffffff81064957>] ? bit_waitqueue+0x10/0xa0
Mar 11 06:51:14 river kernel: [40560.628634] [<ffffffff8110637e>] ? writeback_single_inode+0xe7/0x2da
Mar 11 06:51:14 river kernel: [40560.628637] [<ffffffff81107057>] ? writeback_inodes_wb+0x423/0x4fe
Mar 11 06:51:14 river kernel: [40560.628640] [<ffffffff8110725e>] ? wb_writeback+0x12c/0x1ab
Mar 11 06:51:14 river kernel: [40560.628643] [<ffffffff811073f2>] ? wb_do_writeback+0x73/0x15b
Mar 11 06:51:14 river kernel: [40560.628645] [<ffffffff8110750b>] ? bdi_writeback_task+0x31/0x9d
Mar 11 06:51:14 river kernel: [40560.628649] [<ffffffff810c7c1e>] ? bdi_start_fn+0x0/0xca
Mar 11 06:51:14 river kernel: [40560.628651] [<ffffffff810c7c8e>] ? bdi_start_fn+0x70/0xca
Mar 11 06:51:14 river kernel: [40560.628654] [<ffffffff810c7c1e>] ? bdi_start_fn+0x0/0xca
Mar 11 06:51:14 river kernel: [40560.628656] [<ffffffff81064769>] ? kthread+0x79/0x81
Mar 11 06:51:14 river kernel: [40560.628658] [<ffffffff81011baa>] ? child_rip+0xa/0x20
Mar 11 06:51:14 river kernel: [40560.628661] [<ffffffff810646f0>] ? kthread+0x0/0x81
Mar 11 06:51:14 river kernel: [40560.628663] [<ffffffff81011ba0>] ? child_rip+0x0/0x20
Mar 11 06:53:14 river kernel: [40680.628132] kswapd0 D 0000000000000002 0 47 2 0x00000000
Mar 11 06:53:14 river kernel: [40680.628136] ffff88022f073880 0000000000000046 0000000000000000 ffffffff810114ce
Mar 11 06:53:14 river kernel: [40680.628140] ffffffffb468199e 000000000000f8a0 ffff88022c8e3fd8 00000000000155c0
Mar 11 06:53:14 river kernel: [40680.628143] 00000000000155c0 ffff88022f135bd0 ffff88022f135ec8 0000000100000000
Mar 11 06:53:14 river kernel: [40680.628146] Call Trace:
Mar 11 06:53:14 river kernel: [40680.628154] [<ffffffff810114ce>] ? common_interrupt+0xe/0x13
Mar 11 06:53:14 river kernel: [40680.628159] [<ffffffff81098e5e>] ? delayacct_end+0x74/0x7f
Mar 11 06:53:14 river kernel: [40680.628172] [<ffffffffa038dc38>] ? nfs_wait_bit_uninterruptible+0x0/0xd [nfs]
Mar 11 06:53:14 river kernel: [40680.628177] [<ffffffff812ee03d>] ? io_schedule+0x73/0xb7
Mar 11 06:53:14 river kernel: [40680.628183] [<ffffffffa038dc41>] ? nfs_wait_bit_uninterruptible+0x9/0xd [nfs]
Mar 11 06:53:14 river kernel: [40680.628186] [<ffffffff812ee53d>] ? __wait_on_bit+0x41/0x70
Mar 11 06:53:14 river kernel: [40680.628191] [<ffffffff8118a10f>] ? __lookup_tag+0xad/0x11b
Mar 11 06:53:14 river kernel: [40680.628197] [<ffffffffa038dc38>] ? nfs_wait_bit_uninterruptible+0x0/0xd [nfs]
Mar 11 06:53:14 river kernel: [40680.628200] [<ffffffff812ee5d7>] ? out_of_line_wait_on_bit+0x6b/0x77
Mar 11 06:53:14 river kernel: [40680.628204] [<ffffffff81064a64>] ? wake_bit_function+0x0/0x23
Mar 11 06:53:14 river kernel: [40680.628211] [<ffffffffa0391bc3>] ? nfs_sync_mapping_wait+0xfa/0x227 [nfs]
Mar 11 06:53:14 river kernel: [40680.628218] [<ffffffffa0391d84>] ? nfs_wb_page+0x94/0xc3 [nfs]
Mar 11 06:53:14 river kernel: [40680.628222] [<ffffffff810b4968>] ? __remove_from_page_cache+0x33/0xb6
Mar 11 06:53:14 river kernel: [40680.628228] [<ffffffffa0384e54>] ? nfs_release_page+0x3a/0x57 [nfs]
Mar 11 06:53:14 river kernel: [40680.628232] [<ffffffff810bd244>] ? shrink_page_list+0x481/0x617
Mar 11 06:53:14 river kernel: [40680.628235] [<ffffffff8101166e>] ? apic_timer_interrupt+0xe/0x20
Mar 11 06:53:14 river kernel: [40680.628238] [<ffffffff810bc317>] ? isolate_pages_global+0x1a0/0x20f
Mar 11 06:53:14 river kernel: [40680.628240] [<ffffffff810bdaf1>] ? shrink_list+0x44a/0x725
Mar 11 06:53:14 river kernel: [40680.628249] [<ffffffffa0276828>] ? jbd2_journal_release_jbd_inode+0x55/0x10e [jbd2]
Mar 11 06:53:14 river kernel: [40680.628253] [<ffffffff810e2fd7>] ? add_partial+0x11/0x58
Mar 11 06:53:14 river kernel: [40680.628256] [<ffffffff810be04c>] ? shrink_zone+0x280/0x342
Mar 11 06:53:14 river kernel: [40680.628259] [<ffffffff810be24f>] ? shrink_slab+0x141/0x153
Mar 11 06:53:14 river kernel: [40680.628261] [<ffffffff810bea71>] ? kswapd+0x4b9/0x683
Mar 11 06:53:14 river kernel: [40680.628264] [<ffffffff810bc177>] ? isolate_pages_global+0x0/0x20f
Mar 11 06:53:14 river kernel: [40680.628267] [<ffffffff81064a36>] ? autoremove_wake_function+0x0/0x2e
Mar 11 06:53:14 river kernel: [40680.628269] [<ffffffff810be5b8>] ? kswapd+0x0/0x683
Mar 11 06:53:14 river kernel: [40680.628271] [<ffffffff81064769>] ? kthread+0x79/0x81
Mar 11 06:53:14 river kernel: [40680.628274] [<ffffffff81011baa>] ? child_rip+0xa/0x20
Mar 11 06:53:14 river kernel: [40680.628277] [<ffffffff810646f0>] ? kthread+0x0/0x81
Mar 11 06:53:14 river kernel: [40680.628279] [<ffffffff81011ba0>] ? child_rip+0x0/0x20
Mar 11 06:53:14 river kernel: [40680.628490] flush-0:24 D 0000000000000002 0 4682 2 0x00000000
Mar 11 06:53:14 river kernel: [40680.628493] ffff88022f0754c0 0000000000000046 0000000000000000 ffff88020bfbf1ac
Mar 11 06:53:14 river kernel: [40680.628496] 0000000000000000 000000000000f8a0 ffff88020bfbffd8 00000000000155c0
Mar 11 06:53:14 river kernel: [40680.628499] 00000000000155c0 ffff880203973170 ffff880203973468 0000000200000000
Mar 11 06:53:14 river kernel: [40680.628502] Call Trace:
Mar 11 06:53:14 river kernel: [40680.628504] [<ffffffff81098e5e>] ? delayacct_end+0x74/0x7f
Mar 11 06:53:14 river kernel: [40680.628511] [<ffffffffa038dc38>] ? nfs_wait_bit_uninterruptible+0x0/0xd [nfs]
Mar 11 06:53:14 river kernel: [40680.628514] [<ffffffff812ee03d>] ? io_schedule+0x73/0xb7
Mar 11 06:53:14 river kernel: [40680.628520] [<ffffffffa038dc41>] ? nfs_wait_bit_uninterruptible+0x9/0xd [nfs]
Mar 11 06:53:14 river kernel: [40680.628523] [<ffffffff812ee53d>] ? __wait_on_bit+0x41/0x70
Mar 11 06:53:14 river kernel: [40680.628526] [<ffffffff8118a10f>] ? __lookup_tag+0xad/0x11b
Mar 11 06:53:14 river kernel: [40680.628532] [<ffffffffa038dc38>] ? nfs_wait_bit_uninterruptible+0x0/0xd [nfs]
Mar 11 06:53:14 river kernel: [40680.628535] [<ffffffff812ee5d7>] ? out_of_line_wait_on_bit+0x6b/0x77
Mar 11 06:53:14 river kernel: [40680.628538] [<ffffffff81064a64>] ? wake_bit_function+0x0/0x23
Mar 11 06:53:14 river kernel: [40680.628545] [<ffffffffa0391bc3>] ? nfs_sync_mapping_wait+0xfa/0x227 [nfs]
Mar 11 06:53:14 river kernel: [40680.628552] [<ffffffffa0391d84>] ? nfs_wb_page+0x94/0xc3 [nfs]
Mar 11 06:53:14 river kernel: [40680.628554] [<ffffffff810b4968>] ? __remove_from_page_cache+0x33/0xb6
Mar 11 06:53:14 river kernel: [40680.628560] [<ffffffffa0384e54>] ? nfs_release_page+0x3a/0x57 [nfs]
Mar 11 06:53:14 river kernel: [40680.628563] [<ffffffff810bd244>] ? shrink_page_list+0x481/0x617
Mar 11 06:53:14 river kernel: [40680.628567] [<ffffffff812564c7>] ? sch_direct_xmit+0x7f/0x14c
Mar 11 06:53:14 river kernel: [40680.628570] [<ffffffff810bc317>] ? isolate_pages_global+0x1a0/0x20f
Mar 11 06:53:14 river kernel: [40680.628573] [<ffffffff810bdaf1>] ? shrink_list+0x44a/0x725
Mar 11 06:53:14 river kernel: [40680.628576] [<ffffffff810b9dfc>] ? determine_dirtyable_memory+0xd/0x1d
Mar 11 06:53:14 river kernel: [40680.628579] [<ffffffff810b9e74>] ? get_dirty_limits+0x1d/0x259
Mar 11 06:53:14 river kernel: [40680.628581] [<ffffffff810be04c>] ? shrink_zone+0x280/0x342
Mar 11 06:53:14 river kernel: [40680.628585] [<ffffffff810c63ac>] ? zone_statistics+0x3c/0x5d
Mar 11 06:53:14 river kernel: [40680.628588] [<ffffffff810bf110>] ? try_to_free_pages+0x232/0x38e
Mar 11 06:53:14 river kernel: [40680.628591] [<ffffffff810bc177>] ? isolate_pages_global+0x0/0x20f
Mar 11 06:53:14 river kernel: [40680.628593] [<ffffffff810b92c5>] ? __alloc_pages_nodemask+0x3bb/0x5ce
Mar 11 06:53:14 river kernel: [40680.628597] [<ffffffff810e5190>] ? new_slab+0x42/0x1ca
Mar 11 06:53:14 river kernel: [40680.628600] [<ffffffff810e5508>] ? __slab_alloc+0x1f0/0x39b
Mar 11 06:53:14 river kernel: [40680.628607] [<ffffffffa03924c9>] ? nfs_writedata_alloc+0x74/0x98 [nfs]
Mar 11 06:53:14 river kernel: [40680.628611] [<ffffffff810e67eb>] ? __kmalloc+0xf1/0x141
Mar 11 06:53:14 river kernel: [40680.628613] [<ffffffff8118a10f>] ? __lookup_tag+0xad/0x11b
Mar 11 06:53:14 river kernel: [40680.628620] [<ffffffffa03924c9>] ? nfs_writedata_alloc+0x74/0x98 [nfs]
Mar 11 06:53:14 river kernel: [40680.628627] [<ffffffffa03924c9>] ? nfs_writedata_alloc+0x74/0x98 [nfs]
Mar 11 06:53:14 river kernel: [40680.628634] [<ffffffffa0392501>] ? nfs_flush_one+0x14/0xce [nfs]
Mar 11 06:53:14 river kernel: [40680.628640] [<ffffffffa038daf0>] ? nfs_pageio_doio+0x2a/0x51 [nfs]
Mar 11 06:53:14 river kernel: [40680.628647] [<ffffffffa038dbdc>] ? nfs_pageio_add_request+0xc5/0xd5 [nfs]
Mar 11 06:53:14 river kernel: [40680.628654] [<ffffffffa0390dfd>] ? nfs_do_writepage+0x100/0x122 [nfs]
Mar 11 06:53:14 river kernel: [40680.628661] [<ffffffffa0391316>] ? nfs_writepages_callback+0xf/0x21 [nfs]
Mar 11 06:53:14 river kernel: [40680.628664] [<ffffffff810b9b69>] ? write_cache_pages+0x20b/0x327
Mar 11 06:53:14 river kernel: [40680.628670] [<ffffffffa0391307>] ? nfs_writepages_callback+0x0/0x21 [nfs]
Mar 11 06:53:14 river kernel: [40680.628678] [<ffffffffa03912c6>] ? nfs_writepages+0xef/0x130 [nfs]
Mar 11 06:53:14 river kernel: [40680.628685] [<ffffffffa03924ed>] ? nfs_flush_one+0x0/0xce [nfs]
Mar 11 06:53:14 river kernel: [40680.628687] [<ffffffff81064957>] ? bit_waitqueue+0x10/0xa0
Mar 11 06:53:14 river kernel: [40680.628691] [<ffffffff8110637e>] ? writeback_single_inode+0xe7/0x2da
Mar 11 06:53:14 river kernel: [40680.628694] [<ffffffff81107057>] ? writeback_inodes_wb+0x423/0x4fe
Mar 11 06:53:14 river kernel: [40680.628697] [<ffffffff8110725e>] ? wb_writeback+0x12c/0x1ab
Mar 11 06:53:14 river kernel: [40680.628700] [<ffffffff811073f2>] ? wb_do_writeback+0x73/0x15b
Mar 11 06:53:14 river kernel: [40680.628703] [<ffffffff8110750b>] ? bdi_writeback_task+0x31/0x9d
Mar 11 06:53:14 river kernel: [40680.628706] [<ffffffff810c7c1e>] ? bdi_start_fn+0x0/0xca
Mar 11 06:53:14 river kernel: [40680.628709] [<ffffffff810c7c8e>] ? bdi_start_fn+0x70/0xca
Mar 11 06:53:14 river kernel: [40680.628711] [<ffffffff810c7c1e>] ? bdi_start_fn+0x0/0xca
Mar 11 06:53:14 river kernel: [40680.628714] [<ffffffff81064769>] ? kthread+0x79/0x81
Mar 11 06:53:14 river kernel: [40680.628716] [<ffffffff81011baa>] ? child_rip+0xa/0x20
Mar 11 06:53:14 river kernel: [40680.628719] [<ffffffff810646f0>] ? kthread+0x0/0x81
Mar 11 06:53:14 river kernel: [40680.628721] [<ffffffff81011ba0>] ? child_rip+0x0/0x20
--
Rechnerbetrieb und Support, Technische Fakultät, Universität Bielefeld
Telefon: +49 521 106 2900 - E-Mail: support@techfak.uni-bielefeld.de
Reply to: