Re: Page allocation failures and lockups since Jessie on QNAP kirkwood NASes, even with 5gb swap-on-md-raid1 free
On Mon, Jul 27, 2015 at 15:39:53 +0200, debian.arm.nospam.again@sub.noloop.net wrote:
> Hi. Since upgrading to Jessie, I've been experiencing frequent lockups on my
> QNAP NASes (TS-419P+ and TS-219P) particularly under heavy I/O. Usually the
> devices just drop dead (not even answering to ping), but today one crashing
> machine logged some page allocation failures which were visible in the
> journalctl log after a reboot.
Hello again list,
I've noticed one of these NASes have been spewing more page allocation
failures in dmesg even when moderately idle. This time the system appears
to have been running for quite some time without any visible hiccups, but
the kernel log messages are really concering. I'm not sure how to make sense
of them. Page allocation failures in "swapper" even with several gigabytes
of unused swap space?
Anyone else seeing these? Is there a kernel bug in the 3.16.x series in
Jessie?
All the stack traces seem to mention "mv643xx_eth_poll" and "rxq_refill".
Here's a few select dmesg lines:
[ 0.000000] Linux version 3.16.0-4-kirkwood (debian-kernel@lists.debian.org) (gcc version 4.8.4 (Debian 4.8.4-1) ) #1 Debian 3.16.7-ckt11-1+deb8u3 (2015-08-04)
(....)
[ 0.000000] CPU: Feroceon 88FR131 [56251311] revision 1 (ARMv5TE), cr=0005397f
[ 0.000000] CPU: VIVT data cache, VIVT instruction cache
[ 0.000000] Machine: QNAP TS-41x
[ 0.000000] Ignoring unrecognised tag 0x41000403
(....)
[ 0.000000] Memory: 504224K/524288K available (3899K kernel code, 360K rwdata, 1440K rodata, 277K init, 289K bss, 20064K reserved, 0K highmem)
(....)
[ 7.642116] Kirkwood: MV88F6282-Rev-A0, TCLK=200000000.
(....)
[732563.541317] swapper: page allocation failure: order:0, mode:0x20
[732563.541343] CPU: 0 PID: 0 Comm: swapper Not tainted 3.16.0-4-kirkwood #1 Debian 3.16.7-ckt11-1+deb8u3
[732563.541379] [<c00100c4>] (unwind_backtrace) from [<c000c45c>] (show_stack+0x18/0x1c)
[732563.541405] [<c000c45c>] (show_stack) from [<c00b6e68>] (warn_alloc_failed+0xdc/0x10c)
[732563.541428] [<c00b6e68>] (warn_alloc_failed) from [<c00b9894>] (__alloc_pages_nodemask+0x838/0x944)
[732563.541452] [<c00b9894>] (__alloc_pages_nodemask) from [<c03014b0>] (__netdev_alloc_frag+0x58/0x120)
[732563.541475] [<c03014b0>] (__netdev_alloc_frag) from [<c0306604>] (__netdev_alloc_skb+0x3c/0xdc)
[732563.541517] [<c0306604>] (__netdev_alloc_skb) from [<bf3437fc>] (rxq_refill+0x50/0x158 [mv643xx_eth])
[732563.541563] [<bf3437fc>] (rxq_refill [mv643xx_eth]) from [<bf343e9c>] (mv643xx_eth_poll+0x510/0x580 [mv643xx_eth])
[732563.541595] [<bf343e9c>] (mv643xx_eth_poll [mv643xx_eth]) from [<c030f918>] (net_rx_action+0xe8/0x228)
[732563.541621] [<c030f918>] (net_rx_action) from [<c001def8>] (__do_softirq+0x10c/0x288)
[732563.541642] [<c001def8>] (__do_softirq) from [<c001e2d4>] (irq_exit+0x88/0xe8)
[732563.541661] [<c001e2d4>] (irq_exit) from [<c0009d28>] (handle_IRQ+0x6c/0x88)
[732563.541680] [<c0009d28>] (handle_IRQ) from [<c000cf60>] (__irq_svc+0x40/0x4c)
[732563.541712] [<c000cf60>] (__irq_svc) from [<c0044734>] (cpu_startup_entry+0x158/0x2dc)
[732563.541738] [<c0044734>] (cpu_startup_entry) from [<c053fb88>] (start_kernel+0x378/0x3e8)
[732563.541755] Mem-info:
[732563.541764] DMA per-cpu:
[732563.541775] CPU 0: hi: 186, btch: 31 usd: 31
[732563.541796] active_anon:3308 inactive_anon:4779 isolated_anon:0
active_file:46057 inactive_file:48001 isolated_file:0
unevictable:0 dirty:943 writeback:228 unstable:0
free:266 slab_reclaimable:14117 slab_unreclaimable:3681
mapped:11695 shmem:1393 pagetables:493 bounce:0
free_cma:0
[732563.541868] DMA free:1064kB min:2864kB low:3580kB high:4296kB active_anon:13232kB inactive_anon:19116kB active_file:184228kB inactive_file:192004kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:524288kB managed:513716kB mlocked:0kB dirty:3772kB writeback:912kB mapped:46780kB shmem:5572kB slab_reclaimable:56468kB slab_unreclaimable:14724kB kernel_stack:1160kB pagetables:1972kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[732563.541927] lowmem_reserve[]: 0 0 0 0
[732563.541942] DMA: 0*4kB 1*8kB (R) 0*16kB 1*32kB (R) 0*64kB 0*128kB 0*256kB 0*512kB 1*1024kB (R) 0*2048kB 0*4096kB = 1064kB
[732563.541984] 96690 total pagecache pages
[732563.541996] 1239 pages in swap cache
[732563.542008] Swap cache stats: add 139374, delete 138135, find 835583/858163
[732563.542021] Free swap = 5544960kB
[732563.542030] Total swap = 5582992kB
[732563.548965] 131072 pages of RAM
[732563.548984] 611 free pages
[732563.548993] 2643 reserved pages
[732563.549002] 17481 slab pages
[732563.549010] 125217 pages shared
[732563.549019] 1239 pages swap cached
[732563.549895] swapper: page allocation failure: order:0, mode:0x20
[732563.549923] CPU: 0 PID: 0 Comm: swapper Not tainted 3.16.0-4-kirkwood #1 Debian 3.16.7-ckt11-1+deb8u3
[732563.549961] [<c00100c4>] (unwind_backtrace) from [<c000c45c>] (show_stack+0x18/0x1c)
[732563.549990] [<c000c45c>] (show_stack) from [<c00b6e68>] (warn_alloc_failed+0xdc/0x10c)
[732563.550018] [<c00b6e68>] (warn_alloc_failed) from [<c00b9894>] (__alloc_pages_nodemask+0x838/0x944)
[732563.550045] [<c00b9894>] (__alloc_pages_nodemask) from [<c03014b0>] (__netdev_alloc_frag+0x58/0x120)
[732563.550071] [<c03014b0>] (__netdev_alloc_frag) from [<c0306604>] (__netdev_alloc_skb+0x3c/0xdc)
[732563.550115] [<c0306604>] (__netdev_alloc_skb) from [<bf3437fc>] (rxq_refill+0x50/0x158 [mv643xx_eth])
[732563.550157] [<bf3437fc>] (rxq_refill [mv643xx_eth]) from [<bf343e9c>] (mv643xx_eth_poll+0x510/0x580 [mv643xx_eth])
[732563.550194] [<bf343e9c>] (mv643xx_eth_poll [mv643xx_eth]) from [<c030f918>] (net_rx_action+0xe8/0x228)
[732563.550224] [<c030f918>] (net_rx_action) from [<c001def8>] (__do_softirq+0x10c/0x288)
[732563.550249] [<c001def8>] (__do_softirq) from [<c001e2d4>] (irq_exit+0x88/0xe8)
[732563.550273] [<c001e2d4>] (irq_exit) from [<c0009d28>] (handle_IRQ+0x6c/0x88)
[732563.550294] [<c0009d28>] (handle_IRQ) from [<c000cf60>] (__irq_svc+0x40/0x4c)
[732563.550319] [<c000cf60>] (__irq_svc) from [<c0044734>] (cpu_startup_entry+0x158/0x2dc)
[732563.550345] [<c0044734>] (cpu_startup_entry) from [<c053fb88>] (start_kernel+0x378/0x3e8)
[732563.550361] Mem-info:
[732563.550370] DMA per-cpu:
[732563.550381] CPU 0: hi: 186, btch: 31 usd: 31
[732563.550402] active_anon:3308 inactive_anon:4779 isolated_anon:0
active_file:46057 inactive_file:48001 isolated_file:0
unevictable:0 dirty:943 writeback:228 unstable:0
free:266 slab_reclaimable:14117 slab_unreclaimable:3681
mapped:11695 shmem:1393 pagetables:493 bounce:0
free_cma:0
[732563.550474] DMA free:1064kB min:2864kB low:3580kB high:4296kB active_anon:13232kB inactive_anon:19116kB active_file:184228kB inactive_file:192004kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:524288kB managed:513716kB mlocked:0kB dirty:3772kB writeback:912kB mapped:46780kB shmem:5572kB slab_reclaimable:56468kB slab_unreclaimable:14724kB kernel_stack:1160kB pagetables:1972kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[732563.550532] lowmem_reserve[]: 0 0 0 0
[732563.550548] DMA: 0*4kB 1*8kB (R) 0*16kB 1*32kB (R) 0*64kB 0*128kB 0*256kB 0*512kB 1*1024kB (R) 0*2048kB 0*4096kB = 1064kB
[732563.550589] 96690 total pagecache pages
[732563.550601] 1239 pages in swap cache
[732563.550613] Swap cache stats: add 139374, delete 138135, find 835583/858163
[732563.550625] Free swap = 5544960kB
[732563.550634] Total swap = 5582992kB
[732563.557514] 131072 pages of RAM
[732563.557533] 611 free pages
[732563.557542] 2643 reserved pages
[732563.557551] 17481 slab pages
[732563.557559] 125217 pages shared
[732563.557568] 1239 pages swap cached
[732563.578401] md21_raid5: page allocation failure: order:0, mode:0x20
[732563.578432] CPU: 0 PID: 163 Comm: md21_raid5 Not tainted 3.16.0-4-kirkwood #1 Debian 3.16.7-ckt11-1+deb8u3
[732563.578470] [<c00100c4>] (unwind_backtrace) from [<c000c45c>] (show_stack+0x18/0x1c)
[732563.578499] [<c000c45c>] (show_stack) from [<c00b6e68>] (warn_alloc_failed+0xdc/0x10c)
[732563.578527] [<c00b6e68>] (warn_alloc_failed) from [<c00b9894>] (__alloc_pages_nodemask+0x838/0x944)
[732563.578554] [<c00b9894>] (__alloc_pages_nodemask) from [<c03014b0>] (__netdev_alloc_frag+0x58/0x120)
[732563.578580] [<c03014b0>] (__netdev_alloc_frag) from [<c0306604>] (__netdev_alloc_skb+0x3c/0xdc)
[732563.578625] [<c0306604>] (__netdev_alloc_skb) from [<bf3437fc>] (rxq_refill+0x50/0x158 [mv643xx_eth])
[732563.578667] [<bf3437fc>] (rxq_refill [mv643xx_eth]) from [<bf343e9c>] (mv643xx_eth_poll+0x510/0x580 [mv643xx_eth])
[732563.578703] [<bf343e9c>] (mv643xx_eth_poll [mv643xx_eth]) from [<c030f918>] (net_rx_action+0xe8/0x228)
[732563.578733] [<c030f918>] (net_rx_action) from [<c001def8>] (__do_softirq+0x10c/0x288)
[732563.578759] [<c001def8>] (__do_softirq) from [<c001e2d4>] (irq_exit+0x88/0xe8)
[732563.578782] [<c001e2d4>] (irq_exit) from [<c0009d28>] (handle_IRQ+0x6c/0x88)
[732563.578803] [<c0009d28>] (handle_IRQ) from [<c000cf60>] (__irq_svc+0x40/0x4c)
[732563.578877] [<c000cf60>] (__irq_svc) from [<bf009050>] (scsi_request_fn+0x430/0x48c [scsi_mod])
[732563.578957] [<bf009050>] (scsi_request_fn [scsi_mod]) from [<c01dc0e4>] (__blk_run_queue+0x3c/0x4c)
[732563.578985] [<c01dc0e4>] (__blk_run_queue) from [<c01fe314>] (cfq_insert_request+0x448/0x478)
[732563.579011] [<c01fe314>] (cfq_insert_request) from [<c01d9c0c>] (__elv_add_request+0x2bc/0x30c)
[732563.579038] [<c01d9c0c>] (__elv_add_request) from [<c01dfa38>] (blk_flush_plug_list+0x1a0/0x1d8)
[732563.579064] [<c01dfa38>] (blk_flush_plug_list) from [<c01dfd70>] (blk_finish_plug+0x18/0x3c)
[732563.579112] [<c01dfd70>] (blk_finish_plug) from [<bf15530c>] (raid5d+0x39c/0x56c [raid456])
[732563.579197] [<bf15530c>] (raid5d [raid456]) from [<bf0e4660>] (md_thread+0x150/0x160 [md_mod])
[732563.579261] [<bf0e4660>] (md_thread [md_mod]) from [<c0034dc8>] (kthread+0xc0/0xd4)
[732563.579287] [<c0034dc8>] (kthread) from [<c0009490>] (ret_from_fork+0x14/0x20)
[732563.579303] Mem-info:
[732563.579312] DMA per-cpu:
[732563.579323] CPU 0: hi: 186, btch: 31 usd: 31
[732563.579343] active_anon:3308 inactive_anon:4779 isolated_anon:0
active_file:46057 inactive_file:48001 isolated_file:0
unevictable:0 dirty:901 writeback:264 unstable:0
free:266 slab_reclaimable:14117 slab_unreclaimable:3681
mapped:11695 shmem:1393 pagetables:493 bounce:0
free_cma:0
[732563.579416] DMA free:1064kB min:2864kB low:3580kB high:4296kB active_anon:13232kB inactive_anon:19116kB active_file:184228kB inactive_file:192004kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:524288kB managed:513716kB mlocked:0kB dirty:3604kB writeback:1056kB mapped:46780kB shmem:5572kB slab_reclaimable:56468kB slab_unreclaimable:14724kB kernel_stack:1160kB pagetables:1972kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[732563.579475] lowmem_reserve[]: 0 0 0 0
[732563.579490] DMA: 0*4kB 1*8kB (R) 0*16kB 1*32kB (R) 0*64kB 0*128kB 0*256kB 0*512kB 1*1024kB (R) 0*2048kB 0*4096kB = 1064kB
[732563.579532] 96690 total pagecache pages
[732563.579544] 1239 pages in swap cache
[732563.579556] Swap cache stats: add 139374, delete 138135, find 835583/858165
[732563.579569] Free swap = 5544960kB
[732563.579578] Total swap = 5582992kB
[732563.586483] 131072 pages of RAM
[732563.586501] 611 free pages
[732563.586511] 2643 reserved pages
[732563.586520] 17481 slab pages
[732563.586529] 125217 pages shared
[732563.586537] 1239 pages swap cached
[732563.686336] swapper: page allocation failure: order:0, mode:0x20
[732563.686366] CPU: 0 PID: 0 Comm: swapper Not tainted 3.16.0-4-kirkwood #1 Debian 3.16.7-ckt11-1+deb8u3
[732563.686405] [<c00100c4>] (unwind_backtrace) from [<c000c45c>] (show_stack+0x18/0x1c)
[732563.686435] [<c000c45c>] (show_stack) from [<c00b6e68>] (warn_alloc_failed+0xdc/0x10c)
[732563.686462] [<c00b6e68>] (warn_alloc_failed) from [<c00b9894>] (__alloc_pages_nodemask+0x838/0x944)
[732563.686489] [<c00b9894>] (__alloc_pages_nodemask) from [<c03014b0>] (__netdev_alloc_frag+0x58/0x120)
[732563.686515] [<c03014b0>] (__netdev_alloc_frag) from [<c0306604>] (__netdev_alloc_skb+0x3c/0xdc)
[732563.686559] [<c0306604>] (__netdev_alloc_skb) from [<bf3437fc>] (rxq_refill+0x50/0x158 [mv643xx_eth])
[732563.686601] [<bf3437fc>] (rxq_refill [mv643xx_eth]) from [<bf343e9c>] (mv643xx_eth_poll+0x510/0x580 [mv643xx_eth])
[732563.686637] [<bf343e9c>] (mv643xx_eth_poll [mv643xx_eth]) from [<c030f918>] (net_rx_action+0xe8/0x228)
[732563.686667] [<c030f918>] (net_rx_action) from [<c001def8>] (__do_softirq+0x10c/0x288)
[732563.686692] [<c001def8>] (__do_softirq) from [<c001e2d4>] (irq_exit+0x88/0xe8)
[732563.686716] [<c001e2d4>] (irq_exit) from [<c0009d28>] (handle_IRQ+0x6c/0x88)
[732563.686737] [<c0009d28>] (handle_IRQ) from [<c000cf60>] (__irq_svc+0x40/0x4c)
[732563.686762] [<c000cf60>] (__irq_svc) from [<c0044734>] (cpu_startup_entry+0x158/0x2dc)
[732563.686788] [<c0044734>] (cpu_startup_entry) from [<c053fb88>] (start_kernel+0x378/0x3e8)
[732563.686804] Mem-info:
[732563.686813] DMA per-cpu:
[732563.686824] CPU 0: hi: 186, btch: 31 usd: 31
[732563.686844] active_anon:3308 inactive_anon:4779 isolated_anon:0
active_file:46057 inactive_file:48001 isolated_file:0
unevictable:0 dirty:901 writeback:260 unstable:0
free:266 slab_reclaimable:14117 slab_unreclaimable:3681
mapped:11695 shmem:1393 pagetables:493 bounce:0
free_cma:0
[732563.686918] DMA free:1064kB min:2864kB low:3580kB high:4296kB active_anon:13232kB inactive_anon:19116kB active_file:184228kB inactive_file:192004kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:524288kB managed:513716kB mlocked:0kB dirty:3604kB writeback:1040kB mapped:46780kB shmem:5572kB slab_reclaimable:56468kB slab_unreclaimable:14724kB kernel_stack:1160kB pagetables:1972kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[732563.686977] lowmem_reserve[]: 0 0 0 0
[732563.686992] DMA: 0*4kB 1*8kB (R) 0*16kB 1*32kB (R) 0*64kB 0*128kB 0*256kB 0*512kB 1*1024kB (R) 0*2048kB 0*4096kB = 1064kB
[732563.687034] 96690 total pagecache pages
[732563.687046] 1239 pages in swap cache
[732563.687057] Swap cache stats: add 139374, delete 138135, find 835583/858165
[732563.687070] Free swap = 5544960kB
[732563.687079] Total swap = 5582992kB
[732563.693970] 131072 pages of RAM
[732563.693988] 611 free pages
[732563.693998] 2643 reserved pages
[732563.694007] 17481 slab pages
[732563.694016] 125217 pages shared
[732563.694025] 1239 pages swap cached
[732563.790337] swapper: page allocation failure: order:0, mode:0x20
[732563.790364] CPU: 0 PID: 0 Comm: swapper Not tainted 3.16.0-4-kirkwood #1 Debian 3.16.7-ckt11-1+deb8u3
[732563.790403] [<c00100c4>] (unwind_backtrace) from [<c000c45c>] (show_stack+0x18/0x1c)
[732563.790432] [<c000c45c>] (show_stack) from [<c00b6e68>] (warn_alloc_failed+0xdc/0x10c)
[732563.790460] [<c00b6e68>] (warn_alloc_failed) from [<c00b9894>] (__alloc_pages_nodemask+0x838/0x944)
[732563.790487] [<c00b9894>] (__alloc_pages_nodemask) from [<c03014b0>] (__netdev_alloc_frag+0x58/0x120)
[732563.790514] [<c03014b0>] (__netdev_alloc_frag) from [<c0306604>] (__netdev_alloc_skb+0x3c/0xdc)
[732563.790557] [<c0306604>] (__netdev_alloc_skb) from [<bf3437fc>] (rxq_refill+0x50/0x158 [mv643xx_eth])
[732563.790600] [<bf3437fc>] (rxq_refill [mv643xx_eth]) from [<bf343e9c>] (mv643xx_eth_poll+0x510/0x580 [mv643xx_eth])
[732563.790636] [<bf343e9c>] (mv643xx_eth_poll [mv643xx_eth]) from [<c030f918>] (net_rx_action+0xe8/0x228)
[732563.790665] [<c030f918>] (net_rx_action) from [<c001def8>] (__do_softirq+0x10c/0x288)
[732563.790691] [<c001def8>] (__do_softirq) from [<c001e2d4>] (irq_exit+0x88/0xe8)
[732563.790714] [<c001e2d4>] (irq_exit) from [<c0009d28>] (handle_IRQ+0x6c/0x88)
[732563.790735] [<c0009d28>] (handle_IRQ) from [<c000cf60>] (__irq_svc+0x40/0x4c)
[732563.790760] [<c000cf60>] (__irq_svc) from [<c0044734>] (cpu_startup_entry+0x158/0x2dc)
[732563.790785] [<c0044734>] (cpu_startup_entry) from [<c053fb88>] (start_kernel+0x378/0x3e8)
[732563.790802] Mem-info:
[732563.790811] DMA per-cpu:
[732563.790822] CPU 0: hi: 186, btch: 31 usd: 32
[732563.790842] active_anon:3308 inactive_anon:4779 isolated_anon:0
active_file:46057 inactive_file:48001 isolated_file:0
unevictable:0 dirty:901 writeback:257 unstable:0
free:266 slab_reclaimable:14116 slab_unreclaimable:3681
mapped:11695 shmem:1393 pagetables:493 bounce:0
free_cma:0
[732563.790915] DMA free:1064kB min:2864kB low:3580kB high:4296kB active_anon:13232kB inactive_anon:19116kB active_file:184228kB inactive_file:192004kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:524288kB managed:513716kB mlocked:0kB dirty:3604kB writeback:1028kB mapped:46780kB shmem:5572kB slab_reclaimable:56464kB slab_unreclaimable:14724kB kernel_stack:1160kB pagetables:1972kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[732563.790973] lowmem_reserve[]: 0 0 0 0
[732563.790989] DMA: 0*4kB 1*8kB (R) 0*16kB 1*32kB (R) 0*64kB 0*128kB 0*256kB 0*512kB 1*1024kB (R) 0*2048kB 0*4096kB = 1064kB
[732563.791030] 96690 total pagecache pages
[732563.791043] 1239 pages in swap cache
[732563.791054] Swap cache stats: add 139374, delete 138135, find 835583/858165
[732563.791067] Free swap = 5544960kB
[732563.791076] Total swap = 5582992kB
[732563.797955] 131072 pages of RAM
[732563.797974] 612 free pages
[732563.797983] 2643 reserved pages
[732563.797992] 17480 slab pages
[732563.798000] 125217 pages shared
[732563.798010] 1239 pages swap cached
[732563.894338] swapper: page allocation failure: order:0, mode:0x20
[732563.894369] CPU: 0 PID: 0 Comm: swapper Not tainted 3.16.0-4-kirkwood #1 Debian 3.16.7-ckt11-1+deb8u3
[732563.894407] [<c00100c4>] (unwind_backtrace) from [<c000c45c>] (show_stack+0x18/0x1c)
[732563.894436] [<c000c45c>] (show_stack) from [<c00b6e68>] (warn_alloc_failed+0xdc/0x10c)
[732563.894464] [<c00b6e68>] (warn_alloc_failed) from [<c00b9894>] (__alloc_pages_nodemask+0x838/0x944)
[732563.894490] [<c00b9894>] (__alloc_pages_nodemask) from [<c03014b0>] (__netdev_alloc_frag+0x58/0x120)
[732563.894517] [<c03014b0>] (__netdev_alloc_frag) from [<c0306604>] (__netdev_alloc_skb+0x3c/0xdc)
[732563.894561] [<c0306604>] (__netdev_alloc_skb) from [<bf3437fc>] (rxq_refill+0x50/0x158 [mv643xx_eth])
[732563.894604] [<bf3437fc>] (rxq_refill [mv643xx_eth]) from [<bf343e9c>] (mv643xx_eth_poll+0x510/0x580 [mv643xx_eth])
[732563.894640] [<bf343e9c>] (mv643xx_eth_poll [mv643xx_eth]) from [<c030f918>] (net_rx_action+0xe8/0x228)
[732563.894669] [<c030f918>] (net_rx_action) from [<c001def8>] (__do_softirq+0x10c/0x288)
[732563.894695] [<c001def8>] (__do_softirq) from [<c001e2d4>] (irq_exit+0x88/0xe8)
[732563.894718] [<c001e2d4>] (irq_exit) from [<c0009d28>] (handle_IRQ+0x6c/0x88)
[732563.894739] [<c0009d28>] (handle_IRQ) from [<c000cf60>] (__irq_svc+0x40/0x4c)
[732563.894765] [<c000cf60>] (__irq_svc) from [<c0044734>] (cpu_startup_entry+0x158/0x2dc)
[732563.894791] [<c0044734>] (cpu_startup_entry) from [<c053fb88>] (start_kernel+0x378/0x3e8)
[732563.894807] Mem-info:
[732563.894816] DMA per-cpu:
[732563.894827] CPU 0: hi: 186, btch: 31 usd: 32
[732563.894848] active_anon:3308 inactive_anon:4779 isolated_anon:0
active_file:46057 inactive_file:48001 isolated_file:0
unevictable:0 dirty:901 writeback:232 unstable:0
free:266 slab_reclaimable:14116 slab_unreclaimable:3681
mapped:11695 shmem:1393 pagetables:493 bounce:0
free_cma:0
[732563.894920] DMA free:1064kB min:2864kB low:3580kB high:4296kB active_anon:13232kB inactive_anon:19116kB active_file:184228kB inactive_file:192004kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:524288kB managed:513716kB mlocked:0kB dirty:3604kB writeback:928kB mapped:46780kB shmem:5572kB slab_reclaimable:56464kB slab_unreclaimable:14724kB kernel_stack:1160kB pagetables:1972kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[732563.894979] lowmem_reserve[]: 0 0 0 0
[732563.894994] DMA: 0*4kB 1*8kB (R) 0*16kB 1*32kB (R) 0*64kB 0*128kB 0*256kB 0*512kB 1*1024kB (R) 0*2048kB 0*4096kB = 1064kB
[732563.895035] 96690 total pagecache pages
[732563.895047] 1239 pages in swap cache
[732563.895059] Swap cache stats: add 139374, delete 138135, find 835583/858165
[732563.895071] Free swap = 5544960kB
[732563.895080] Total swap = 5582992kB
[732563.901975] 131072 pages of RAM
[732563.901993] 612 free pages
[732563.902003] 2643 reserved pages
[732563.902012] 17480 slab pages
[732563.902020] 125217 pages shared
[732563.902029] 1239 pages swap cached
[732563.998338] swapper: page allocation failure: order:0, mode:0x20
[732563.998365] CPU: 0 PID: 0 Comm: swapper Not tainted 3.16.0-4-kirkwood #1 Debian 3.16.7-ckt11-1+deb8u3
[732563.998403] [<c00100c4>] (unwind_backtrace) from [<c000c45c>] (show_stack+0x18/0x1c)
[732563.998432] [<c000c45c>] (show_stack) from [<c00b6e68>] (warn_alloc_failed+0xdc/0x10c)
[732563.998459] [<c00b6e68>] (warn_alloc_failed) from [<c00b9894>] (__alloc_pages_nodemask+0x838/0x944)
[732563.998486] [<c00b9894>] (__alloc_pages_nodemask) from [<c03014b0>] (__netdev_alloc_frag+0x58/0x120)
[732563.998512] [<c03014b0>] (__netdev_alloc_frag) from [<c0306604>] (__netdev_alloc_skb+0x3c/0xdc)
[732563.998556] [<c0306604>] (__netdev_alloc_skb) from [<bf3437fc>] (rxq_refill+0x50/0x158 [mv643xx_eth])
[732563.998598] [<bf3437fc>] (rxq_refill [mv643xx_eth]) from [<bf343e9c>] (mv643xx_eth_poll+0x510/0x580 [mv643xx_eth])
[732563.998634] [<bf343e9c>] (mv643xx_eth_poll [mv643xx_eth]) from [<c030f918>] (net_rx_action+0xe8/0x228)
[732563.998663] [<c030f918>] (net_rx_action) from [<c001def8>] (__do_softirq+0x10c/0x288)
[732563.998689] [<c001def8>] (__do_softirq) from [<c001e2d4>] (irq_exit+0x88/0xe8)
[732563.998712] [<c001e2d4>] (irq_exit) from [<c0009d28>] (handle_IRQ+0x6c/0x88)
[732563.998734] [<c0009d28>] (handle_IRQ) from [<c000cf60>] (__irq_svc+0x40/0x4c)
[732563.998759] [<c000cf60>] (__irq_svc) from [<c0044734>] (cpu_startup_entry+0x158/0x2dc)
[732563.998785] [<c0044734>] (cpu_startup_entry) from [<c053fb88>] (start_kernel+0x378/0x3e8)
[732563.998802] Mem-info:
[732563.998811] DMA per-cpu:
[732563.998822] CPU 0: hi: 186, btch: 31 usd: 32
[732563.998842] active_anon:3308 inactive_anon:4779 isolated_anon:0
active_file:46057 inactive_file:48001 isolated_file:0
unevictable:0 dirty:901 writeback:229 unstable:0
free:266 slab_reclaimable:14116 slab_unreclaimable:3681
mapped:11695 shmem:1393 pagetables:493 bounce:0
free_cma:0
[732563.998915] DMA free:1064kB min:2864kB low:3580kB high:4296kB active_anon:13232kB inactive_anon:19116kB active_file:184228kB inactive_file:192004kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:524288kB managed:513716kB mlocked:0kB dirty:3604kB writeback:916kB mapped:46780kB shmem:5572kB slab_reclaimable:56464kB slab_unreclaimable:14724kB kernel_stack:1160kB pagetables:1972kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[732563.998973] lowmem_reserve[]: 0 0 0 0
[732563.998988] DMA: 0*4kB 1*8kB (R) 0*16kB 1*32kB (R) 0*64kB 0*128kB 0*256kB 0*512kB 1*1024kB (R) 0*2048kB 0*4096kB = 1064kB
[732563.999030] 96690 total pagecache pages
[732563.999042] 1239 pages in swap cache
[732563.999054] Swap cache stats: add 139374, delete 138135, find 835583/858165
[732563.999067] Free swap = 5544960kB
[732563.999076] Total swap = 5582992kB
[732564.005944] 131072 pages of RAM
[732564.005962] 612 free pages
[732564.005971] 2643 reserved pages
[732564.005981] 17480 slab pages
[732564.005989] 125217 pages shared
[732564.005998] 1239 pages swap cached
[732564.102336] swapper: page allocation failure: order:0, mode:0x20
[732564.102363] CPU: 0 PID: 0 Comm: swapper Not tainted 3.16.0-4-kirkwood #1 Debian 3.16.7-ckt11-1+deb8u3
[732564.102400] [<c00100c4>] (unwind_backtrace) from [<c000c45c>] (show_stack+0x18/0x1c)
[732564.102429] [<c000c45c>] (show_stack) from [<c00b6e68>] (warn_alloc_failed+0xdc/0x10c)
[732564.102457] [<c00b6e68>] (warn_alloc_failed) from [<c00b9894>] (__alloc_pages_nodemask+0x838/0x944)
[732564.102484] [<c00b9894>] (__alloc_pages_nodemask) from [<c03014b0>] (__netdev_alloc_frag+0x58/0x120)
[732564.102510] [<c03014b0>] (__netdev_alloc_frag) from [<c0306604>] (__netdev_alloc_skb+0x3c/0xdc)
[732564.102554] [<c0306604>] (__netdev_alloc_skb) from [<bf3437fc>] (rxq_refill+0x50/0x158 [mv643xx_eth])
[732564.102596] [<bf3437fc>] (rxq_refill [mv643xx_eth]) from [<bf343e9c>] (mv643xx_eth_poll+0x510/0x580 [mv643xx_eth])
[732564.102632] [<bf343e9c>] (mv643xx_eth_poll [mv643xx_eth]) from [<c030f918>] (net_rx_action+0xe8/0x228)
[732564.102662] [<c030f918>] (net_rx_action) from [<c001def8>] (__do_softirq+0x10c/0x288)
[732564.102687] [<c001def8>] (__do_softirq) from [<c001e2d4>] (irq_exit+0x88/0xe8)
[732564.102711] [<c001e2d4>] (irq_exit) from [<c0009d28>] (handle_IRQ+0x6c/0x88)
[732564.102732] [<c0009d28>] (handle_IRQ) from [<c000cf60>] (__irq_svc+0x40/0x4c)
[732564.102758] [<c000cf60>] (__irq_svc) from [<c0044734>] (cpu_startup_entry+0x158/0x2dc)
[732564.102783] [<c0044734>] (cpu_startup_entry) from [<c053fb88>] (start_kernel+0x378/0x3e8)
[732564.102800] Mem-info:
[732564.102809] DMA per-cpu:
[732564.102820] CPU 0: hi: 186, btch: 31 usd: 32
[732564.102841] active_anon:3308 inactive_anon:4779 isolated_anon:0
active_file:46057 inactive_file:48001 isolated_file:0
unevictable:0 dirty:901 writeback:225 unstable:0
free:266 slab_reclaimable:14116 slab_unreclaimable:3681
mapped:11695 shmem:1393 pagetables:493 bounce:0
free_cma:0
[732564.102913] DMA free:1064kB min:2864kB low:3580kB high:4296kB active_anon:13232kB inactive_anon:19116kB active_file:184228kB inactive_file:192004kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:524288kB managed:513716kB mlocked:0kB dirty:3604kB writeback:900kB mapped:46780kB shmem:5572kB slab_reclaimable:56464kB slab_unreclaimable:14724kB kernel_stack:1160kB pagetables:1972kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[732564.102972] lowmem_reserve[]: 0 0 0 0
[732564.102987] DMA: 0*4kB 1*8kB (R) 0*16kB 1*32kB (R) 0*64kB 0*128kB 0*256kB 0*512kB 1*1024kB (R) 0*2048kB 0*4096kB = 1064kB
[732564.103029] 96690 total pagecache pages
[732564.103041] 1239 pages in swap cache
[732564.103053] Swap cache stats: add 139374, delete 138135, find 835583/858165
[732564.103065] Free swap = 5544960kB
[732564.103075] Total swap = 5582992kB
[732564.109946] 131072 pages of RAM
[732564.109965] 612 free pages
[732564.109974] 2643 reserved pages
[732564.109983] 17480 slab pages
[732564.109992] 125217 pages shared
[732564.110001] 1239 pages swap cached
[732564.134451] ksoftirqd/0: page allocation failure: order:0, mode:0x20
[732564.134481] CPU: 0 PID: 3 Comm: ksoftirqd/0 Not tainted 3.16.0-4-kirkwood #1 Debian 3.16.7-ckt11-1+deb8u3
[732564.134519] [<c00100c4>] (unwind_backtrace) from [<c000c45c>] (show_stack+0x18/0x1c)
[732564.134548] [<c000c45c>] (show_stack) from [<c00b6e68>] (warn_alloc_failed+0xdc/0x10c)
[732564.134576] [<c00b6e68>] (warn_alloc_failed) from [<c00b9894>] (__alloc_pages_nodemask+0x838/0x944)
[732564.134603] [<c00b9894>] (__alloc_pages_nodemask) from [<c03014b0>] (__netdev_alloc_frag+0x58/0x120)
[732564.134629] [<c03014b0>] (__netdev_alloc_frag) from [<c0306604>] (__netdev_alloc_skb+0x3c/0xdc)
[732564.134673] [<c0306604>] (__netdev_alloc_skb) from [<bf3437fc>] (rxq_refill+0x50/0x158 [mv643xx_eth])
[732564.134716] [<bf3437fc>] (rxq_refill [mv643xx_eth]) from [<bf343e9c>] (mv643xx_eth_poll+0x510/0x580 [mv643xx_eth])
[732564.134752] [<bf343e9c>] (mv643xx_eth_poll [mv643xx_eth]) from [<c030f918>] (net_rx_action+0xe8/0x228)
[732564.134781] [<c030f918>] (net_rx_action) from [<c001def8>] (__do_softirq+0x10c/0x288)
[732564.134806] [<c001def8>] (__do_softirq) from [<c001e0a4>] (run_ksoftirqd+0x30/0x60)
[732564.134831] [<c001e0a4>] (run_ksoftirqd) from [<c003afe0>] (smpboot_thread_fn+0x138/0x14c)
[732564.134855] [<c003afe0>] (smpboot_thread_fn) from [<c0034dc8>] (kthread+0xc0/0xd4)
[732564.134878] [<c0034dc8>] (kthread) from [<c0009490>] (ret_from_fork+0x14/0x20)
[732564.134894] Mem-info:
[732564.134902] DMA per-cpu:
[732564.134913] CPU 0: hi: 186, btch: 31 usd: 32
[732564.134933] active_anon:3308 inactive_anon:4779 isolated_anon:0
active_file:46057 inactive_file:48001 isolated_file:0
unevictable:0 dirty:880 writeback:244 unstable:0
free:266 slab_reclaimable:14116 slab_unreclaimable:3681
mapped:11695 shmem:1393 pagetables:493 bounce:0
free_cma:0
[732564.135006] DMA free:1064kB min:2864kB low:3580kB high:4296kB active_anon:13232kB inactive_anon:19116kB active_file:184228kB inactive_file:192004kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:524288kB managed:513716kB mlocked:0kB dirty:3520kB writeback:976kB mapped:46780kB shmem:5572kB slab_reclaimable:56464kB slab_unreclaimable:14724kB kernel_stack:1160kB pagetables:1972kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[732564.135065] lowmem_reserve[]: 0 0 0 0
[732564.135080] DMA: 0*4kB 1*8kB (R) 0*16kB 1*32kB (R) 0*64kB 0*128kB 0*256kB 0*512kB 1*1024kB (R) 0*2048kB 0*4096kB = 1064kB
[732564.135122] 96690 total pagecache pages
[732564.135134] 1239 pages in swap cache
[732564.135146] Swap cache stats: add 139374, delete 138135, find 835583/858165
[732564.135158] Free swap = 5544960kB
[732564.135167] Total swap = 5582992kB
[732564.142050] 131072 pages of RAM
[732564.142068] 612 free pages
[732564.142078] 2643 reserved pages
[732564.142087] 17480 slab pages
[732564.142096] 125217 pages shared
[732564.142105] 1239 pages swap cached
[732564.238340] swapper: page allocation failure: order:0, mode:0x20
[732564.238370] CPU: 0 PID: 0 Comm: swapper Not tainted 3.16.0-4-kirkwood #1 Debian 3.16.7-ckt11-1+deb8u3
[732564.238409] [<c00100c4>] (unwind_backtrace) from [<c000c45c>] (show_stack+0x18/0x1c)
[732564.238439] [<c000c45c>] (show_stack) from [<c00b6e68>] (warn_alloc_failed+0xdc/0x10c)
[732564.238466] [<c00b6e68>] (warn_alloc_failed) from [<c00b9894>] (__alloc_pages_nodemask+0x838/0x944)
[732564.238493] [<c00b9894>] (__alloc_pages_nodemask) from [<c03014b0>] (__netdev_alloc_frag+0x58/0x120)
[732564.238519] [<c03014b0>] (__netdev_alloc_frag) from [<c0306604>] (__netdev_alloc_skb+0x3c/0xdc)
[732564.238563] [<c0306604>] (__netdev_alloc_skb) from [<bf3437fc>] (rxq_refill+0x50/0x158 [mv643xx_eth])
[732564.238606] [<bf3437fc>] (rxq_refill [mv643xx_eth]) from [<bf343e9c>] (mv643xx_eth_poll+0x510/0x580 [mv643xx_eth])
[732564.238642] [<bf343e9c>] (mv643xx_eth_poll [mv643xx_eth]) from [<c030f918>] (net_rx_action+0xe8/0x228)
[732564.238672] [<c030f918>] (net_rx_action) from [<c001def8>] (__do_softirq+0x10c/0x288)
[732564.238697] [<c001def8>] (__do_softirq) from [<c001e2d4>] (irq_exit+0x88/0xe8)
[732564.238720] [<c001e2d4>] (irq_exit) from [<c0009d28>] (handle_IRQ+0x6c/0x88)
[732564.238741] [<c0009d28>] (handle_IRQ) from [<c000cf60>] (__irq_svc+0x40/0x4c)
[732564.238767] [<c000cf60>] (__irq_svc) from [<c0044734>] (cpu_startup_entry+0x158/0x2dc)
[732564.238792] [<c0044734>] (cpu_startup_entry) from [<c053fb88>] (start_kernel+0x378/0x3e8)
[732564.238809] Mem-info:
[732564.238818] DMA per-cpu:
[732564.238829] CPU 0: hi: 186, btch: 31 usd: 32
[732564.238849] active_anon:3308 inactive_anon:4779 isolated_anon:0
active_file:46057 inactive_file:48001 isolated_file:0
unevictable:0 dirty:880 writeback:234 unstable:0
free:266 slab_reclaimable:14116 slab_unreclaimable:3681
mapped:11695 shmem:1393 pagetables:493 bounce:0
free_cma:0
[732564.238921] DMA free:1064kB min:2864kB low:3580kB high:4296kB active_anon:13232kB inactive_anon:19116kB active_file:184228kB inactive_file:192004kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:524288kB managed:513716kB mlocked:0kB dirty:3520kB writeback:936kB mapped:46780kB shmem:5572kB slab_reclaimable:56464kB slab_unreclaimable:14724kB kernel_stack:1160kB pagetables:1972kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[732564.238979] lowmem_reserve[]: 0 0 0 0
[732564.238995] DMA: 0*4kB 1*8kB (R) 0*16kB 1*32kB (R) 0*64kB 0*128kB 0*256kB 0*512kB 1*1024kB (R) 0*2048kB 0*4096kB = 1064kB
[732564.239036] 96690 total pagecache pages
[732564.239048] 1239 pages in swap cache
[732564.239060] Swap cache stats: add 139374, delete 138135, find 835583/858165
[732564.239073] Free swap = 5544960kB
[732564.239082] Total swap = 5582992kB
[732564.245965] 131072 pages of RAM
[732564.245984] 612 free pages
[732564.245993] 2643 reserved pages
[732564.246002] 17480 slab pages
[732564.246011] 125217 pages shared
[732564.246020] 1239 pages swap cached
[1258268.897172] mv643xx_eth_port mv643xx_eth_port.0 eth0: link down
[1258284.366223] mv643xx_eth_port mv643xx_eth_port.0 eth0: link up, 1000 Mb/s, full duplex, flow control disabled
Reply to: