Your message dated Fri, 14 Oct 2011 13:24:14 +0100 with message-id <1318595061.4024.240.camel@deadeye> and subject line Re: Bug#645306: linux-image-2.6.32-5-kirkwood: page allocation failure after enabling jumbo frames has caused the Debian Bug report #645306, regarding linux-image-2.6.32-5-kirkwood: page allocation failure after enabling jumbo frames to be marked as done. This means that you claim that the problem has been dealt with. If this is not the case it is now your responsibility to reopen the Bug report if necessary, and/or fix the problem forthwith. (NB: If you are a system administrator and have no idea what this message is talking about, this may indicate a serious mail system misconfiguration somewhere. Please contact owner@bugs.debian.org immediately.) -- 645306: http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=645306 Debian Bug Tracking System Contact owner@bugs.debian.org with problems
--- Begin Message ---
- To: Debian Bug Tracking System <submit@bugs.debian.org>
- Subject: linux-image-2.6.32-5-kirkwood: page allocation failure after enabling jumbo frames
- From: aelschuring@hotmail.com
- Date: Fri, 14 Oct 2011 11:47:22 +0200
- Message-id: <[🔎] 20111014094722.2948.47636.reportbug@genie.loos.site>
Package: linux-2.6 Version: 2.6.32-38 Severity: normal I'm seeing multiple swapper allocation failures (with backtrace) since I increased the MTU on one of the network interfaces: [36290.311168] swapper: page allocation failure. order:2, mode:0x4020 [36290.311233] [<c002df78>] (unwind_backtrace+0x0/0xdc) from [<c00a5904>] (__alloc_pages_nodemask+0x4e4/0x584) [36290.311276] [<c00a5904>] (__alloc_pages_nodemask+0x4e4/0x584) from [<c00a59b8>] (__get_free_pages+0x14/0x44) [36290.311318] [<c00a59b8>] (__get_free_pages+0x14/0x44) from [<c00ca018>] (__kmalloc_track_caller+0x40/0x19c) [36290.311356] [<c00ca018>] (__kmalloc_track_caller+0x40/0x19c) from [<c0235710>] (__alloc_skb+0x50/0x10c) [36290.311391] [<c0235710>] (__alloc_skb+0x50/0x10c) from [<c02367b4>] (dev_alloc_skb+0x1c/0x44) [36290.311456] [<c02367b4>] (dev_alloc_skb+0x1c/0x44) from [<bf0b3254>] (rxq_refill+0x7c/0x144 [mv643xx_eth]) [36290.311527] [<bf0b3254>] (rxq_refill+0x7c/0x144 [mv643xx_eth]) from [<bf0b4afc>] (mv643xx_eth_poll+0x5e4/0x68c [mv643xx_eth]) [36290.311589] [<bf0b4afc>] (mv643xx_eth_poll+0x5e4/0x68c [mv643xx_eth]) from [<c023d5ac>] (net_rx_action+0x90/0x208) [36290.311632] [<c023d5ac>] (net_rx_action+0x90/0x208) from [<c004b558>] (__do_softirq+0xc0/0x1a8) [36290.311668] [<c004b558>] (__do_softirq+0xc0/0x1a8) from [<c004b680>] (irq_exit+0x40/0x94) [36290.311701] [<c004b680>] (irq_exit+0x40/0x94) from [<c0027070>] (asm_do_IRQ+0x70/0x8c) [36290.311732] [<c0027070>] (asm_do_IRQ+0x70/0x8c) from [<c0027ad4>] (__irq_svc+0x34/0x80) For now, swap has been disabled and I am not seeing any more traces, but the traces aren't occuring regularly so that isn't saying much. Will report back if the traces occur without swap as well. As an indication of frequency: ladmin@gnome:~$ zgrep swapper: /var/log/kern.log* /var/log/kern.log:Oct 14 00:27:37 genie kernel: [2898220.232272] swapper: page allocation failure. order:2, mode:0x4020 /var/log/kern.log:Oct 14 00:42:26 genie kernel: [2899109.609445] swapper: page allocation failure. order:2, mode:0x4020 /var/log/kern.log:Oct 14 00:54:34 genie kernel: [2899838.053379] swapper: page allocation failure. order:2, mode:0x4020 /var/log/kern.log:Oct 14 00:58:06 genie kernel: [2900049.147139] swapper: page allocation failure. order:2, mode:0x4020 /var/log/kern.log:Oct 14 10:42:42 genie kernel: [34964.059729] swapper: page allocation failure. order:2, mode:0x4020 /var/log/kern.log:Oct 14 11:04:48 genie kernel: [36290.311168] swapper: page allocation failure. order:2, mode:0x4020 /var/log/kern.log:Oct 14 11:05:08 genie kernel: [36310.658851] swapper: page allocation failure. order:2, mode:0x4020 note: /usr/share/bug/linux-image-2.6.32-5-kirkwood/script returned with error. When run manually, it says yesno: command not found Regards, Arno -- Package-specific info: ** Version: Linux version 2.6.32-5-kirkwood (Debian 2.6.32-35) (dannf@debian.org) (gcc version 4.3.5 (Debian 4.3.5-4) ) #1 Tue Jun 14 23:05:32 UTC 2011 ** Command line: root=/dev/ram initrd=0xa00000,0x900000 ramdisk=32768 ** Not tainted ** Kernel log: [34964.060844] Normal: 330*4kB 267*8kB 10*16kB 1*32kB 1*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 3712kB [34964.060893] 107895 total pagecache pages [34964.060906] 121 pages in swap cache [34964.060920] Swap cache stats: add 121, delete 0, find 0/0 [34964.060935] Free swap = 261628kB [34964.060947] Total swap = 262112kB [34964.069064] 131072 pages of RAM [34964.069079] 1220 free pages [34964.069090] 2389 reserved pages [34964.069102] 5031 slab pages [34964.069112] 43892 pages shared [34964.069123] 121 pages swap cached [36310.658851] swapper: page allocation failure. order:2, mode:0x4020 [36310.658916] [<c002df78>] (unwind_backtrace+0x0/0xdc) from [<c00a5904>] (__alloc_pages_nodemask+0x4e4/0x584) [36310.658959] [<c00a5904>] (__alloc_pages_nodemask+0x4e4/0x584) from [<c00a59b8>] (__get_free_pages+0x14/0x44) [36310.659000] [<c00a59b8>] (__get_free_pages+0x14/0x44) from [<c00ca018>] (__kmalloc_track_caller+0x40/0x19c) [36310.659038] [<c00ca018>] (__kmalloc_track_caller+0x40/0x19c) from [<c0235710>] (__alloc_skb+0x50/0x10c) [36310.659072] [<c0235710>] (__alloc_skb+0x50/0x10c) from [<c02367b4>] (dev_alloc_skb+0x1c/0x44) [36310.659136] [<c02367b4>] (dev_alloc_skb+0x1c/0x44) from [<bf0b3254>] (rxq_refill+0x7c/0x144 [mv643xx_eth]) [36310.659207] [<bf0b3254>] (rxq_refill+0x7c/0x144 [mv643xx_eth]) from [<bf0b4afc>] (mv643xx_eth_poll+0x5e4/0x68c [mv643xx_eth]) [36310.659269] [<bf0b4afc>] (mv643xx_eth_poll+0x5e4/0x68c [mv643xx_eth]) from [<c023d5ac>] (net_rx_action+0x90/0x208) [36310.659312] [<c023d5ac>] (net_rx_action+0x90/0x208) from [<c004b558>] (__do_softirq+0xc0/0x1a8) [36310.659348] [<c004b558>] (__do_softirq+0xc0/0x1a8) from [<c004b680>] (irq_exit+0x40/0x94) [36310.659381] [<c004b680>] (irq_exit+0x40/0x94) from [<c0027070>] (asm_do_IRQ+0x70/0x8c) [36310.659412] [<c0027070>] (asm_do_IRQ+0x70/0x8c) from [<c0027ad4>] (__irq_svc+0x34/0x80) [36310.659438] Exception stack(0xc03adf48 to 0xc03adf90) [36310.659461] df40: 000ae312 000ae312 4e97fb44 000ac918 c03b3d70 c03b3d80 [36310.659491] df60: c03b3d70 c043ac88 00022b9c 56251311 000229c8 00000000 2a870384 c03adf90 [36310.659519] df80: c0066934 c00320ec 20000013 ffffffff [36310.659546] [<c0027ad4>] (__irq_svc+0x34/0x80) from [<c00320ec>] (kirkwood_enter_idle+0x64/0x88) [36310.659587] [<c00320ec>] (kirkwood_enter_idle+0x64/0x88) from [<c0227af0>] (cpuidle_idle_call+0xb0/0x150) [36310.659625] [<c0227af0>] (cpuidle_idle_call+0xb0/0x150) from [<c002944c>] (cpu_idle+0x5c/0xa4) [36310.659660] [<c002944c>] (cpu_idle+0x5c/0xa4) from [<c0008b2c>] (start_kernel+0x280/0x2e4) [36310.659702] [<c0008b2c>] (start_kernel+0x280/0x2e4) from [<00008034>] (0x8034) [36310.659725] Mem-info: [36310.659736] Normal per-cpu: [36310.659749] CPU 0: hi: 186, btch: 31 usd: 49 [36310.659774] active_anon:1240 inactive_anon:7723 isolated_anon:0 [36310.659779] active_file:13546 inactive_file:94370 isolated_file:0 [36310.659785] unevictable:16 dirty:0 writeback:0 unstable:0 [36310.659790] free:965 slab_reclaimable:5462 slab_unreclaimable:1763 [36310.659796] mapped:2461 shmem:44 pagetables:182 bounce:0 [36310.659866] Normal free:3860kB min:2884kB low:3604kB high:4324kB active_anon:4960kB inactive_anon:30892kB active_file:54184kB inactive_file:377480kB unevictable:64kB isolated(anon):0kB isolated(file):0kB present:520192kB mlocked:64kB dirty:0kB writeback:0kB mapped:9844kB shmem:176kB slab_reclaimable:21848kB slab_unreclaimable:7052kB kernel_stack:1072kB pagetables:728kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no [36310.659955] lowmem_reserve[]: 0 0 [36310.659971] Normal: 407*4kB 245*8kB 9*16kB 2*32kB 1*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 3860kB [36310.660021] 108085 total pagecache pages [36310.660034] 121 pages in swap cache [36310.660048] Swap cache stats: add 121, delete 0, find 0/0 [36310.660063] Free swap = 261628kB [36310.660075] Total swap = 262112kB [36310.668324] 131072 pages of RAM [36310.668348] 1247 free pages [36310.668360] 2389 reserved pages [36310.668372] 4878 slab pages [36310.668383] 40307 pages shared [36310.668394] 121 pages swap cached ** Model information Processor : Feroceon 88FR131 rev 1 (v5l) Hardware : QNAP TS-41x Revision : 0000 ** Loaded modules: Module Size Used by rpcsec_gss_krb5 9026 0 nfsd 247560 13 exportfs 3000 1 nfsd nfs 270508 0 lockd 63165 2 nfsd,nfs fscache 34105 1 nfs nfs_acl 2277 2 nfsd,nfs auth_rpcgss 33334 3 rpcsec_gss_krb5,nfsd,nfs sunrpc 171216 18 rpcsec_gss_krb5,nfsd,nfs,lockd,nfs_acl,auth_rpcgss ipv6 253786 62 ext4 288561 4 jbd2 64191 1 ext4 configfs 20841 0 loop 11427 0 hmac 2475 0 sha1_generic 1717 0 evdev 6582 0 mv_cesa 9262 0 aes_generic 32820 1 mv_cesa gpio_keys 3066 0 dm_mod 56595 19 raid456 50943 1 async_raid6_recov 4240 1 raid456 async_pq 3424 2 raid456,async_raid6_recov raid6_pq 75781 2 async_raid6_recov,async_pq async_xor 2563 3 raid456,async_raid6_recov,async_pq xor 4819 1 async_xor async_memcpy 956 2 raid456,async_raid6_recov async_tx 2008 5 raid456,async_raid6_recov,async_pq,async_xor,async_memcpy raid10 19531 1 raid1 19757 1 md_mod 80446 6 raid456,raid10,raid1 btrfs 539502 1 crc32c 2562 1 libcrc32c 896 1 btrfs ext3 111104 1 jbd 37434 1 ext3 ext2 55323 0 mbcache 4860 3 ext4,ext3,ext2 usbhid 35658 1 hid 63178 1 usbhid sd_mod 31324 18 crc_t10dif 1106 1 sd_mod ehci_hcd 36473 0 sata_mv 24398 14 mv643xx_eth 22558 0 usbcore 122547 4 usbhid,ehci_hcd libata 137894 1 sata_mv nls_base 5367 1 usbcore libphy 14836 1 mv643xx_eth inet_lro 5060 1 mv643xx_eth scsi_mod 124244 2 sd_mod,libata ** Network interface configuration: # This file describes the network interfaces available on your system # and how to activate them. For more information, see interfaces(5). # The loopback network interface auto lo iface lo inet loopback # The primary network interface auto eth0 iface eth0 inet dhcp # Secondary network interface auto eth1 iface eth1 inet dhcp #iface eth1 inet static # address 169.254.100.100 # netmask 255.255.0.0 ** Network status: *** IP interfaces and addresses: 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 16436 qdisc noqueue state UNKNOWN link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9216 qdisc mq state UP qlen 1000 link/ether 00:08:9b:be:6d:6f brd ff:ff:ff:ff:ff:ff inet 172.22.15.8/24 brd 172.22.15.255 scope global eth0 inet6 2002:d594:e6a3:15:208:9bff:febe:6d6f/64 scope global dynamic valid_lft 7200sec preferred_lft 300sec inet6 fe80::208:9bff:febe:6d6f/64 scope link valid_lft forever preferred_lft forever 3: eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000 link/ether 00:50:43:3c:3b:5d brd ff:ff:ff:ff:ff:ff inet 172.22.21.8/24 brd 172.22.21.255 scope global eth1 inet6 2002:d594:e6a3:21:250:43ff:fe3c:3b5d/64 scope global dynamic valid_lft 6736sec preferred_lft 136sec inet6 fe80::250:43ff:fe3c:3b5d/64 scope link valid_lft forever preferred_lft forever *** Device statistics: Inter-| Receive | Transmit face |bytes packets errs drop fifo frame compressed multicast|bytes packets errs drop fifo colls carrier compressed lo:17184164 7980 0 0 0 0 0 0 17184164 7980 0 0 0 0 0 0 eth0: 646762 5669 0 0 0 0 0 0 1709063 24943 0 0 0 0 0 0 eth1:145501742 240971 0 0 0 0 0 0 381890415 301105 0 0 0 0 0 0 *** Protocol statistics: Ip: 248689 total packets received 4 with invalid addresses 0 forwarded 0 incoming packets discarded 248662 incoming packets delivered 129259 requests sent out 1 outgoing packets dropped 46 reassemblies required 23 packets reassembled ok Icmp: 33 ICMP messages received 0 input ICMP message failed. ICMP input histogram: destination unreachable: 24 echo requests: 9 65 ICMP messages sent 0 ICMP messages failed ICMP output histogram: destination unreachable: 56 echo replies: 9 IcmpMsg: InType3: 24 InType8: 9 OutType0: 9 OutType3: 56 Tcp: 197 active connections openings 480 passive connection openings 5 failed connection attempts 0 connection resets received 14 connections established 248017 segments received 127990 segments send out 126 segments retransmited 0 bad segments received. 23 resets sent Udp: 570 packets received 56 packets to unknown port received. 0 packet receive errors 1098 packets sent UdpLite: TcpExt: 157 TCP sockets finished time wait in fast timer 526 delayed acks sent 1 delayed acks further delayed because of locked socket Quick ack mode was activated 3 times 581 packets directly queued to recvmsg prequeue. 550 bytes directly in process context from backlog 39679 bytes directly received in process context from prequeue 118533 packet headers predicted 580 packets header predicted and directly queued to user 5737 acknowledgments not containing data payload received 148010 predicted acknowledgments 21 times recovered from packet loss by selective acknowledgements 293 TCP data loss events TCPLostRetransmit: 6 116 fast retransmits 5 forward retransmits 3 other TCP timeouts 3 DSACKs sent for old packets 1 connections reset due to unexpected data 2 connections reset due to early user close 2 connections aborted due to timeout TCPSackShifted: 644 TCPSackMerged: 485 TCPSackShiftFallback: 77 IpExt: OutMcastPkts: 500 InBcastPkts: 10 InOctets: 158326048 OutOctets: 385567306 OutMcastOctets: 177631 InBcastOctets: 4284 ** PCI devices: 00:00.0 Memory controller [0580]: Marvell Technology Group Ltd. 88F6281 [Kirkwood] ARM SoC [11ab:6281] (rev 02) Subsystem: Marvell Technology Group Ltd. Device [11ab:11ab] Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx+ Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx- Latency: 0, Cache Line Size: 32 bytes Interrupt: pin A routed to IRQ 9 Region 0: Memory at <ignored> (64-bit, prefetchable) Capabilities: <access denied> 00:01.0 SCSI storage controller [0100]: Marvell Technology Group Ltd. 88SX7042 PCI-e 4-port SATA-II [11ab:7042] (rev 02) Subsystem: Marvell Technology Group Ltd. Device [11ab:11ab] Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx- Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx- Latency: 0, Cache Line Size: 32 bytes Interrupt: pin A routed to IRQ 9 Region 0: Memory at e0000000 (64-bit, non-prefetchable) [size=1M] Region 2: I/O ports at 1000 [size=256] Capabilities: <access denied> Kernel driver in use: sata_mv ** Sound cards: -- System Information: Debian Release: 6.0.3 APT prefers stable APT policy: (990, 'stable'), (600, 'testing'), (200, 'stable-updates') Architecture: armel (armv5tel) Kernel: Linux 2.6.32-5-kirkwood Locale: LANG=en_GB.UTF-8, LC_CTYPE=en_GB.UTF-8 (charmap=UTF-8) (ignored: LC_ALL set to en_GB.UTF-8) Shell: /bin/sh linked to /bin/dash Versions of packages linux-image-2.6.32-5-kirkwood depends on: ii debconf [debconf-2.0] 1.5.36.1 Debian configuration management sy ii initramfs-tools [linux-initra 0.98.8 tools for generating an initramfs ii linux-base 2.6.32-38 Linux image base package ii module-init-tools 3.12-1 tools for managing Linux kernel mo Versions of packages linux-image-2.6.32-5-kirkwood recommends: ii firmware-linux-free 2.6.32-38 Binary firmware for various driver ii uboot-mkimage 0.4 generate kernel image for U-Boot Versions of packages linux-image-2.6.32-5-kirkwood suggests: pn fdutils <none> (no description available) pn linux-doc-2.6.32 <none> (no description available) Versions of packages linux-image-2.6.32-5-kirkwood is related to: pn firmware-bnx2 <none> (no description available) pn firmware-bnx2x <none> (no description available) pn firmware-ipw2x00 <none> (no description available) pn firmware-ivtv <none> (no description available) pn firmware-iwlwifi <none> (no description available) pn firmware-linux <none> (no description available) pn firmware-linux-nonfree <none> (no description available) pn firmware-qlogic <none> (no description available) pn firmware-ralink <none> (no description available) pn xen-hypervisor <none> (no description available) -- debconf information: linux-image-2.6.32-5-kirkwood/postinst/bootloader-error-2.6.32-5-kirkwood: linux-image-2.6.32-5-kirkwood/postinst/bootloader-test-error-2.6.32-5-kirkwood: shared/kernel-image/really-run-bootloader: true linux-image-2.6.32-5-kirkwood/postinst/depmod-error-initrd-2.6.32-5-kirkwood: false linux-image-2.6.32-5-kirkwood/postinst/ignoring-do-bootloader-2.6.32-5-kirkwood: linux-image-2.6.32-5-kirkwood/postinst/missing-firmware-2.6.32-5-kirkwood: linux-image-2.6.32-5-kirkwood/prerm/would-invalidate-boot-loader-2.6.32-5-kirkwood: true linux-image-2.6.32-5-kirkwood/prerm/removing-running-kernel-2.6.32-5-kirkwood: true[ 0.000000] Initializing cgroup subsys cpuset [ 0.000000] Initializing cgroup subsys cpu [ 0.000000] Linux version 2.6.32-5-kirkwood (Debian 2.6.32-35) (dannf@debian.org) (gcc version 4.3.5 (Debian 4.3.5-4) ) #1 Tue Jun 14 23:05:32 UTC 2011 [ 0.000000] CPU: Feroceon 88FR131 [56251311] revision 1 (ARMv5TE), cr=00053977 [ 0.000000] CPU: VIVT data cache, VIVT instruction cache [ 0.000000] Machine: QNAP TS-41x [ 0.000000] Ignoring unrecognised tag 0x41000403 [ 0.000000] Memory policy: ECC disabled, Data cache writeback [ 0.000000] On node 0 totalpages: 131072 [ 0.000000] free_area_init_node: node 0, pgdat c03d50e0, node_mem_map c0442000 [ 0.000000] Normal zone: 1024 pages used for memmap [ 0.000000] Normal zone: 0 pages reserved [ 0.000000] Normal zone: 130048 pages, LIFO batch:31 [ 0.000000] Built 1 zonelists in Zone order, mobility grouping on. Total pages: 130048 [ 0.000000] Kernel command line: root=/dev/ram initrd=0xa00000,0x900000 ramdisk=32768 [ 0.000000] PID hash table entries: 2048 (order: 1, 8192 bytes) [ 0.000000] Dentry cache hash table entries: 65536 (order: 6, 262144 bytes) [ 0.000000] Inode-cache hash table entries: 32768 (order: 5, 131072 bytes) [ 0.000000] Memory: 256MB 256MB = 512MB total [ 0.000000] Memory: 505984KB available (3516K code, 583K data, 124K init, 0K highmem) [ 0.000000] SLUB: Genslabs=11, HWalign=32, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 [ 0.000000] Hierarchical RCU implementation. [ 0.000000] NR_IRQS:114 [ 0.000000] Console: colour dummy device 80x30 [ 0.000000] console [tty0] enabled [ 21.475127] Calibrating delay loop... 1199.30 BogoMIPS (lpj=5996544) [ 21.704934] Security Framework initialized [ 21.704960] SELinux: Disabled at boot. [ 21.704994] Mount-cache hash table entries: 512 [ 21.705324] Initializing cgroup subsys ns [ 21.705359] Initializing cgroup subsys cpuacct [ 21.705380] Initializing cgroup subsys devices [ 21.705400] Initializing cgroup subsys freezer [ 21.705417] Initializing cgroup subsys net_cls [ 21.705489] CPU: Testing write buffer coherency: ok [ 21.706295] devtmpfs: initialized [ 21.707980] regulator: core version 0.5 [ 21.708221] NET: Registered protocol family 16 [ 21.708765] Kirkwood: MV88F6281-A0, TCLK=200000000. [ 21.708797] Feroceon L2: Enabling L2 [ 21.708844] Feroceon L2: Cache support initialised. [ 21.709292] initial MPP regs: 11112222 43303311 33330004 33003333 00000033 00000000 00000000 [ 21.709317] final MPP regs: 11112222 43303311 33330004 33003333 00000033 00000000 00000000 [ 21.749897] Kirkwood PCIe port 0: [ 21.749908] link up [ 21.749940] PCI: bus0 uses PCIe port 0 [ 21.750074] pci 0000:00:00.0: reg 10 64bit mmio pref: [0xf1000000-0xf10fffff] [ 21.750090] pci 0000:00:00.0: reg 18 32bit mmio: [0x000000-0x1fffffff] [ 21.750117] pci 0000:00:00.0: supports D1 D2 [ 21.750172] pci 0000:00:01.0: reg 10 64bit mmio: [0x14000000-0x140fffff] [ 21.750187] pci 0000:00:01.0: reg 18 io port: [0x00-0xff] [ 21.750270] PCI: bus0: Fast back to back transfers disabled [ 21.751560] bio: create slab <bio-0> at 0 [ 21.751847] vgaarb: loaded [ 21.752310] Switching to clocksource orion_clocksource [ 21.756074] NET: Registered protocol family 2 [ 21.756331] IP route cache hash table entries: 4096 (order: 2, 16384 bytes) [ 21.757115] TCP established hash table entries: 16384 (order: 5, 131072 bytes) [ 21.757485] TCP bind hash table entries: 16384 (order: 4, 65536 bytes) [ 21.757674] TCP: Hash tables configured (established 16384 bind 16384) [ 21.757693] TCP reno registered [ 21.757867] NET: Registered protocol family 1 [ 21.758057] Unpacking initramfs... [ 22.257173] Freeing initrd memory: 9216K [ 22.257292] NetWinder Floating Point Emulator V0.97 (double precision) [ 22.257549] audit: initializing netlink socket (disabled) [ 22.257598] type=2000 audit(0.770:1): initialized [ 22.264218] VFS: Disk quotas dquot_6.5.2 [ 22.264488] Dquot-cache hash table entries: 1024 (order 0, 4096 bytes) [ 22.264596] JFFS2 version 2.2. (NAND) (SUMMARY) © 2001-2006 Red Hat, Inc. [ 22.265198] msgmni has been set to 1006 [ 22.266913] alg: No test for stdrng (krng) [ 22.267057] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 253) [ 22.267087] io scheduler noop registered [ 22.267101] io scheduler anticipatory registered [ 22.267117] io scheduler deadline registered [ 22.267309] io scheduler cfq registered (default) [ 22.273372] Serial: 8250/16550 driver, 2 ports, IRQ sharing disabled [ 22.273880] serial8250.0: ttyS0 at MMIO 0xf1012000 (irq = 33) is a 16550A [ 22.274145] serial8250.1: ttyS1 at MMIO 0xf1012100 (irq = 34) is a 16550A [ 22.275095] m25p80 spi0.0: m25p128 (16384 Kbytes) [ 22.275122] Creating 6 MTD partitions on "spi_flash": [ 22.275143] 0x000000000000-0x000000080000 : "U-Boot" [ 22.275741] 0x000000200000-0x000000400000 : "Kernel" [ 22.276243] 0x000000400000-0x000000d00000 : "RootFS1" [ 22.276703] 0x000000d00000-0x000001000000 : "RootFS2" [ 22.277165] 0x000000080000-0x0000000c0000 : "U-Boot Config" [ 22.277605] 0x0000000c0000-0x000000200000 : "NAS Config" [ 22.278284] mice: PS/2 mouse device common for all mice [ 23.282363] rtc-mv rtc-mv: internal RTC not ticking [ 23.282483] i2c /dev entries driver [ 23.284390] rtc-s35390a 0-0030: rtc core: registered rtc-s35390a as rtc0 [ 23.284639] cpuidle: using governor ladder [ 23.284779] cpuidle: using governor menu [ 23.284859] mv_xor_shared mv_xor_shared.0: Marvell shared XOR driver [ 23.284898] mv_xor_shared mv_xor_shared.1: Marvell shared XOR driver [ 23.322386] mv_xor mv_xor.0: Marvell XOR: ( xor cpy ) [ 23.362382] mv_xor mv_xor.1: Marvell XOR: ( xor fill cpy ) [ 23.402382] mv_xor mv_xor.2: Marvell XOR: ( xor cpy ) [ 23.442383] mv_xor mv_xor.3: Marvell XOR: ( xor fill cpy ) [ 23.443565] TCP cubic registered [ 23.443587] NET: Registered protocol family 17 [ 23.443615] Gating clock of unused units [ 23.443622] before: 0x00cfc1dd [ 23.443628] after: 0x00cfc1cd [ 23.443932] registered taskstats version 1 [ 23.445278] rtc-s35390a 0-0030: setting system clock to 2011-10-13 23:00:21 UTC (1318546821) [ 23.445310] Initalizing network drop monitor service [ 23.445386] Freeing init memory: 124K [ 23.522800] udev[44]: starting version 164 [ 23.832493] SCSI subsystem initialized [ 23.961206] libata version 3.00 loaded. [ 24.015976] usbcore: registered new interface driver usbfs [ 24.016679] usbcore: registered new interface driver hub [ 24.017384] usbcore: registered new device driver usb [ 24.037831] MV-643xx 10/100/1000 ethernet driver version 1.4 [ 24.038755] mv643xx_eth smi: probed [ 24.053703] sata_mv 0000:00:01.0: version 1.28 [ 24.053822] PCI: enabling device 0000:00:01.0 (0140 -> 0143) [ 24.053985] sata_mv 0000:00:01.0: Gen-IIE 32 slots 4 ports SCSI mode IRQ via INTx [ 24.055488] scsi0 : sata_mv [ 24.061372] scsi1 : sata_mv [ 24.063067] net eth0: port 0 with MAC address 00:08:9b:be:6d:6f [ 24.064504] scsi2 : sata_mv [ 24.065687] scsi3 : sata_mv [ 24.065880] ata1: SATA max UDMA/133 mmio m1048576@0xe0000000 port 0xe0022000 irq 9 [ 24.065911] ata2: SATA max UDMA/133 mmio m1048576@0xe0000000 port 0xe0024000 irq 9 [ 24.065937] ata3: SATA max UDMA/133 mmio m1048576@0xe0000000 port 0xe0026000 irq 9 [ 24.065963] ata4: SATA max UDMA/133 mmio m1048576@0xe0000000 port 0xe0028000 irq 9 [ 24.074534] net eth1: port 0 with MAC address 00:50:43:3c:3b:5d [ 24.074661] sata_mv sata_mv.0: version 1.28 [ 24.074799] sata_mv sata_mv.0: slots 32 ports 2 [ 24.077329] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 24.078163] scsi4 : sata_mv [ 24.078689] scsi5 : sata_mv [ 24.078871] ata5: SATA max UDMA/133 irq 21 [ 24.078891] ata6: SATA max UDMA/133 irq 21 [ 24.079877] orion-ehci orion-ehci.0: Marvell Orion EHCI [ 24.079955] orion-ehci orion-ehci.0: new USB bus registered, assigned bus number 1 [ 24.102379] orion-ehci orion-ehci.0: irq 19, io mem 0xf1050000 [ 24.122371] orion-ehci orion-ehci.0: USB 2.0 started, EHCI 1.00 [ 24.122448] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002 [ 24.122470] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 24.122494] usb usb1: Product: Marvell Orion EHCI [ 24.122510] usb usb1: Manufacturer: Linux 2.6.32-5-kirkwood ehci_hcd [ 24.122529] usb usb1: SerialNumber: orion-ehci.0 [ 24.123103] usb usb1: configuration #1 chosen from 1 choice [ 24.123433] hub 1-0:1.0: USB hub found [ 24.123498] hub 1-0:1.0: 1 port detected [ 24.422368] ata5: SATA link down (SStatus 0 SControl F300) [ 24.442377] usb 1-1: new high speed USB device using orion-ehci and address 2 [ 24.593688] usb 1-1: New USB device found, idVendor=05e3, idProduct=0608 [ 24.593719] usb 1-1: New USB device strings: Mfr=0, Product=1, SerialNumber=0 [ 24.593740] usb 1-1: Product: USB2.0 Hub [ 24.594261] usb 1-1: configuration #1 chosen from 1 choice [ 24.594847] hub 1-1:1.0: USB hub found [ 24.595189] hub 1-1:1.0: 4 ports detected [ 24.632394] ata1: SATA link up 3.0 Gbps (SStatus 123 SControl 300) [ 24.692444] ata1.00: ATA-8: WDC WD15EARS-00Z5B1, 80.00A80, max UDMA/133 [ 24.692474] ata1.00: 2930277168 sectors, multi 0: LBA48 NCQ (depth 31/32) [ 24.732468] ata1.00: configured for UDMA/133 [ 24.732789] scsi 0:0:0:0: Direct-Access ATA WDC WD15EARS-00Z 80.0 PQ: 0 ANSI: 5 [ 24.872728] usb 1-1.2: new low speed USB device using orion-ehci and address 3 [ 25.087445] usb 1-1.2: New USB device found, idVendor=051d, idProduct=0002 [ 25.087477] usb 1-1.2: New USB device strings: Mfr=3, Product=1, SerialNumber=2 [ 25.087502] usb 1-1.2: Product: Back-UPS CS 350 FW:807.q7.I USB FW:q7 [ 25.087521] usb 1-1.2: Manufacturer: American Power Conversion [ 25.087539] usb 1-1.2: SerialNumber: BB0549066133 [ 25.088071] usb 1-1.2: configuration #1 chosen from 1 choice [ 25.242386] ata2: SATA link up 3.0 Gbps (SStatus 123 SControl 300) [ 25.742416] ata2.00: ATA-8: WDC WD15EARS-00Z5B1, 80.00A80, max UDMA/133 [ 25.742447] ata2.00: 2930277168 sectors, multi 0: LBA48 NCQ (depth 31/32) [ 25.802458] ata2.00: configured for UDMA/133 [ 25.802772] scsi 1:0:0:0: Direct-Access ATA WDC WD15EARS-00Z 80.0 PQ: 0 ANSI: 5 [ 25.829615] sd 0:0:0:0: [sda] 2930277168 512-byte logical blocks: (1.50 TB/1.36 TiB) [ 25.829887] sd 0:0:0:0: [sda] Write Protect is off [ 25.829910] sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00 [ 25.830012] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 25.830620] sda: [ 25.832022] sd 1:0:0:0: [sdb] 2930277168 512-byte logical blocks: (1.50 TB/1.36 TiB) [ 25.832282] sd 1:0:0:0: [sdb] Write Protect is off [ 25.832305] sd 1:0:0:0: [sdb] Mode Sense: 00 3a 00 00 [ 25.832450] sd 1:0:0:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 25.833045] sdb: sda1 sda2 sda3 [ 25.881643] sd 0:0:0:0: [sda] Attached SCSI disk [ 25.889867] sdb1 sdb2 sdb3 [ 25.892581] sd 1:0:0:0: [sdb] Attached SCSI disk [ 26.312393] ata3: SATA link up 3.0 Gbps (SStatus 123 SControl 300) [ 26.352509] ata3.00: ATA-8: ST2000VM002-9UY166, SC01, max UDMA/133 [ 26.352537] ata3.00: 3907029168 sectors, multi 0: LBA48 NCQ (depth 31/32) [ 26.412467] ata3.00: configured for UDMA/133 [ 26.412763] scsi 2:0:0:0: Direct-Access ATA ST2000VM002-9UY1 SC01 PQ: 0 ANSI: 5 [ 26.415866] sd 2:0:0:0: [sdc] 3907029168 512-byte logical blocks: (2.00 TB/1.81 TiB) [ 26.415903] sd 2:0:0:0: [sdc] 4096-byte physical blocks [ 26.416151] sd 2:0:0:0: [sdc] Write Protect is off [ 26.416174] sd 2:0:0:0: [sdc] Mode Sense: 00 3a 00 00 [ 26.416274] sd 2:0:0:0: [sdc] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 26.416874] sdc: sdc1 sdc2 sdc3 sdc4 [ 26.490207] sd 2:0:0:0: [sdc] Attached SCSI disk [ 31.962356] ata4: link is slow to respond, please be patient (ready=0) [ 35.742387] ata4: SATA link up 3.0 Gbps (SStatus 123 SControl 300) [ 35.782418] ata4.00: ATA-8: ST2000VM002-9UY166, SC01, max UDMA/133 [ 35.782446] ata4.00: 3907029168 sectors, multi 0: LBA48 NCQ (depth 31/32) [ 35.842466] ata4.00: configured for UDMA/133 [ 35.842777] scsi 3:0:0:0: Direct-Access ATA ST2000VM002-9UY1 SC01 PQ: 0 ANSI: 5 [ 35.845479] sd 3:0:0:0: [sdd] 3907029168 512-byte logical blocks: (2.00 TB/1.81 TiB) [ 35.845519] sd 3:0:0:0: [sdd] 4096-byte physical blocks [ 35.845771] sd 3:0:0:0: [sdd] Write Protect is off [ 35.845794] sd 3:0:0:0: [sdd] Mode Sense: 00 3a 00 00 [ 35.845894] sd 3:0:0:0: [sdd] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 35.846503] sdd: sdd1 sdd2 sdd3 sdd4 [ 35.920206] sd 3:0:0:0: [sdd] Attached SCSI disk [ 36.192377] ata6: SATA link down (SStatus 0 SControl F300) [ 36.317437] usbcore: registered new interface driver hiddev [ 37.840944] generic-usb 0003:051D:0002.0001: hiddev0,hidraw0: USB HID v1.10 Device [American Power Conversion Back-UPS CS 350 FW:807.q7.I USB FW:q7] on usb-orion-ehci.0-1.2/input0 [ 37.841077] usbcore: registered new interface driver usbhid [ 37.841103] usbhid: v2.6:USB HID core driver [ 38.048934] Btrfs loaded [ 38.109057] md: raid1 personality registered for level 1 [ 38.125914] md: raid10 personality registered for level 10 [ 38.135047] async_tx: api initialized (async) [ 38.139439] xor: measuring software checksum speed [ 38.182346] arm4regs : 1090.800 MB/sec [ 38.232346] 8regs : 808.400 MB/sec [ 38.282347] 32regs : 905.600 MB/sec [ 38.282366] xor: using function: arm4regs (1090.800 MB/sec) [ 38.452871] raid6: int32x1 78 MB/s [ 38.622531] raid6: int32x2 104 MB/s [ 38.792639] raid6: int32x4 125 MB/s [ 38.962900] raid6: int32x8 110 MB/s [ 38.962919] raid6: using algorithm int32x4 (125 MB/s) [ 38.990139] md: raid6 personality registered for level 6 [ 38.990170] md: raid5 personality registered for level 5 [ 38.990187] md: raid4 personality registered for level 4 [ 39.107690] md: md0 stopped. [ 39.132169] md: bind<sdb2> [ 39.162638] md: bind<sdc2> [ 39.162940] md: bind<sda2> [ 39.163344] md: bind<sdd2> [ 39.168568] raid10: raid set md0 active with 4 out of 4 devices [ 39.168708] md0: detected capacity change from 0 to 8719958016 [ 39.176636] md0: unknown partition table [ 39.473277] md: md127 stopped. [ 39.491857] md: bind<sdb3> [ 39.495281] md: bind<sdc3> [ 39.497175] md: bind<sdd3> [ 39.500470] md: bind<sda3> [ 39.517865] raid5: device sda3 operational as raid disk 0 [ 39.517900] raid5: device sdd3 operational as raid disk 3 [ 39.517919] raid5: device sdc3 operational as raid disk 2 [ 39.517938] raid5: device sdb3 operational as raid disk 1 [ 39.519533] raid5: allocated 4228kB for md127 [ 39.523171] 0: w=1 pa=0 pr=4 m=1 a=2 r=4 op1=0 op2=0 [ 39.523204] 3: w=2 pa=0 pr=4 m=1 a=2 r=4 op1=0 op2=0 [ 39.523223] 2: w=3 pa=0 pr=4 m=1 a=2 r=4 op1=0 op2=0 [ 39.523242] 1: w=4 pa=0 pr=4 m=1 a=2 r=4 op1=0 op2=0 [ 39.523261] raid5: raid level 5 set md127 active with 4 out of 4 devices, algorithm 2 [ 39.523283] RAID5 conf printout: [ 39.523296] --- rd:4 wd:4 [ 39.523310] disk 0, o:1, dev:sda3 [ 39.523324] disk 1, o:1, dev:sdb3 [ 39.523338] disk 2, o:1, dev:sdc3 [ 39.523352] disk 3, o:1, dev:sdd3 [ 39.523500] md127: detected capacity change from 0 to 4487617708032 [ 39.535456] md127: unknown partition table [ 39.578354] md: md2 stopped. [ 39.595680] md: bind<sdc4> [ 39.596098] md: bind<sdd4> [ 39.610955] raid1: raid set md2 active with 2 out of 2 mirrors [ 39.611088] md2: detected capacity change from 0 to 500095839232 [ 39.615336] md2: unknown partition table [ 39.855612] device-mapper: uevent: version 1.0.3 [ 39.857836] device-mapper: ioctl: 4.15.0-ioctl (2009-04-01) initialised: dm-devel@redhat.com [ 40.872825] kjournald starting. Commit interval 5 seconds [ 40.872882] EXT3-fs: mounted filesystem with ordered data mode. [ 42.048245] udev[298]: starting version 164 [ 42.331616] input: gpio-keys as /devices/platform/gpio-keys/input/input0 [ 44.877957] Adding 65528k swap on /dev/sda1. Priority:4 extents:1 across:65528k [ 44.885492] Adding 65528k swap on /dev/sdb1. Priority:4 extents:1 across:65528k [ 44.927098] Adding 65528k swap on /dev/sdd1. Priority:4 extents:1 across:65528k [ 44.956054] Adding 65528k swap on /dev/sdc1. Priority:4 extents:1 across:65528k [ 45.252856] EXT3 FS on dm-0, internal journal [ 45.480132] loop: module loaded [ 45.598630] netconsole: local port 6665 [ 45.598660] netconsole: local IP 0.0.0.0 [ 45.598674] netconsole: interface eth1 [ 45.598688] netconsole: remote port 6666 [ 45.598702] netconsole: remote IP 172.22.21.5 [ 45.598718] netconsole: remote ethernet address ff:ff:ff:ff:ff:ff [ 45.598740] netconsole: device eth1 not up yet, forcing it [ 47.651972] eth1: link up, 100 Mb/s, full duplex, flow control disabled [ 47.662365] netconsole: no IP address for eth1, aborting [ 47.662391] netconsole: cleaning up [ 49.332929] EXT4-fs (dm-5): mounted filesystem with ordered data mode [ 49.469844] EXT4-fs (dm-1): mounted filesystem with ordered data mode [ 49.494290] device label ceph devid 1 transid 93 /dev/mapper/data-ceph [ 49.921956] EXT4-fs (dm-2): mounted filesystem with writeback data mode [ 49.997858] EXT4-fs (dm-4): mounted filesystem with ordered data mode [ 51.077474] NET: Registered protocol family 10 [ 51.367012] ADDRCONF(NETDEV_UP): eth0: link is not ready [ 54.462193] eth0: link up, 1000 Mb/s, full duplex, flow control disabled [ 54.462414] ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready [ 59.517474] eth0: link up, 1000 Mb/s, full duplex, flow control disabled [ 70.165782] RPC: Registered udp transport module. [ 70.165816] RPC: Registered tcp transport module. [ 70.165832] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 70.675608] Slow work thread pool: Starting up [ 70.693787] Slow work thread pool: Ready [ 70.694758] FS-Cache: Loaded [ 71.494810] FS-Cache: Netfs 'nfs' registered for caching [ 72.084698] Installing knfsd (copyright (C) 1996 okir@monad.swb.de). [ 73.777406] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory [ 73.787043] NFSD: starting 90-second grace period [34964.059729] swapper: page allocation failure. order:2, mode:0x4020 [34964.059793] [<c002df78>] (unwind_backtrace+0x0/0xdc) from [<c00a5904>] (__alloc_pages_nodemask+0x4e4/0x584) [34964.059835] [<c00a5904>] (__alloc_pages_nodemask+0x4e4/0x584) from [<c00a59b8>] (__get_free_pages+0x14/0x44) [34964.059876] [<c00a59b8>] (__get_free_pages+0x14/0x44) from [<c00ca018>] (__kmalloc_track_caller+0x40/0x19c) [34964.059914] [<c00ca018>] (__kmalloc_track_caller+0x40/0x19c) from [<c0235710>] (__alloc_skb+0x50/0x10c) [34964.059949] [<c0235710>] (__alloc_skb+0x50/0x10c) from [<c02367b4>] (dev_alloc_skb+0x1c/0x44) [34964.060012] [<c02367b4>] (dev_alloc_skb+0x1c/0x44) from [<bf0b3254>] (rxq_refill+0x7c/0x144 [mv643xx_eth]) [34964.060083] [<bf0b3254>] (rxq_refill+0x7c/0x144 [mv643xx_eth]) from [<bf0b4afc>] (mv643xx_eth_poll+0x5e4/0x68c [mv643xx_eth]) [34964.060144] [<bf0b4afc>] (mv643xx_eth_poll+0x5e4/0x68c [mv643xx_eth]) from [<c023d5ac>] (net_rx_action+0x90/0x208) [34964.060188] [<c023d5ac>] (net_rx_action+0x90/0x208) from [<c004b558>] (__do_softirq+0xc0/0x1a8) [34964.060224] [<c004b558>] (__do_softirq+0xc0/0x1a8) from [<c004b680>] (irq_exit+0x40/0x94) [34964.060256] [<c004b680>] (irq_exit+0x40/0x94) from [<c0027070>] (asm_do_IRQ+0x70/0x8c) [34964.060287] [<c0027070>] (asm_do_IRQ+0x70/0x8c) from [<c0027ad4>] (__irq_svc+0x34/0x80) [34964.060313] Exception stack(0xc03adf48 to 0xc03adf90) [34964.060335] df40: 0001bebb 0001bebb 4e97f602 0000df6a c03b3d70 c03b3de0 [34964.060366] df60: c03b3d70 c043ac88 00022b9c 56251311 000229c8 00000000 06d10902 c03adf90 [34964.060393] df80: c0066934 c00320ec 20000013 ffffffff [34964.060420] [<c0027ad4>] (__irq_svc+0x34/0x80) from [<c00320ec>] (kirkwood_enter_idle+0x64/0x88) [34964.060460] [<c00320ec>] (kirkwood_enter_idle+0x64/0x88) from [<c0227af0>] (cpuidle_idle_call+0xb0/0x150) [34964.060498] [<c0227af0>] (cpuidle_idle_call+0xb0/0x150) from [<c002944c>] (cpu_idle+0x5c/0xa4) [34964.060532] [<c002944c>] (cpu_idle+0x5c/0xa4) from [<c0008b2c>] (start_kernel+0x280/0x2e4) [34964.060575] [<c0008b2c>] (start_kernel+0x280/0x2e4) from [<00008034>] (0x8034) [34964.060598] Mem-info: [34964.060609] Normal per-cpu: [34964.060622] CPU 0: hi: 186, btch: 31 usd: 59 [34964.060647] active_anon:1236 inactive_anon:7727 isolated_anon:0 [34964.060652] active_file:13581 inactive_file:94149 isolated_file:0 [34964.060658] unevictable:16 dirty:2 writeback:0 unstable:0 [34964.060663] free:928 slab_reclaimable:5673 slab_unreclaimable:1770 [34964.060669] mapped:2461 shmem:44 pagetables:182 bounce:0 [34964.060739] Normal free:3712kB min:2884kB low:3604kB high:4324kB active_anon:4944kB inactive_anon:30908kB active_file:54324kB inactive_file:376596kB unevictable:64kB isolated(anon):0kB isolated(file):0kB present:520192kB mlocked:64kB dirty:8kB writeback:0kB mapped:9844kB shmem:176kB slab_reclaimable:22692kB slab_unreclaimable:7080kB kernel_stack:1072kB pagetables:728kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no [34964.060828] lowmem_reserve[]: 0 0 [34964.060844] Normal: 330*4kB 267*8kB 10*16kB 1*32kB 1*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 3712kB [34964.060893] 107895 total pagecache pages [34964.060906] 121 pages in swap cache [34964.060920] Swap cache stats: add 121, delete 0, find 0/0 [34964.060935] Free swap = 261628kB [34964.060947] Total swap = 262112kB [34964.069064] 131072 pages of RAM [34964.069079] 1220 free pages [34964.069090] 2389 reserved pages [34964.069102] 5031 slab pages [34964.069112] 43892 pages shared [34964.069123] 121 pages swap cached [36290.311168] swapper: page allocation failure. order:2, mode:0x4020 [36290.311233] [<c002df78>] (unwind_backtrace+0x0/0xdc) from [<c00a5904>] (__alloc_pages_nodemask+0x4e4/0x584) [36290.311276] [<c00a5904>] (__alloc_pages_nodemask+0x4e4/0x584) from [<c00a59b8>] (__get_free_pages+0x14/0x44) [36290.311318] [<c00a59b8>] (__get_free_pages+0x14/0x44) from [<c00ca018>] (__kmalloc_track_caller+0x40/0x19c) [36290.311356] [<c00ca018>] (__kmalloc_track_caller+0x40/0x19c) from [<c0235710>] (__alloc_skb+0x50/0x10c) [36290.311391] [<c0235710>] (__alloc_skb+0x50/0x10c) from [<c02367b4>] (dev_alloc_skb+0x1c/0x44) [36290.311456] [<c02367b4>] (dev_alloc_skb+0x1c/0x44) from [<bf0b3254>] (rxq_refill+0x7c/0x144 [mv643xx_eth]) [36290.311527] [<bf0b3254>] (rxq_refill+0x7c/0x144 [mv643xx_eth]) from [<bf0b4afc>] (mv643xx_eth_poll+0x5e4/0x68c [mv643xx_eth]) [36290.311589] [<bf0b4afc>] (mv643xx_eth_poll+0x5e4/0x68c [mv643xx_eth]) from [<c023d5ac>] (net_rx_action+0x90/0x208) [36290.311632] [<c023d5ac>] (net_rx_action+0x90/0x208) from [<c004b558>] (__do_softirq+0xc0/0x1a8) [36290.311668] [<c004b558>] (__do_softirq+0xc0/0x1a8) from [<c004b680>] (irq_exit+0x40/0x94) [36290.311701] [<c004b680>] (irq_exit+0x40/0x94) from [<c0027070>] (asm_do_IRQ+0x70/0x8c) [36290.311732] [<c0027070>] (asm_do_IRQ+0x70/0x8c) from [<c0027ad4>] (__irq_svc+0x34/0x80) [36290.311758] Exception stack(0xc03adf48 to 0xc03adf90) [36290.311780] df40: 000594ec 000594ec 4e97fb30 00058108 c03b3d70 c03b3d80 [36290.311812] df60: c03b3d70 c043ac88 00022b9c 56251311 000229c8 00000000 15cdbe2c c03adf90 [36290.311839] df80: c0066934 c00320ec 20000013 ffffffff [36290.311866] [<c0027ad4>] (__irq_svc+0x34/0x80) from [<c00320ec>] (kirkwood_enter_idle+0x64/0x88) [36290.311907] [<c00320ec>] (kirkwood_enter_idle+0x64/0x88) from [<c0227af0>] (cpuidle_idle_call+0xb0/0x150) [36290.311946] [<c0227af0>] (cpuidle_idle_call+0xb0/0x150) from [<c002944c>] (cpu_idle+0x5c/0xa4) [36290.311981] [<c002944c>] (cpu_idle+0x5c/0xa4) from [<c0008b2c>] (start_kernel+0x280/0x2e4) [36290.312023] [<c0008b2c>] (start_kernel+0x280/0x2e4) from [<00008034>] (0x8034) [36290.312045] Mem-info: [36290.312056] Normal per-cpu: [36290.312070] CPU 0: hi: 186, btch: 31 usd: 30 [36290.312094] active_anon:1240 inactive_anon:7723 isolated_anon:0 [36290.312100] active_file:13546 inactive_file:94375 isolated_file:0 [36290.312106] unevictable:16 dirty:0 writeback:0 unstable:0 [36290.312111] free:943 slab_reclaimable:5497 slab_unreclaimable:1764 [36290.312117] mapped:2461 shmem:44 pagetables:182 bounce:0 [36290.312187] Normal free:3772kB min:2884kB low:3604kB high:4324kB active_anon:4960kB inactive_anon:30892kB active_file:54184kB inactive_file:377500kB unevictable:64kB isolated(anon):0kB isolated(file):0kB present:520192kB mlocked:64kB dirty:0kB writeback:0kB mapped:9844kB shmem:176kB slab_reclaimable:21988kB slab_unreclaimable:7056kB kernel_stack:1072kB pagetables:728kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no [36290.312277] lowmem_reserve[]: 0 0 [36290.312292] Normal: 427*4kB 242*8kB 6*16kB 1*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 3772kB [36290.312341] 108091 total pagecache pages [36290.312354] 121 pages in swap cache [36290.312368] Swap cache stats: add 121, delete 0, find 0/0 [36290.312384] Free swap = 261628kB [36290.312395] Total swap = 262112kB [36290.320614] 131072 pages of RAM [36290.320636] 1206 free pages [36290.320647] 2389 reserved pages [36290.320659] 4903 slab pages [36290.320670] 40787 pages shared [36290.320681] 121 pages swap cached [36310.658851] swapper: page allocation failure. order:2, mode:0x4020 [36310.658916] [<c002df78>] (unwind_backtrace+0x0/0xdc) from [<c00a5904>] (__alloc_pages_nodemask+0x4e4/0x584) [36310.658959] [<c00a5904>] (__alloc_pages_nodemask+0x4e4/0x584) from [<c00a59b8>] (__get_free_pages+0x14/0x44) [36310.659000] [<c00a59b8>] (__get_free_pages+0x14/0x44) from [<c00ca018>] (__kmalloc_track_caller+0x40/0x19c) [36310.659038] [<c00ca018>] (__kmalloc_track_caller+0x40/0x19c) from [<c0235710>] (__alloc_skb+0x50/0x10c) [36310.659072] [<c0235710>] (__alloc_skb+0x50/0x10c) from [<c02367b4>] (dev_alloc_skb+0x1c/0x44) [36310.659136] [<c02367b4>] (dev_alloc_skb+0x1c/0x44) from [<bf0b3254>] (rxq_refill+0x7c/0x144 [mv643xx_eth]) [36310.659207] [<bf0b3254>] (rxq_refill+0x7c/0x144 [mv643xx_eth]) from [<bf0b4afc>] (mv643xx_eth_poll+0x5e4/0x68c [mv643xx_eth]) [36310.659269] [<bf0b4afc>] (mv643xx_eth_poll+0x5e4/0x68c [mv643xx_eth]) from [<c023d5ac>] (net_rx_action+0x90/0x208) [36310.659312] [<c023d5ac>] (net_rx_action+0x90/0x208) from [<c004b558>] (__do_softirq+0xc0/0x1a8) [36310.659348] [<c004b558>] (__do_softirq+0xc0/0x1a8) from [<c004b680>] (irq_exit+0x40/0x94) [36310.659381] [<c004b680>] (irq_exit+0x40/0x94) from [<c0027070>] (asm_do_IRQ+0x70/0x8c) [36310.659412] [<c0027070>] (asm_do_IRQ+0x70/0x8c) from [<c0027ad4>] (__irq_svc+0x34/0x80) [36310.659438] Exception stack(0xc03adf48 to 0xc03adf90) [36310.659461] df40: 000ae312 000ae312 4e97fb44 000ac918 c03b3d70 c03b3d80 [36310.659491] df60: c03b3d70 c043ac88 00022b9c 56251311 000229c8 00000000 2a870384 c03adf90 [36310.659519] df80: c0066934 c00320ec 20000013 ffffffff [36310.659546] [<c0027ad4>] (__irq_svc+0x34/0x80) from [<c00320ec>] (kirkwood_enter_idle+0x64/0x88) [36310.659587] [<c00320ec>] (kirkwood_enter_idle+0x64/0x88) from [<c0227af0>] (cpuidle_idle_call+0xb0/0x150) [36310.659625] [<c0227af0>] (cpuidle_idle_call+0xb0/0x150) from [<c002944c>] (cpu_idle+0x5c/0xa4) [36310.659660] [<c002944c>] (cpu_idle+0x5c/0xa4) from [<c0008b2c>] (start_kernel+0x280/0x2e4) [36310.659702] [<c0008b2c>] (start_kernel+0x280/0x2e4) from [<00008034>] (0x8034) [36310.659725] Mem-info: [36310.659736] Normal per-cpu: [36310.659749] CPU 0: hi: 186, btch: 31 usd: 49 [36310.659774] active_anon:1240 inactive_anon:7723 isolated_anon:0 [36310.659779] active_file:13546 inactive_file:94370 isolated_file:0 [36310.659785] unevictable:16 dirty:0 writeback:0 unstable:0 [36310.659790] free:965 slab_reclaimable:5462 slab_unreclaimable:1763 [36310.659796] mapped:2461 shmem:44 pagetables:182 bounce:0 [36310.659866] Normal free:3860kB min:2884kB low:3604kB high:4324kB active_anon:4960kB inactive_anon:30892kB active_file:54184kB inactive_file:377480kB unevictable:64kB isolated(anon):0kB isolated(file):0kB present:520192kB mlocked:64kB dirty:0kB writeback:0kB mapped:9844kB shmem:176kB slab_reclaimable:21848kB slab_unreclaimable:7052kB kernel_stack:1072kB pagetables:728kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no [36310.659955] lowmem_reserve[]: 0 0 [36310.659971] Normal: 407*4kB 245*8kB 9*16kB 2*32kB 1*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 3860kB [36310.660021] 108085 total pagecache pages [36310.660034] 121 pages in swap cache [36310.660048] Swap cache stats: add 121, delete 0, find 0/0 [36310.660063] Free swap = 261628kB [36310.660075] Total swap = 262112kB [36310.668324] 131072 pages of RAM [36310.668348] 1247 free pages [36310.668360] 2389 reserved pages [36310.668372] 4878 slab pages [36310.668383] 40307 pages shared [36310.668394] 121 pages swap cached
--- End Message ---
--- Begin Message ---
- To: 645306-done@bugs.debian.org
- Subject: Re: Bug#645306: linux-image-2.6.32-5-kirkwood: page allocation failure after enabling jumbo frames
- From: Ben Hutchings <ben@decadent.org.uk>
- Date: Fri, 14 Oct 2011 13:24:14 +0100
- Message-id: <1318595061.4024.240.camel@deadeye>
- In-reply-to: <[🔎] SNT108-W146DDD05E6D91D77CDE822B8E10@phx.gbl>
- References: <[🔎] 20111014094722.2948.47636.reportbug@genie.loos.site> <[🔎] SNT108-W146DDD05E6D91D77CDE822B8E10@phx.gbl>
On Fri, 2011-10-14 at 10:00 +0000, Arno Schuring wrote: > Maybe I should have searched the 'Net before firing... > > > I'm seeing multiple swapper allocation failures (with backtrace) since I > > increased the MTU on one of the network interfaces: > > According to http://www.mail-archive.com/debian-arm@lists.debian.org/msg10282.html this is actually expected behaviour? > > If anyone can confirm that the messages are indeed harmless? When you enable jumbo frames with a driver/hardware that doesn't support DMA scatter, this can require allocation of multiple contiguous pages for each receive buffer. Such an allocation is often not possible without waiting for data to be swapped/flushed to disk, but network packet processing cannot wait for that. This has nothing to do with the swapper (aka the idle task); that was just the task that the network adapter interrupted. This is certainly not unexpected behaviour. But it's also not harmless, because if memory allocation fails often enough then incoming packets may be dropped. You may be able to reduce the risk of allocation failure by tuning the virtual memory system to write-back dirty pages more aggressively. I'm not sure there's a good guide to that, but the parameters are documented in <http://www.kernel.org/doc/Documentation/sysctl/vm.txt>. Ben. -- Ben Hutchings Quantity is no substitute for quality, but it's the only one we've got.Attachment: signature.asc
Description: This is a digitally signed message part
--- End Message ---