Bug#597729: #7303: linux-image-2.6-amd64: page allocation failure. order:0, mode:0x20
Package: linux-image-2.6-amd64
Version: 2.6.26+17+lenny1
Severity: important
We are experiencing similar issues as described in Debian Bug report #592187
(http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=592187).
I can't include logs and the output from several commands during the moment the
issue occurred, because the issue we are experiencing is on production servers
and we needed them to be up-and-running as soon as possible. As described in
message #44 (http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=592187#44), we
used the "e1000" driver for the network; that did solve the problem we had with
the "page allocation failure. order:0, mode:0x20" related to several packages.
I've seen that the solution (patch) was applied to kernel packages like
"linux-image-2.6.32-5-amd64_2.6.32-22_amd64.deb", though not to the currently
stable kernel included in "Debian 5.0 Lenny"
I will try to include as much related information as possible.
== KVM Virtual machine system ==
This is the system where the issue occurred. The KVM host system (see further
on) is not affected by the issue.
Snippet from /var/log/syslog at the moment(s) the issue did occur:
Sep 13 08:41:04 srv-2 kernel: [432745.310248] smbd: page allocation failure. order:0, mode:0x20
Sep 13 08:41:04 srv-2 kernel: [432745.311126] Pid: 18525, comm: smbd Not tainted 2.6.26-2-amd64 #1
Sep 13 08:41:04 srv-2 kernel: [432745.311887]
Sep 13 08:41:04 srv-2 kernel: [432745.311887] Call Trace:
Sep 13 08:41:04 srv-2 kernel: [432745.313128] [<ffffffff80276bc5>] __alloc_pages_internal+0x3a6/0x3bf
...
Sep 13 11:25:45 srv-2 kernel: [1368578.263690] smbd: page allocation failure. order:0, mode:0x20
Sep 13 11:25:45 srv-2 kernel: [1368578.263690] Pid: 12536, comm: smbd Not tainted 2.6.26-2-amd64 #1
Sep 13 11:25:45 srv-2 kernel: [1368578.263690]
Sep 13 11:25:45 srv-2 kernel: [1368578.263690] Call Trace:
Sep 13 11:25:45 srv-2 kernel: [1368578.263690] [<ffffffff80276bc5>] __alloc_pages_internal+0x3a6/0x3bf
...
Note: The following information is *not* from the exact time the issue occured.
~# dpkg -l | grep linux-image
ii linux-image-2.6-amd64 2.6.26+17+lenny1 Linux 2.6 image on AMD64
ii linux-image-2.6.26-2-amd64 2.6.26-24lenny1 Linux 2.6.26 image on AMD64
Package: linux-image-2.6-amd64
Priority: optional
Section: admin
Installed-Size: 32
Maintainer: Debian Kernel Team <debian-kernel@lists.debian.org>
Architecture: amd64
Source: linux-latest-2.6 (17+lenny1)
Version: 2.6.26+17+lenny1
Provides: linux-latest-modules-2.6.26-2-amd64
Depends: linux-image-2.6.26-2-amd64
Filename: pool/main/l/linux-latest-2.6/linux-image-2.6-amd64_2.6.26+17+lenny1_amd64.deb
Size: 2514
MD5sum: fd85048b2ace2345857704c1cc855378
SHA1: a9aed8288c6d63bdaf174c2a2165d30a4c1be3ee
SHA256: 6a6c2205da0bf7059febd2ae6f15fe1f505c45eea71225a3ad78893bbaf577f8
Package: linux-image-2.6.26-2-amd64
Priority: optional
Section: admin
Installed-Size: 81072
Maintainer: Debian Kernel Team <debian-kernel@lists.debian.org>
Architecture: amd64
Source: linux-2.6
Version: 2.6.26-24lenny1
Provides: linux-image, linux-image-2.6, linux-modules-2.6.26-2-amd64
Depends: module-init-tools, initramfs-tools (>= 0.55) | yaird (>= 0.0.13) | linux-initramfs-tool
Pre-Depends: debconf | debconf-2.0
Suggests: linux-doc-2.6.26, grub | lilo
Conflicts: initramfs-tools (<< 0.55), yaird (<< 0.0.13)
Filename: pool/updates/main/l/linux-2.6/linux-image-2.6.26-2-amd64_2.6.26-24lenny1_amd64.deb
Size: 20932872
MD5sum: 5d1c202e4b8c2342dcb2e22acf5da88f
SHA1: 3acbee98a713beafa460bf21e5a7128eb330a58f
SHA256: 372751c7b2936dc73c7ed4e6ef307ae06f350a5a703489db956aac414b980ec8
~# lsmod
Module Size Used by
ipv6 288456 52
nfs 252080 5
lockd 68944 1 nfs
nfs_acl 7552 1 nfs
sunrpc 197992 21 nfs,lockd,nfs_acl
loop 19468 0
snd_pcsp 14588 0
serio_raw 9988 0
snd_pcm 81800 1 snd_pcsp
psmouse 42268 0
snd_timer 25744 1 snd_pcm
snd 63688 3 snd_pcsp,snd_pcm,snd_timer
soundcore 12064 1 snd
snd_page_alloc 13072 1 snd_pcm
button 11680 0
i2c_piix4 13072 0
i2c_core 27936 1 i2c_piix4
evdev 14208 0
ext3 125072 1
jbd 51240 1 ext3
mbcache 12804 1 ext3
ide_cd_mod 36360 0
cdrom 37928 1 ide_cd_mod
ata_generic 10116 0
libata 165600 1 ata_generic
scsi_mod 161016 1 libata
dock 14112 1 libata
virtio_blk 9992 3
piix 12424 0 [permanent]
floppy 61800 0
virtio_pci 10624 0
virtio_ring 8064 1 virtio_pci
virtio 9604 2 virtio_blk,virtio_pci
ide_pci_generic 9220 0 [permanent]
ide_core 128284 3 ide_cd_mod,piix,ide_pci_generic
e1000 117312 0
uhci_hcd 25760 0
thermal 22688 0
processor 42304 1 thermal
fan 9352 0
thermal_sys 17728 3 thermal,processor,fan
== KVM host system ==
Note: The following information is *not* from the exact time the issue occurred.
~# cat /etc/network/interfaces
auto lo
iface lo inet loopback
auto bond0
iface bond0 inet manual
slaves eth0 eth1
auto bond0.30
iface bond0.30 inet manual
auto br0.30
iface br0.30 inet static
address w.x.y.z
netmask 255.255.0.0
gateway w.x.y.z
bridge_ports bond0.30
bridge_fd 9
bridge_maxage 12
bridge_hello 2
bridge_stp off
auto bond1
iface bond1 inet manual
slaves eth2 eth3
pre-up /sbin/ifconfig $IFACE mtu 9000
auto br1
iface br1 inet static
address w.x.y.z
netmask 255.255.255.0
bridge_ports bond1
bridge_fd 9
bridge_maxage 12
bridge_hello 2
bridge_stp on
Snippet network declaration srv-2.xml
<interface type='bridge'>
<source bridge='br0.30'/>
<mac address='54:00:01:01:01:02'/>
<model type='e1000' />
</interface>
<interface type='bridge'>
<source bridge='br1'/>
<mac address='54:00:01:01:02:02'/>
<model type='e1000' />
</interface>
~# dpkg -l | grep -e linux-image -e kvm -e libvirt
ii kvm 72+dfsg-5~lenny5 Full virtualization on x86 hardware
ii libvirt-bin 0.4.6-10 the programs for the libvirt library
ii libvirt0 0.4.6-10 library for interfacing with different virtu
ii linux-image-2.6-amd64 2.6.26+17+lenny1 Linux 2.6 image on AMD64
ii linux-image-2.6.26-2-amd64 2.6.26-24 Linux 2.6.26 image on AMD64
ii python-libvirt 0.4.6-10 libvirt Python bindings
Package: kvm
Priority: optional
Section: misc
Installed-Size: 3048
Maintainer: Jan Lübbe <jluebbe@debian.org>
Architecture: amd64
Version: 72+dfsg-5~lenny5
Replaces: kvm-data (<= 66+dfsg-1.1)
Depends: libasound2 (>> 1.0.16), libc6 (>= 2.7-1), libgnutls26 (>= 2.4.0-0), libncurses5 (>= 5.6+20071006-3), libsdl1.2debian (>= 1.2.10-1), zlib1g (>= 1:1.1.4), python, iproute, bridge-utils
Pre-Depends: adduser
Recommends: linux-image
Suggests: debootstrap, hal, vde2, samba, kvm-source
Conflicts: kvm-data (<= 66+dfsg-1.1), kvm-source (<= 18-1)
Filename: pool/main/k/kvm/kvm_72+dfsg-5~lenny5_amd64.deb
Size: 1110560
MD5sum: df3bcd5f384fc054863dac9947f60ddb
SHA1: 66438f1dc992bcc182ee7ce993688bfdf8e5515f
SHA256: 8f94c648f900eacfb19e1d6caf9890d234afe8ad098db31f48aa89bcea371ae1
Package: libvirt-bin
Priority: optional
Section: admin
Installed-Size: 612
Maintainer: Debian Libvirt Maintainers <pkg-libvirt-maintainers@lists.alioth.debian.org>
Architecture: amd64
Source: libvirt
Version: 0.4.6-10
Depends: libavahi-client3 (>= 0.6.16), libavahi-common3 (>= 0.6.16), libc6 (>= 2.7-1), libdbus-1-3 (>= 1.0.2), libgcrypt11 (>= 1.4.0), libgnutls26 (>= 2.4.0-0), libgpg-error0 (>= 1.4), libpolkit-dbus2
(>= 0.7), libpolkit2 (>= 0.7), libreadline5 (>= 5.2), libsasl2-2, libselinux1 (>= 2.0.59), libtasn1-3 (>= 0.3.4), libvirt0 (>= 0.4.6-10), libxenstore3.0, libxml2 (>= 2.6.27), zlib1g (>= 1:1.1.4),
adduser, logrotate
Recommends: netcat-openbsd, bridge-utils, dnsmasq, iptables, qemu (>= 0.9.1)
Suggests: policykit
Filename: pool/main/libv/libvirt/libvirt-bin_0.4.6-10_amd64.deb
Size: 223422
MD5sum: a90986ada8642737bc2bf38ec995d4ee
SHA1: f8faa3f928211843082cfbc829bc817c35588661
SHA256: a79b34f249998e546fa3f1fb826c0f5e1da70ae84100750ec45a54d599b14d56
Package: libvirt0
Priority: optional
Section: libs
Installed-Size: 744
Maintainer: Debian Libvirt Maintainers <pkg-libvirt-maintainers@lists.alioth.debian.org>
Architecture: amd64
Source: libvirt
Version: 0.4.6-10
Depends: libc6 (>= 2.7-1), libgnutls26 (>= 2.4.0-0), libsasl2-2, libselinux1 (>= 2.0.59), libxenstore3.0, libxml2 (>= 2.6.27)
Recommends: lvm2
Filename: pool/main/libv/libvirt/libvirt0_0.4.6-10_amd64.deb
Size: 351334
MD5sum: 701e42c30d91cde76668f142bbc18ba8
SHA1: d03c9453b2a610f486a796a57e6f786024f89571
SHA256: 20d1cef05a95b5a4118c918a799e87d421bb74915eba9ab8363aad5b4ec09d6c
Package: linux-image-2.6-amd64
Priority: optional
Section: admin
Installed-Size: 32
Maintainer: Debian Kernel Team <debian-kernel@lists.debian.org>
Architecture: amd64
Source: linux-latest-2.6 (17+lenny1)
Version: 2.6.26+17+lenny1
Provides: linux-latest-modules-2.6.26-2-amd64
Depends: linux-image-2.6.26-2-amd64
Filename: pool/main/l/linux-latest-2.6/linux-image-2.6-amd64_2.6.26+17+lenny1_amd64.deb
Size: 2514
MD5sum: fd85048b2ace2345857704c1cc855378
SHA1: a9aed8288c6d63bdaf174c2a2165d30a4c1be3ee
SHA256: 6a6c2205da0bf7059febd2ae6f15fe1f505c45eea71225a3ad78893bbaf577f8
Package: linux-image-2.6.26-2-amd64
Priority: optional
Section: admin
Installed-Size: 81072
Maintainer: Debian Kernel Team <debian-kernel@lists.debian.org>
Architecture: amd64
Source: linux-2.6
Version: 2.6.26-24
Provides: linux-image, linux-image-2.6, linux-modules-2.6.26-2-amd64
Depends: module-init-tools, initramfs-tools (>= 0.55) | yaird (>= 0.0.13) | linux-initramfs-tool
Pre-Depends: debconf | debconf-2.0
Suggests: linux-doc-2.6.26, grub | lilo
Conflicts: initramfs-tools (<< 0.55), yaird (<< 0.0.13)
Filename: pool/main/l/linux-2.6/linux-image-2.6.26-2-amd64_2.6.26-24_amd64.deb
Size: 20931720
MD5sum: 5052848d592d338185cdbc83b09af147
SHA1: b97d4a16193b96edb0553ff1c4f11b20fc40fa42
SHA256: d719715c155d413ba8a614f14f9606c253d4c1205c0dc974686632f242016045
Package: linux-image-2.6.26-2-amd64
Priority: optional
Section: admin
Installed-Size: 81068
Maintainer: Debian Kernel Team <debian-kernel@lists.debian.org>
Architecture: amd64
Source: linux-2.6
Version: 2.6.26-22lenny1
Provides: linux-image, linux-image-2.6, linux-modules-2.6.26-2-amd64
Depends: module-init-tools, initramfs-tools (>= 0.55) | yaird (>= 0.0.13) | linux-initramfs-tool
Pre-Depends: debconf | debconf-2.0
Suggests: linux-doc-2.6.26, grub | lilo
Conflicts: initramfs-tools (<< 0.55), yaird (<< 0.0.13)
Filename: pool/updates/main/l/linux-2.6/linux-image-2.6.26-2-amd64_2.6.26-22lenny1_amd64.deb
Size: 20931422
MD5sum: 9d71c45188552af06abd5a04d62b7c84
SHA1: 135b02b320074f45afa8d720b445b95dcc3d1c4b
SHA256: 18524c0f4cd9e4ac8d22f32312086a27ac4dbc7ea583be25a17a1a95cb5ce4d2
~# lspci
00:00.0 Host bridge: Intel Corporation 5100 Chipset Memory Controller Hub (rev 90)
00:02.0 PCI bridge: Intel Corporation 5100 Chipset PCI Express x8 Port 2-3 (rev 90)
00:04.0 PCI bridge: Intel Corporation 5100 Chipset PCI Express x16 Port 4-7 (rev 90)
00:08.0 System peripheral: Intel Corporation 5100 Chipset DMA Engine (rev 90)
00:10.0 Host bridge: Intel Corporation 5100 Chipset FSB Registers (rev 90)
00:10.1 Host bridge: Intel Corporation 5100 Chipset FSB Registers (rev 90)
00:10.2 Host bridge: Intel Corporation 5100 Chipset FSB Registers (rev 90)
00:11.0 Host bridge: Intel Corporation 5100 Chipset Reserved Registers (rev 90)
00:13.0 Host bridge: Intel Corporation 5100 Chipset Reserved Registers (rev 90)
00:15.0 Host bridge: Intel Corporation 5100 Chipset DDR Channel 0 Registers (rev 90)
00:16.0 Host bridge: Intel Corporation 5100 Chipset DDR Channel 1 Registers (rev 90)
00:1a.0 USB Controller: Intel Corporation 82801I (ICH9 Family) USB UHCI Controller #4 (rev 02)
00:1a.7 USB Controller: Intel Corporation 82801I (ICH9 Family) USB2 EHCI Controller #2 (rev 02)
00:1c.0 PCI bridge: Intel Corporation 82801I (ICH9 Family) PCI Express Port 1 (rev 02)
00:1c.4 PCI bridge: Intel Corporation 82801I (ICH9 Family) PCI Express Port 5 (rev 02)
00:1c.5 PCI bridge: Intel Corporation 82801I (ICH9 Family) PCI Express Port 6 (rev 02)
00:1d.0 USB Controller: Intel Corporation 82801I (ICH9 Family) USB UHCI Controller #1 (rev 02)
00:1d.1 USB Controller: Intel Corporation 82801I (ICH9 Family) USB UHCI Controller #2 (rev 02)
00:1d.2 USB Controller: Intel Corporation 82801I (ICH9 Family) USB UHCI Controller #3 (rev 02)
00:1d.7 USB Controller: Intel Corporation 82801I (ICH9 Family) USB2 EHCI Controller #1 (rev 02)
00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev 92)
00:1f.0 ISA bridge: Intel Corporation 82801IR (ICH9R) LPC Interface Controller (rev 02)
00:1f.2 IDE interface: Intel Corporation 82801IR/IO/IH (ICH9R/DO/DH) 4 port SATA IDE Controller (rev 02)
00:1f.3 SMBus: Intel Corporation 82801I (ICH9 Family) SMBus Controller (rev 02)
00:1f.5 IDE interface: Intel Corporation 82801I (ICH9 Family) 2 port SATA IDE Controller (rev 02)
02:00.0 PCI bridge: Integrated Device Technology, Inc. PES12N3A PCI Express Switch (rev 0e)
03:02.0 PCI bridge: Integrated Device Technology, Inc. PES12N3A PCI Express Switch (rev 0e)
03:04.0 PCI bridge: Integrated Device Technology, Inc. PES12N3A PCI Express Switch (rev 0e)
04:00.0 Ethernet controller: Intel Corporation 82571EB Gigabit Ethernet Controller (Copper) (rev 06)
04:00.1 Ethernet controller: Intel Corporation 82571EB Gigabit Ethernet Controller (Copper) (rev 06)
05:00.0 Ethernet controller: Intel Corporation 82571EB Gigabit Ethernet Controller (Copper) (rev 06)
05:00.1 Ethernet controller: Intel Corporation 82571EB Gigabit Ethernet Controller (Copper) (rev 06)
07:00.0 Ethernet controller: Intel Corporation 82573E Gigabit Ethernet Controller (Copper) (rev 03)
08:00.0 Ethernet controller: Intel Corporation 82573L Gigabit Ethernet Controller
09:01.0 VGA compatible controller: ATI Technologies Inc ES1000 (rev 02)
~# lsmod
Module Size Used by
tun 14084 4
kvm_intel 39776 2
kvm 129640 1 kvm_intel
ipv6 288456 46
nfs 252080 35
lockd 68944 1 nfs
nfs_acl 7552 1 nfs
sunrpc 197992 79 nfs,lockd,nfs_acl
bridge 53544 0
8021q 23456 0
bonding 83808 0
ext3 125072 1
jbd 51240 1 ext3
mbcache 12804 1 ext3
loop 19468 0
snd_pcm 81800 0
psmouse 42268 0
i2c_i801 13596 0
snd_timer 25744 1 snd_pcm
pcspkr 7040 0
snd 63688 2 snd_pcm,snd_timer
soundcore 12064 1 snd
serio_raw 9988 0
snd_page_alloc 13072 1 snd_pcm
i2c_core 27936 1 i2c_i801
container 8320 0
button 11680 0
joydev 14848 0
evdev 14208 3
sg 36448 0
sr_mod 19652 0
cdrom 37928 1 sr_mod
xfs 475560 1
dm_mirror 20608 0
dm_log 13956 1 dm_mirror
dm_snapshot 19400 0
dm_mod 58864 3 dm_mirror,dm_log,dm_snapshot
raid1 24192 1
md_mod 80292 2 raid1
sd_mod 29376 6
usbhid 45792 0
hid 41792 1 usbhid
ff_memless 9224 1 usbhid
ata_piix 22916 4
usb_storage 95936 0
ata_generic 10116 0
libata 165600 2 ata_piix,ata_generic
scsi_mod 161016 5 sg,sr_mod,sd_mod,usb_storage,libata
dock 14112 1 libata
ide_pci_generic 9220 0 [permanent]
ide_core 128284 1 ide_pci_generic
uhci_hcd 25760 0
ehci_hcd 36108 0
e1000e 105000 0
thermal 22688 0
processor 42304 1 thermal
fan 9352 0
thermal_sys 17728 3 thermal,processor,fan
Reply to: