Bug#526983: r8169
Package: linux-image-2.6.26-2-amd64
Version: 2.6.26-19lenny2
Severity: important
I can confirm this problem with latest debian lenny packages.
Error when network load is high:
Jan 12 14:16:17 wtf kernel: [1967737.278889] NETDEV WATCHDOG: eth0: transmit timed out
Jan 12 14:16:17 wtf kernel: [1967737.278929] ------------[ cut here ]------------
Jan 12 14:16:17 wtf kernel: [1967737.278958] WARNING: at net/sched/sch_generic.c:222 dev_watchdog+0xa6/0xfb()
Jan 12 14:16:17 wtf kernel: [1967737.279018] Modules linked in: kvm_intel kvm tun sha256_generic aes_x86_64 aes_generic cbc dm_crypt crypto_blkcipher iptable_nat nf_nat xt_multiport xt_limit xt_tcpudp nf_conntrack_ipv4 xt_state nf_conntrack ipt_REJECT iptable_filter ip_tables x_tables bridge ext2 f71882fg ext3 jbd mbcache dm_mirror dm_log dm_snapshot dm_mod raid1 md_mod sd_mod ahci r8169 libata scsi_mod dock processor thermal_sys [last unloaded: kvm]
Jan 12 14:16:17 wtf kernel: [1967737.279304] Pid: 0, comm: swapper Not tainted 2.6.26-2-amd64 #1
Jan 12 14:16:17 wtf kernel: [1967737.279333]
Jan 12 14:16:17 wtf kernel: [1967737.279333] Call Trace:
Jan 12 14:16:17 wtf kernel: [1967737.279375] <IRQ> [<ffffffff80234a0c>] warn_on_slowpath+0x51/0x7a
Jan 12 14:16:17 wtf kernel: [1967737.279412] [<ffffffff803cc816>] dev_watchdog+0x0/0xfb
Jan 12 14:16:17 wtf kernel: [1967737.279441] [<ffffffff80235461>] printk+0x4e/0x56
Jan 12 14:16:17 wtf kernel: [1967737.279470] [<ffffffff8023cf75>] lock_timer_base+0x26/0x4b
Jan 12 14:16:17 wtf kernel: [1967737.279500] [<ffffffff8023d104>] __mod_timer+0xbd/0xcc
Jan 12 14:16:17 wtf kernel: [1967737.279530] [<ffffffff802438a3>] queue_delayed_work_on+0xb8/0xc8
Jan 12 14:16:17 wtf kernel: [1967737.279561] [<ffffffff803cc816>] dev_watchdog+0x0/0xfb
Jan 12 14:16:17 wtf kernel: [1967737.279589] [<ffffffff803cc8bc>] dev_watchdog+0xa6/0xfb
Jan 12 14:16:17 wtf kernel: [1967737.279617] [<ffffffff803cc816>] dev_watchdog+0x0/0xfb
Jan 12 14:16:17 wtf kernel: [1967737.279646] [<ffffffff8023ca35>] run_timer_softirq+0x16a/0x1e2
Jan 12 14:16:17 wtf kernel: [1967737.279677] [<ffffffff80239403>] __do_softirq+0x5c/0xd1
Jan 12 14:16:17 wtf kernel: [1967737.279707] [<ffffffff8020d2cc>] call_softirq+0x1c/0x28
Jan 12 14:16:17 wtf kernel: [1967737.279736] [<ffffffff8020f3d8>] do_softirq+0x3c/0x81
Jan 12 14:16:17 wtf kernel: [1967737.279764] [<ffffffff80239363>] irq_exit+0x3f/0x83
Jan 12 14:16:17 wtf kernel: [1967737.279792] [<ffffffff8021aa7b>] smp_apic_timer_interrupt+0x8c/0xa4
Jan 12 14:16:17 wtf kernel: [1967737.279823] [<ffffffff8020ccf2>] apic_timer_interrupt+0x72/0x80
Jan 12 14:16:17 wtf kernel: [1967737.279852] <EOI> [<ffffffffa000826d>] :processor:acpi_idle_enter_bm+0x2b3/0x327
Jan 12 14:16:17 wtf kernel: [1967737.279909] [<ffffffff803aa728>] cpuidle_idle_call+0x7a/0xb2
Jan 12 14:16:17 wtf kernel: [1967737.279938] [<ffffffff803aa6ae>] cpuidle_idle_call+0x0/0xb2
Jan 12 14:16:17 wtf kernel: [1967737.279967] [<ffffffff8020ac79>] cpu_idle+0x89/0xb3
Jan 12 14:16:17 wtf kernel: [1967737.279996]
Jan 12 14:16:17 wtf kernel: [1967737.280016] ---[ end trace db0b2e9f487d3b4d ]---
Jan 12 14:16:17 wtf kernel: [1967737.299403] r8169: eth0: link up
Seems like the interface went down and came up right away - i didn't even noticed
this problem until i checked dmesg.
Maybe the counter is wrong or there are really this many packets dropped:
% ifconfig
eth0 Link encap:Ethernet HWaddr 00:24:21:XX:XX:XX
inet addr:XXX.XXX.XXX.XXX Bcast:XXX.XXX.XXX.255 Mask:255.255.255.255
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:96607465 errors:0 dropped:34911509435217 overruns:0 frame:0
TX packets:116667448 errors:0 dropped:46 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:86936665600 (80.9 GiB) TX bytes:112516773583 (104.7 GiB)
Interrupt:250 Base address:0x6000
Hardware:
% lspci -nn
00:00.0 Host bridge [0600]: Intel Corporation X58 I/O Hub to ESI Port [8086:3405] (rev 13)
00:01.0 PCI bridge [0604]: Intel Corporation 5520/5500/X58 I/O Hub PCI Express Root Port 1 [8086:3408] (rev 13)
00:03.0 PCI bridge [0604]: Intel Corporation 5520/5500/X58 I/O Hub PCI Express Root Port 3 [8086:340a] (rev 13)
00:07.0 PCI bridge [0604]: Intel Corporation 5520/5500/X58 I/O Hub PCI Express Root Port 7 [8086:340e] (rev 13)
00:14.0 PIC [0800]: Intel Corporation 5520/5500/X58 I/O Hub System Management Registers [8086:342e] (rev 13)
00:14.1 PIC [0800]: Intel Corporation 5520/5500/X58 I/O Hub GPIO and Scratch Pad Registers [8086:3422] (rev 13)
00:14.2 PIC [0800]: Intel Corporation 5520/5500/X58 I/O Hub Control Status and RAS Registers [8086:3423] (rev 13)
00:14.3 PIC [0800]: Intel Corporation 5520/5500/X58 I/O Hub Throttle Registers [8086:3438] (rev 13)
00:1a.0 USB Controller [0c03]: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #4 [8086:3a37]
00:1a.1 USB Controller [0c03]: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #5 [8086:3a38]
00:1a.2 USB Controller [0c03]: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #6 [8086:3a39]
00:1a.7 USB Controller [0c03]: Intel Corporation 82801JI (ICH10 Family) USB2 EHCI Controller #2 [8086:3a3c]
00:1c.0 PCI bridge [0604]: Intel Corporation 82801JI (ICH10 Family) PCI Express Port 1 [8086:3a40]
00:1c.4 PCI bridge [0604]: Intel Corporation 82801JI (ICH10 Family) PCI Express Port 5 [8086:3a48]
00:1d.0 USB Controller [0c03]: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #1 [8086:3a34]
00:1d.1 USB Controller [0c03]: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #2 [8086:3a35]
00:1d.2 USB Controller [0c03]: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #3 [8086:3a36]
00:1d.7 USB Controller [0c03]: Intel Corporation 82801JI (ICH10 Family) USB2 EHCI Controller #1 [8086:3a3a]
00:1e.0 PCI bridge [0604]: Intel Corporation 82801 PCI Bridge [8086:244e] (rev 90)
00:1f.0 ISA bridge [0601]: Intel Corporation 82801JIR (ICH10R) LPC Interface Controller [8086:3a16]
00:1f.2 SATA controller [0106]: Intel Corporation 82801JI (ICH10 Family) SATA AHCI Controller [8086:3a22]
00:1f.3 SMBus [0c05]: Intel Corporation 82801JI (ICH10 Family) SMBus Controller [8086:3a30]
02:00.0 VGA compatible controller [0300]: nVidia Corporation G98 [GeForce 8400 GS] [10de:06e4] (rev a1)
06:00.0 Ethernet controller [0200]: Realtek Semiconductor Co., Ltd. RTL8111/8168B PCI Express Gigabit Ethernet controller [10ec:8168] (rev 02)
% cat /proc/interrupts
CPU0 CPU1 CPU2 CPU3 CPU4 CPU5 CPU6 CPU7
0: 36 0 0 186192002 0 0 0 0 IO-APIC-edge timer
1: 0 0 0 160 0 0 0 0 IO-APIC-edge i8042
8: 0 0 0 1 0 0 0 0 IO-APIC-edge rtc0
9: 0 0 0 0 0 0 0 0 IO-APIC-fasteoi acpi
1273: 0 39977837 0 0 0 0 0 0 PCI-MSI-edge ahci
1274: 139715346 0 0 0 0 0 0 0 PCI-MSI-edge eth0
NMI: 0 0 0 0 0 0 0 0 Non-maskable interrupts
LOC: 48293328 16073328 15892105 621752 36182069 13277026 14285508 16625434 Local timer interrupts
RES: 13870686 33601781 7996828 7741088 52588568 28611068 6949762 6348231 Rescheduling interrupts
CAL: 320134 195084 830927 762879 8264337 528551 859674 589289 function call interrupts
TLB: 872 1400 1819 1601 15467 6167 8577 8294 TLB shootdowns
TRM: 0 0 0 0 0 0 0 0 Thermal event interrupts
THR: 0 0 0 0 0 0 0 0 Threshold APIC interrupts
SPU: 0 0 0 0 0 0 0 0 Spurious interrupts
ERR: 0
% lsmod
Module Size Used by
kvm_intel 39776 5
kvm 127592 1 kvm_intel
tun 14084 5
sha256_generic 13696 0
aes_x86_64 12416 2
aes_generic 32552 1 aes_x86_64
cbc 7936 1
dm_crypt 17032 1
crypto_blkcipher 21636 3 cbc,dm_crypt
iptable_nat 9872 1
nf_nat 23192 1 iptable_nat
xt_multiport 7424 2
xt_limit 7172 1
xt_tcpudp 7680 1
nf_conntrack_ipv4 19352 8 iptable_nat,nf_nat
xt_state 6656 5
nf_conntrack 71440 4 iptable_nat,nf_nat,nf_conntrack_ipv4,xt_state
ipt_REJECT 7552 2
iptable_filter 7424 1
ip_tables 21520 2 iptable_nat,iptable_filter
x_tables 25224 7 iptable_nat,xt_multiport,xt_limit,xt_tcpudp,xt_state,ipt_REJECT,ip_tables
bridge 53544 0
ext2 66576 1
f71882fg 15244 0
ext3 125072 2
jbd 51240 1 ext3
mbcache 12804 2 ext2,ext3
dm_mirror 20608 0
dm_log 13956 1 dm_mirror
dm_snapshot 19400 0
dm_mod 58864 22 dm_crypt,dm_mirror,dm_log,dm_snapshot
raid1 24192 3
md_mod 80292 4 raid1
sd_mod 29376 8
ahci 33036 6
r8169 31364 0
libata 165600 1 ahci
scsi_mod 161016 2 sd_mod,libata
dock 14112 1 libata
processor 42304 8
thermal_sys 17728 1 processor
% cat /proc/version
Linux version 2.6.26-2-amd64 (Debian 2.6.26-19lenny2) (dannf@debian.org) (gcc version 4.1.3 20080704 (prerelease) (Debian 4.1.2-25)) #1 SMP Thu Nov 5 02:23:12 UTC 2009
Marcel.
Reply to: