Bug#399981: Oops related to link failure in Xen kernel
Package: linux-image-2.6.18-2-xen-686
Version: 2.6.18-5
While using the above mentioned kernel, I get an oops when the link on eth1 fails:
BUG: unable to handle kernel NULL pointer dereference at virtual address 00000000
printing eip:
c02855ba
*pde = ma 00000000 pa fffff000
Oops: 0002 [#1]
SMP
Modules linked in: ip_vs_wrr ip_vs xt_physdev netconsole iptable_filter ip_tables x_tables bridge netloop drbd button ac battery loop shpchp pci_hotplug pcspkr serial_core serio_raw psmouse evdev tsdev ext3 jbd mbcache dm_mirror dm_snapshot dm_mod ide_cd cdrom generic usbhid cciss piix scsi_mod uhci_hcd ide_core bnx2 usbcore thermal processor fan
CPU: 0
EIP: 0061:[<c02855ba>] Not tainted VLI
EFLAGS: 00010286 (2.6.18-2-xen-686 #1)
EIP is at iret_exc+0x883/0xbe6
eax: 00000000 ebx: 00000000 ecx: 00000007 edx: c0ca0000
esi: c0ca0018 edi: c06d1890 ebp: 0000004c esp: c0315d0c
ds: 007b es: 007b ss: 0069
Process swapper (pid: 0, ti=c0314000 task=c02c9660 task.ti=c0314000)
Stack: 0000004c 000001d8 c0ca0000 c0227f6d c0ca0000 c06d1878 000001d8 00000000
00000000 00000000 00000018 c06d1878 c71038ac 00000001 0000004c 000005dc
c52fd53c 0000025f c02079fc 000001d8 c0315e38 00000224 c76fee80 0000022c
Call Trace:
[<c0227f6d>] skb_copy_and_csum_bits+0x129/0x2a9
[<c02079fc>] __alloc_skb+0x6c/0x70
[<c02647a9>] icmp_glue_bits+0x1f/0x74
[<c02496f8>] ip_append_data+0x5d1/0x942
[<c026478a>] icmp_glue_bits+0x0/0x74
[<c026467d>] icmp_push_reply+0x3d/0x14a
[<c0243d86>] ip_route_output_flow+0x13/0x57
[<c0264f6d>] icmp_send+0x2e7/0x350
[<c012b60c>] run_posix_cpu_timers+0x1c/0x6bf
[<c011495e>] rebalance_tick+0x116/0x2ae
[<c0241b36>] ipv4_link_failure+0x14/0x3c
[<c0262f1c>] arp_error_report+0x1c/0x24
[<c0232c0d>] neigh_timer_handler+0x18e/0x24d
[<c0232a7f>] neigh_timer_handler+0x0/0x24d
[<c0121c28>] run_timer_softirq+0x101/0x15c
[<c011de82>] __do_softirq+0x5e/0xc3
[<c011df21>] do_softirq+0x3a/0x4a
[<c01060c9>] do_IRQ+0x48/0x53
[<c0206518>] evtchn_do_upcall+0x64/0x9b
[<c01049d9>] hypervisor_callback+0x3d/0x48
[<c01072c6>] raw_safe_halt+0x8c/0xaf
[<c0102c63>] xen_idle+0x22/0x2e
[<c0102d82>] cpu_idle+0x91/0xab
[<c03196fe>] start_kernel+0x37a/0x381
Code: ff ff ff e9 a8 4f ef ff b8 f2 ff ff ff e9 c7 4f ef ff b8 f2 ff ff ff e9 e7 4f ef ff 8b 3d 20 0b 36 c0 e9 ef 93 ef ff 8b 5c 24 20 <c7> 03 f2 ff ff ff 8b 7c 24 14 8b 4c 24 18 31 c0 f3 aa e9 4b 0d
EIP: [<c02855ba>] iret_exc+0x883/0xbe6 SS:ESP 0069:c0315d0c
<0>Kernel panic - not syncing: Fatal exception in interrupt
The eth1 interface is used for drbd replication traffic and heartbeat monitoring. The network card is linked to another machine with the same kernel and the same configuration using a cross-link cable. So when one of the machine reboots, the other machine crashes with this oops. The network card is a Broadcom NetXtreme II BCM5708 1000Base-T (B1) PCI-X 64-bit 133MHz. The machine is running debian unstable.
lspci -vn output:
00:00.0 0600: 8086:25d8 (rev 93)
Subsystem: 103c:31fd
Flags: bus master, fast devsel, latency 0
Capabilities: [50] Power Management version 2
Capabilities: [58] Message Signalled Interrupts: Mask- 64bit- Queue=0/1 Enable-
Capabilities: [6c] Express Root Port (Slot-) IRQ 0
00:02.0 0604: 8086:25e2 (rev 93) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=00, secondary=09, subordinate=12, sec-latency=0
Memory behind bridge: fdf00000-fdffffff
Capabilities: [50] Power Management version 2
Capabilities: [58] Message Signalled Interrupts: Mask- 64bit- Queue=0/1 Enable-
Capabilities: [6c] Express Root Port (Slot-) IRQ 0
00:03.0 0604: 8086:25e3 (rev 93) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=00, secondary=06, subordinate=08, sec-latency=0
I/O behind bridge: 00004000-00004fff
Memory behind bridge: fdd00000-fdefffff
Prefetchable memory behind bridge: 0000000088000000-00000000880fffff
Capabilities: [50] Power Management version 2
Capabilities: [58] Message Signalled Interrupts: Mask- 64bit- Queue=0/1 Enable-
Capabilities: [6c] Express Root Port (Slot-) IRQ 0
00:04.0 0604: 8086:25f8 (rev 93) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=00, secondary=13, subordinate=15, sec-latency=0
Capabilities: [50] Power Management version 2
Capabilities: [58] Message Signalled Interrupts: Mask- 64bit- Queue=0/1 Enable-
Capabilities: [6c] Express Root Port (Slot-) IRQ 0
00:05.0 0604: 8086:25e5 (rev 93) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=00, secondary=16, subordinate=16, sec-latency=0
Capabilities: [50] Power Management version 2
Capabilities: [58] Message Signalled Interrupts: Mask- 64bit- Queue=0/1 Enable-
Capabilities: [6c] Express Root Port (Slot-) IRQ 0
00:06.0 0604: 8086:25e6 (rev 93) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=00, secondary=02, subordinate=03, sec-latency=0
Memory behind bridge: f8000000-f9ffffff
Prefetchable memory behind bridge: 0000000088100000-00000000881fffff
Capabilities: [50] Power Management version 2
Capabilities: [58] Message Signalled Interrupts: Mask- 64bit- Queue=0/1 Enable-
Capabilities: [6c] Express Root Port (Slot-) IRQ 0
00:07.0 0604: 8086:25e7 (rev 93) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=00, secondary=04, subordinate=05, sec-latency=0
Memory behind bridge: fa000000-fbffffff
Prefetchable memory behind bridge: 0000000088200000-00000000882fffff
Capabilities: [50] Power Management version 2
Capabilities: [58] Message Signalled Interrupts: Mask- 64bit- Queue=0/1 Enable-
Capabilities: [6c] Express Root Port (Slot-) IRQ 0
00:10.0 0600: 8086:25f0 (rev 93)
Subsystem: 103c:31fd
Flags: fast devsel
00:10.1 0600: 8086:25f0 (rev 93)
Subsystem: 103c:31fd
Flags: fast devsel
00:10.2 0600: 8086:25f0 (rev 93)
Subsystem: 103c:31fd
Flags: fast devsel
00:11.0 0600: 8086:25f1 (rev 93)
Subsystem: 103c:31fd
Flags: fast devsel
00:13.0 0600: 8086:25f3 (rev 93)
Subsystem: 103c:31fd
Flags: fast devsel
00:15.0 0600: 8086:25f5 (rev 93)
Subsystem: 103c:31fd
Flags: fast devsel
00:16.0 0600: 8086:25f6 (rev 93)
Subsystem: 103c:31fd
Flags: fast devsel
00:1e.0 0604: 8086:244e (rev d9) (prog-if 01 [Subtractive decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=00, secondary=01, subordinate=01, sec-latency=32
I/O behind bridge: 00002000-00003fff
Memory behind bridge: f7e00000-f7ffffff
Prefetchable memory behind bridge: 00000000d8000000-00000000dfffffff
Capabilities: [50] Subsystem: 0000:0000
00:1f.0 0601: 8086:2670 (rev 09)
Flags: bus master, medium devsel, latency 0
00:1f.1 0101: 8086:269e (rev 09) (prog-if 8a [Master SecP PriP])
Subsystem: 103c:31fe
Flags: bus master, medium devsel, latency 0, IRQ 17
I/O ports at <ignored>
I/O ports at <ignored>
I/O ports at <ignored>
I/O ports at <ignored>
I/O ports at 0500 [size=16]
01:03.0 0300: 1002:515e (rev 02) (prog-if 00 [VGA])
Subsystem: 103c:31fb
Flags: bus master, stepping, medium devsel, latency 64, IRQ 7
Memory at d8000000 (32-bit, prefetchable) [size=128M]
I/O ports at 3000 [size=256]
Memory at f7ff0000 (32-bit, non-prefetchable) [size=64K]
[virtual] Expansion ROM at f7e00000 [disabled] [size=128K]
Capabilities: [50] Power Management version 2
01:04.0 0880: 0e11:b203 (rev 03)
Subsystem: 103c:3305
Flags: medium devsel, IRQ 5
I/O ports at 2800 [size=256]
Memory at f7fe0000 (32-bit, non-prefetchable) [size=512]
Capabilities: [f0] Power Management version 3
01:04.2 0880: 0e11:b204 (rev 03)
Subsystem: 103c:3305
Flags: bus master, medium devsel, latency 64, IRQ 10
I/O ports at 3400 [size=256]
Memory at f7fd0000 (32-bit, non-prefetchable) [size=2K]
Memory at f7fc0000 (32-bit, non-prefetchable) [size=8K]
Memory at f7f00000 (32-bit, non-prefetchable) [size=512K]
[virtual] Expansion ROM at f7e20000 [disabled] [size=64K]
Capabilities: [f0] Power Management version 3
01:04.4 0c03: 103c:3300 (prog-if 00 [UHCI])
Subsystem: 103c:3305
Flags: bus master, medium devsel, latency 64, IRQ 19
I/O ports at 3800 [size=32]
Capabilities: [f0] Power Management version 3
01:04.6 0c07: 103c:3302 (prog-if 01)
Subsystem: 103c:3305
Flags: medium devsel, IRQ 5
Memory at f7ef0000 (32-bit, non-prefetchable) [size=256]
Capabilities: [f0] Power Management version 3
02:00.0 0604: 1166:0103 (rev c2) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=02, secondary=03, subordinate=03, sec-latency=64
Memory behind bridge: f8000000-f9ffffff
Prefetchable memory behind bridge: 0000000088100000-00000000881fffff
Capabilities: [60] Express PCI/PCI-X Bridge IRQ 0
Capabilities: [90] PCI-X bridge device
Capabilities: [b0] Power Management version 2
03:00.0 0200: 14e4:164c (rev 11)
Subsystem: 103c:7038
Flags: bus master, 66MHz, medium devsel, latency 64, IRQ 16
Memory at f8000000 (64-bit, non-prefetchable) [size=32M]
[virtual] Expansion ROM at 88100000 [disabled] [size=2K]
Capabilities: [40] PCI-X non-bridge device
Capabilities: [48] Power Management version 2
Capabilities: [50] Vital Product Data
Capabilities: [58] Message Signalled Interrupts: Mask- 64bit+ Queue=0/0 Enable-
04:00.0 0604: 1166:0103 (rev c2) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=04, secondary=05, subordinate=05, sec-latency=64
Memory behind bridge: fa000000-fbffffff
Prefetchable memory behind bridge: 0000000088200000-00000000882fffff
Capabilities: [60] Express PCI/PCI-X Bridge IRQ 0
Capabilities: [90] PCI-X bridge device
Capabilities: [b0] Power Management version 2
05:00.0 0200: 14e4:164c (rev 11)
Subsystem: 103c:7038
Flags: bus master, 66MHz, medium devsel, latency 64, IRQ 16
Memory at fa000000 (64-bit, non-prefetchable) [size=32M]
[virtual] Expansion ROM at 88200000 [disabled] [size=2K]
Capabilities: [40] PCI-X non-bridge device
Capabilities: [48] Power Management version 2
Capabilities: [50] Vital Product Data
Capabilities: [58] Message Signalled Interrupts: Mask- 64bit+ Queue=0/0 Enable-
06:00.0 0104: 103c:3230 (rev 01)
Subsystem: 103c:3235
Flags: bus master, fast devsel, latency 0, IRQ 16
Memory at fde00000 (64-bit, non-prefetchable) [size=1M]
I/O ports at 4000 [size=256]
Memory at fddf0000 (64-bit, non-prefetchable) [size=4K]
[virtual] Expansion ROM at 88000000 [disabled] [size=256K]
Capabilities: [b0] Express Endpoint IRQ 0
Capabilities: [d4] MSI-X: Enable- Mask- TabSize=4
Capabilities: [e0] Power Management version 2
Capabilities: [ec] Vital Product Data
09:00.0 0604: 8086:3500 (rev 01) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=09, secondary=0a, subordinate=0f, sec-latency=0
Capabilities: [44] Express Upstream Port IRQ 0
Capabilities: [70] Power Management version 2
Capabilities: [80] Subsystem: 0000:0000
09:00.3 0604: 8086:350c (rev 01) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=09, secondary=10, subordinate=12, sec-latency=64
Capabilities: [44] Express PCI/PCI-X Bridge IRQ 0
Capabilities: [6c] Power Management version 2
Capabilities: [80] Subsystem: 0000:0000
Capabilities: [d8] PCI-X bridge device
0a:00.0 0604: 8086:3510 (rev 01) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=0a, secondary=0b, subordinate=0d, sec-latency=0
Capabilities: [44] Express Downstream Port (Slot-) IRQ 0
Capabilities: [60] Message Signalled Interrupts: Mask- 64bit+ Queue=0/0 Enable-
Capabilities: [70] Power Management version 2
Capabilities: [80] Subsystem: 0000:0000
0a:01.0 0604: 8086:3514 (rev 01) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=0a, secondary=0e, subordinate=0e, sec-latency=0
Capabilities: [44] Express Downstream Port (Slot-) IRQ 0
Capabilities: [60] Message Signalled Interrupts: Mask- 64bit+ Queue=0/0 Enable-
Capabilities: [70] Power Management version 2
Capabilities: [80] Subsystem: 0000:0000
0a:02.0 0604: 8086:3518 (rev 01) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=0a, secondary=0f, subordinate=0f, sec-latency=0
Capabilities: [44] Express Downstream Port (Slot-) IRQ 0
Capabilities: [60] Message Signalled Interrupts: Mask- 64bit+ Queue=0/0 Enable-
Capabilities: [70] Power Management version 2
Capabilities: [80] Subsystem: 0000:0000
If more information is needed, please e-mail me.
Reply to: