On Thu, 2012-08-16 at 18:17 +0200, Carsten Wolff wrote:
> Source: linux-2.6
> Version: 2.6.32-45
>
> Hi,
>
> we hit the above kernel panic twice in two days. There is a bugfix in upstream
> stable, but it did not make it to 2.6.32, just later kernels:
>
> http://git.kernel.org/?p=linux/kernel/git/davem/net-
> next.git;a=commit;h=8f49c2703b33519aaaccc63f571b465b9d2b3a2d
David, is there any reason why this shouldn't be backported to 2.6.32,
or might need adjustment? It originally went into 2.6.37 and was then
backported to 2.6.{34,35,36}.
Ben.
> For completeness follows the trace.
>
> Thanks,
> Carsten
>
> Aug 15 20:38:33 lb01 kernel: [71032.540454] ------------[ cut here
> ]------------
> Aug 15 20:38:33 lb01 kernel: [71032.544153] kernel BUG at /build/buildd-
> linux-2.6_2.6.32-45-i386-
> yQfQSv/linux-2.6-2.6.32/debian/build/source_i386_none/net/ipv4/tcp_ipv4.c:415!
> Aug 15 20:38:33 lb01 kernel: [71032.544153] invalid opcode: 0000 [#1] SMP
> Aug 15 20:38:33 lb01 kernel: [71032.544153] last sysfs file:
> /sys/devices/virtual/block/dm-3/dm/name
> Aug 15 20:38:33 lb01 kernel: [71032.544153] Modules linked in: ip_vs_rr
> ip_vs_wlc ip_vs 8021q garp stp bonding xt_MARK iptable_mangle ipt_ULOG
> xt_tcpudp nf_conntrack_ipv4 nf_defrag_ipv4 xt_state nf_conntrack xt_multiport
> iptable_filter ip_tables x_tables loop snd_pcm snd_timer snd radeon soundcore
> ttm drm_kms_helper snd_page_alloc ibmpex drm ibmaem i2c_i801 i5000_edac
> ioatdma i2c_algo_bit ipmi_msghandler psmouse evdev shpchp pcspkr ics932s401
> edac_core dca joydev pci_hotplug serio_raw i5k_amb i2c_core rng_core processor
> button ext3 jbd mbcache dm_mod sg usbhid ses hid sr_mod cdrom sd_mod
> crc_t10dif enclosure ata_generic uhci_hcd ehci_hcd ata_piix aacraid bnx2
> usbcore libata nls_base scsi_mod e1000e thermal thermal_sys [last unloaded:
> scsi_wait_scan]
> Aug 15 20:38:33 lb01 kernel: [71032.544153]
> Aug 15 20:38:33 lb01 kernel: [71032.544153] Pid: 10, comm: ksoftirqd/2 Not
> tainted (2.6.32-5-686 #1) IBM System x3650 -[7979BCG]-
> Aug 15 20:38:33 lb01 kernel: [71032.544153] EIP: 0060:[<c121074f>] EFLAGS:
> 00010246 CPU: 2
> Aug 15 20:38:33 lb01 kernel: [71032.544153] EIP is at tcp_v4_err+0x2b5/0x43e
> Aug 15 20:38:33 lb01 kernel: [71032.544153] EAX: f2286440 EBX: 00000071 ECX:
> f2286440 EDX: 00000000
> Aug 15 20:38:33 lb01 kernel: [71032.544153] ESI: a6235fce EDI: f22863c0 EBP:
> 00000001 ESP: f6c61e80
> Aug 15 20:38:33 lb01 kernel: [71032.544153] DS: 007b ES: 007b FS: 00d8 GS:
> 00e0 SS: 0068
> Aug 15 20:38:33 lb01 kernel: [71032.544153] Process ksoftirqd/2 (pid: 10,
> ti=f6c60000 task=f6c32a80 task.ti=f6c60000)
> Aug 15 20:38:33 lb01 kernel: [71032.544153] Stack:
> Aug 15 20:38:33 lb01 kernel: [71032.544153] 00000000 010330dc f7805e5d
> f543ec2c f543ec40 c14c9b10 00000000 00000006
> Aug 15 20:38:33 lb01 kernel: [71032.544153] <0> 00000000 f5e55180 f543ec24
> c1217c27 c14c9b10 f5e55180 00000002 00000000
> Aug 15 20:38:33 lb01 kernel: [71032.544153] <0> c14c9b10 c1217dde f2127e00
> f5e55180 00000001 c1299648 c14c9b10 c11f8142
> Aug 15 20:38:33 lb01 kernel: [71032.544153] Call Trace:
> Aug 15 20:38:33 lb01 kernel: [71032.544153] [<c1217c27>] ?
> icmp_unreach+0x189/0x1ab
> Aug 15 20:38:33 lb01 kernel: [71032.544153] [<c1217dde>] ?
> icmp_rcv+0x195/0x1bd
> Aug 15 20:38:33 lb01 kernel: [71032.544153] [<c11f8142>] ?
> ip_local_deliver_finish+0x10c/0x18c
> Aug 15 20:38:33 lb01 kernel: [71032.544153] [<c11f7d68>] ?
> ip_rcv_finish+0x2c4/0x2d8
> Aug 15 20:38:33 lb01 kernel: [71032.544153] [<c11d9ca8>] ?
> netif_receive_skb+0x3bb/0x3d6
> Aug 15 20:38:33 lb01 kernel: [71032.544153] [<c11d9d2c>] ?
> process_backlog+0x69/0x93
> Aug 15 20:38:33 lb01 kernel: [71032.544153] [<c11da231>] ?
> net_rx_action+0x96/0x194
> Aug 15 20:38:33 lb01 kernel: [71032.544153] [<c1035a96>] ?
> __do_softirq+0xaa/0x156
> Aug 15 20:38:33 lb01 kernel: [71032.544153] [<c1035b73>] ?
> do_softirq+0x31/0x3c
> Aug 15 20:38:33 lb01 kernel: [71032.544153] [<c1035bc7>] ? ksoftirqd+0x49/0xa9
> Aug 15 20:38:33 lb01 kernel: [71032.544153] [<c1035b7e>] ? ksoftirqd+0x0/0xa9
> Aug 15 20:38:33 lb01 kernel: [71032.544153] [<c10440fc>] ? kthread+0x61/0x66
> Aug 15 20:38:33 lb01 kernel: [71032.544153] [<c104409b>] ? kthread+0x0/0x66
> Aug 15 20:38:33 lb01 kernel: [71032.544153] [<c1003d47>] ?
> kernel_thread_helper+0x7/0x10
> Aug 15 20:38:33 lb01 kernel: [71032.544153] Code: 03 03 87 88 03 00 00 d3 e0
> 8b 8f 80 00 00 00 3d 31 75 00 00 0f 42 d0 8d 87 80 00 00 00 39 c1 89 97 84 02
> 00 00 74 04 85 c9 75 04 <0f> 0b eb fe 8b 97 84 02 00 00 a1 00 fa 35 c1 2b 41
> 40 89 d1 39
> Aug 15 20:38:33 lb01 kernel: [71032.544153] EIP: [<c121074f>]
> tcp_v4_err+0x2b5/0x43e SS:ESP 0068:f6c61e80
> Aug 15 20:38:33 lb01 kernel: [71034.106668] ---[ end trace e49827b6cc847155
> ]---
> Aug 15 20:38:33 lb01 kernel: [71034.134369] Kernel panic - not syncing: Fatal
> exception in interrupt
> Aug 15 20:38:33 lb01 kernel: [71034.172500] Pid: 10, comm: ksoftirqd/2
> Tainted: G D 2.6.32-5-686 #1
> Aug 15 20:38:33 lb01 kernel: [71034.214275] Call Trace:
> Aug 15 20:38:33 lb01 kernel: [71034.228992] [<c126d5f7>] ? panic+0x38/0xe6
> Aug 15 20:38:33 lb01 kernel: [71034.254121] [<c126fc01>] ? oops_end+0x91/0x9d
> Aug 15 20:38:33 lb01 kernel: [71034.280808] [<c1004121>] ?
> do_invalid_op+0x0/0x75
> Aug 15 20:38:33 lb01 kernel: [71034.309576] [<c100418d>] ?
> do_invalid_op+0x6c/0x75
> Aug 15 20:38:33 lb01 kernel: [71034.338865] [<c121074f>] ?
> tcp_v4_err+0x2b5/0x43e
> Aug 15 20:38:33 lb01 kernel: [71034.367633] [<c11dfc1c>] ?
> neigh_resolve_output+0x59/0x227
> Aug 15 20:38:33 lb01 kernel: [71034.401088] [<c11f27d0>] ?
> nf_hook_slow+0x3d/0x93
> Aug 15 20:38:33 lb01 kernel: [71034.429856] [<f8cf96bf>] ?
> ipt_do_table+0x4be/0x4eb [ip_tables]
> Aug 15 20:38:33 lb01 kernel: [71034.465913] [<c11fe152>] ?
> __inet_lookup_established+0x34/0x284
> Aug 15 20:38:33 lb01 kernel: [71034.501955] [<c126f2f3>] ?
> error_code+0x73/0x78
> Aug 15 20:38:33 lb01 kernel: [71034.529679] [<c121074f>] ?
> tcp_v4_err+0x2b5/0x43e
> Aug 15 20:38:33 lb01 kernel: [71034.558447] [<c1217c27>] ?
> icmp_unreach+0x189/0x1ab
> Aug 15 20:38:33 lb01 kernel: [71034.588253] [<c1217dde>] ?
> icmp_rcv+0x195/0x1bd
> Aug 15 20:38:33 lb01 kernel: [71034.615975] [<c11f8142>] ?
> ip_local_deliver_finish+0x10c/0x18c
> Aug 15 20:38:33 lb01 kernel: [71034.651503] [<c11f7d68>] ?
> ip_rcv_finish+0x2c4/0x2d8
> Aug 15 20:38:33 lb01 kernel: [71034.681826] [<c11d9ca8>] ?
> netif_receive_skb+0x3bb/0x3d6
> Aug 15 20:38:33 lb01 kernel: [71034.714234] [<c11d9d2c>] ?
> process_backlog+0x69/0x93
> Aug 15 20:38:33 lb01 kernel: [71034.744570] [<c11da231>] ?
> net_rx_action+0x96/0x194
> Aug 15 20:38:33 lb01 kernel: [71034.774360] [<c1035a96>] ?
> __do_softirq+0xaa/0x156
> Aug 15 20:38:33 lb01 kernel: [71034.803641] [<c1035b73>] ?
> do_softirq+0x31/0x3c
> Aug 15 20:38:33 lb01 kernel: [71034.831360] [<c1035bc7>] ? ksoftirqd+0x49/0xa9
> Aug 15 20:38:33 lb01 kernel: [71034.858562] [<c1035b7e>] ? ksoftirqd+0x0/0xa9
> Aug 15 20:38:33 lb01 kernel: [71034.885246] [<c10440fc>] ? kthread+0x61/0x66
> Aug 15 20:38:33 lb01 kernel: [71034.911410] [<c104409b>] ? kthread+0x0/0x66
> Aug 15 20:38:33 lb01 kernel: [71034.937051] [<c1003d47>] ?
> kernel_thread_helper+0x7/0x10
> Aug 15 20:38:44 lb02 kernel: [73520.996050] IPVS: stopping backup sync thread
> 24426 ...
> Aug 15 20:38:44 lb02 kernel: [73520.996806] IPVS: sync thread started: state =
> MASTER, mcast_ifn = vlan0400, syncid = 22
>
> --
> Carsten Wolff
> Tel.: +49 (0)21 61 / 46 43-182
>
> credativ GmbH, HRB Mönchengladbach 12080
> Hohenzollernstr. 133, 41061 Mönchengladbach
> Geschäftsführung: Dr. Michael Meskes, Jörg Folz
>
>
--
Ben Hutchings
The most exhausting thing in life is being insincere. - Anne Morrow Lindberg
Attachment:
signature.asc
Description: This is a digitally signed message part