Any help with the following would be greatly appreciated!
-------------------------------------------------
Symptoms:
-------------------------------------------------
Issues:
- Existing and new inbound TCP connections failed. However, system did respond to TCP connect (good 3-way handshake... just no response after that)
- Console (virtual console via Xen) was unresponsive.
- virtual machine did not respond to "xm shutdown" (had to "xm destroy").
Healthy:
- Outbound TCP and all UDP remained OK.
- All database and applications continued to function normally (except snmpd).
-------------------------------------------------
Oops Message:
-------------------------------------------------
Feb 29 04:30:02 MYHOST kernel: [4556249.019622] BUG: unable to handle kernel NULL pointer dereference at 00000000000000c8
Feb 29 04:30:02 MYHOST kernel: [4556249.020025] IP: [<ffffffff81135748>] next_tgid+0x61/0x88
Feb 29 04:30:02 MYHOST kernel: [4556249.020025] PGD 37bda067 PUD bdf29067 PMD 0
Feb 29 04:30:02 MYHOST kernel: [4556249.022172] Oops: 0000 [#1] SMP
Feb 29 04:30:02 MYHOST kernel: [4556249.022172] last sysfs file: /sys/module/vt/parameters/default_utf8
Feb 29 04:30:02 MYHOST kernel: [4556249.022172] CPU 0
Feb 29 04:30:02 MYHOST kernel: [4556249.022172] Modules linked in: cls_u32 sch_netem sch_htb xt_tcpudp iptable_nat nf_nat nf_conntrack_ipv4 nf_conntrack nf_defrag_ipv4 iptable_filter ip_tables x_tables loop snd_pcm snd_timer i2c_piix4 joydev snd i2c_core soundcore psmouse snd_page_alloc pcspkr usbhid hid serio_raw evdev ext3 jbd mbcache ata_generic ata_piix libata uhci_hcd ehci_hcd xen_blkfront xen_netfront usbcore nls_base scsi_mod [last unloaded: scsi_wait_scan]
Feb 29 04:30:02 MYHOST kernel: [4556249.027399] Pid: 1483, comm: snmpd Not tainted 2.6.32-5-amd64 #1 HVM domU
Feb 29 04:30:02 MYHOST kernel: [4556249.027399] RIP: 0010:[<ffffffff81135748>] [<ffffffff81135748>] next_tgid+0x61/0x88
Feb 29 04:30:02 MYHOST kernel: [4556249.027399] RSP: 0018:ffff8800bdc7fdf8 EFLAGS: 00010282
Feb 29 04:30:02 MYHOST kernel: [4556249.027399] RAX: 0000000000000000 RBX: ffff8800beb45d00 RCX: 0000000000000000
Feb 29 04:30:02 MYHOST kernel: [4556249.027399] RDX: ffff880004623170 RSI: 0000000000000000 RDI: ffff8800beb45d00
Feb 29 04:30:02 MYHOST kernel: [4556249.030748] RBP: 0000000000003593 R08: ffffffff81494500 R09: 0000000000003593
Feb 29 04:30:02 MYHOST kernel: [4556249.030748] R10: 0000000000000000 R11: ffffffff81154634 R12: ffffffff81494500
Feb 29 04:30:02 MYHOST kernel: [4556249.030748] R13: ffff8800bfa60000 R14: ffffffff81494500 R15: ffff8800bdc7fe98
Feb 29 04:30:02 MYHOST kernel: [4556249.030748] FS: 00007f9a6cbde700(0000) GS:ffff880001800000(0000) knlGS:0000000000000000
Feb 29 04:30:02 MYHOST kernel: [4556249.030748] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Feb 29 04:30:02 MYHOST kernel: [4556249.030748] CR2: 00000000000000c8 CR3: 00000000bccc4000 CR4: 00000000000006f0
Feb 29 04:30:02 MYHOST kernel: [4556249.030748] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Feb 29 04:30:02 MYHOST kernel: [4556249.035511] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Feb 29 04:30:02 MYHOST kernel: [4556249.035511] Process snmpd (pid: 1483, threadinfo ffff8800bdc7e000, task ffff8800bded9530)
Feb 29 04:30:02 MYHOST kernel: [4556249.035511] Stack:
Feb 29 04:30:02 MYHOST kernel: [4556249.035511] 0000000508588089 ffff8800bdc7fe98 ffff880000003593 ffff8800bddb0000
Feb 29 04:30:02 MYHOST kernel: [4556249.035511] <0> ffff8800bddb0000 0000000000003592 ffff8800bce8dd00 ffff8800bddb0000
Feb 29 04:30:02 MYHOST kernel: [4556249.035511] <0> 0000000000003592 ffffffff811358f3 ffff8800bddb0000 0000000000000000
Feb 29 04:30:02 MYHOST kernel: [4556249.035511] Call Trace:
Feb 29 04:30:02 MYHOST kernel: [4556249.035511] [<ffffffff811358f3>] ? proc_pid_readdir+0x184/0x1e3
Feb 29 04:30:02 MYHOST kernel: [4556249.035511] [<ffffffff810fc028>] ? filldir+0x0/0xb7
Feb 29 04:30:02 MYHOST kernel: [4556249.035511] [<ffffffff810fc028>] ? filldir+0x0/0xb7
Feb 29 04:30:02 MYHOST kernel: [4556249.035511] [<ffffffff810fc028>] ? filldir+0x0/0xb7
Feb 29 04:30:02 MYHOST kernel: [4556249.035511] [<ffffffff810fc1f8>] ? vfs_readdir+0x75/0xa7
Feb 29 04:30:02 MYHOST kernel: [4556249.035511] [<ffffffff810fc362>] ? sys_getdents+0x7a/0xc7
Feb 29 04:30:02 MYHOST kernel: [4556249.035511] [<ffffffff81010b22>] ? system_call_fastpath+0x16/0x1b
Feb 29 04:30:02 MYHOST kernel: [4556249.035511] Code: 04 31 d2 eb 42 4c 89 e6 48 89 c7 e8 ee d3 f2 ff 31 f6 48 89 df 89 c5 e8 66 d3 f2 ff 48 85 c0 48 89 c2 74 17 48 8b 80 b8 04 00 00 <48> 8b 88 c8 00 00 00 48 39 8a 60 02 00 00 74 04 ff c5 eb b0 48
Feb 29 04:30:02 MYHOST kernel: [4556249.047427] RIP [<ffffffff81135748>] next_tgid+0x61/0x88
Feb 29 04:30:02 MYHOST kernel: [4556249.047427] RSP <ffff8800bdc7fdf8>
Feb 29 04:30:02 MYHOST kernel: [4556249.047427] CR2: 00000000000000c8
Feb 29 04:30:02 MYHOST kernel: [4556249.053352] ---[ end trace 4becffcbf98b91c8 ]---
-------------------------------------------------
System Information:
-------------------------------------------------
gorhamj@MYHOST:/$ uname -a
Linux MYHOST 2.6.32-5-amd64 #1 SMP Sat Jan 2 18:40:58 UTC 2016 x86_64 GNU/Linux
gorhamj@MYHOST:/$ cat /proc/version
Linux version 2.6.32-5-amd64 (Debian 2.6.32-48squeeze18) (
ben@decadent.org.uk) (gcc version 4.3.5 (Debian 4.3.5-4) ) #1 SMP Sat Jan 2 18:40:58 UTC 2016
-------------------------------------------------
Package Info:
-------------------------------------------------
Package: snmpd
New: yes
State: installed
Automatically installed: no
Version: 5.4.3~dfsg-2+squeeze1
Priority: optional
Section: net
Uncompressed Size: 1,147 k
Depends: libc6 (>= 2.4), libsnmp15 (>= 5.4.3~dfsg), libwrap0 (>= 7.6-4~), debconf (>= 0.5) | debconf-2.0, adduser, debconf, lsb-base (>= 3.2-13)
Description: SNMP (Simple Network Management Protocol) agents
The Simple Network Management Protocol (SNMP) provides a framework for the exchange of management information between agents (servers) and clients.
The Net-SNMP agent is a daemon which listens for incoming SNMP requests from clients and provides responses.