Bug#783063: Xen domU freeze with "Guest Rx stalled"
Package: src:linux
Version: 3.16.7-ckt4-3~bpo70+1
Severity: important
Hello,
ever since upgrading some of our Xen dom0s to the kernel in backports at
that time (3.16.7-ckt4-3~bpo70+1) we are seeing domU freezes with output such
as:
[2951591.712865] vif vif-1-0 vif1.0: Guest Rx stalled
[2951591.713145] public: port 2(vif1.0) entered disabled state
and a normal shutdown fails with:
[2015-04-21 11:24:03 3895] DEBUG (XendDomainInfo:1881) XendDomainInfo.handleShutdownWatch
[2015-04-21 11:27:02 3895] INFO (XendDomainInfo:2114) Domain shutdown timeout expired: name=foo-domU1 id=1
[2015-04-21 11:28:02 3895] DEBUG (XendDomainInfo:524) XendDomainInfo.shutdown(poweroff)
so that we had to destroy it for it to (re-)boot.
It should be noted that we have not yet seen this problem on PVHVM guests, but
only on PV ones. The domains are shown as running (state r), but do not react to
any commands.
A patch that *might* be related is xen-netback-reintroduce-guest-Rx-stall-detection.patch
(cf. [0]), but we are not sure about that yet.
On two occasions we managed to capture the following call trace:
[2583319.512052] Call Trace:
[2583319.512052] <IRQ>
[2583319.512052] [<ffffffff8137daf3>] ? xen_send_IPI_one+0x43/0x60
[2583319.512052] [<ffffffff81011713>] ? __xen_send_IPI_mask+0x33/0x60
[2583319.512052] [<ffffffff8104b700>] ?
arch_trigger_all_cpu_backtrace+0x120/0x130
[2583319.512052] [<ffffffff810d0210>] ? rcu_check_callbacks+0x410/0x680
[2583319.512052] [<ffffffff810ac382>] ? trigger_load_balance+0x52/0x210
[2583319.512052] [<ffffffff8107bd14>] ? update_process_times+0x44/0x80
[2583319.512052] [<ffffffff810db39f>] ? tick_sched_handle.isra.12+0x2f/0x70
[2583319.512052] [<ffffffff810db4ca>] ? tick_sched_timer+0x4a/0x80
[2583319.512052] [<ffffffff81093350>] ? __run_hrtimer+0x70/0x210
[2583319.512052] [<ffffffff810db480>] ? tick_nohz_handler+0xa0/0xa0
[2583319.512052] [<ffffffff81093bc1>] ? hrtimer_interrupt+0x101/0x260
[2583319.512052] [<ffffffff8100b2e8>] ? xen_timer_interrupt+0x28/0x150
[2583319.512052] [<ffffffff813b7b21>] ? add_interrupt_randomness+0x51/0x200
[2583319.512052] [<ffffffff810c4f54>] ? handle_irq_event_percpu+0x54/0x1e0
[2583319.512052] [<ffffffff810c891a>] ? handle_percpu_irq+0x4a/0x80
[2583319.512052] [<ffffffff810c473d>] ? generic_handle_irq+0x1d/0x30
[2583319.512052] [<ffffffff8137e51d>] ? evtchn_2l_handle_events+0x24d/0x260
[2583319.512052] [<ffffffff8137bdff>] ? __xen_evtchn_do_upcall+0x3f/0x70
[2583319.512052] [<ffffffff8137db3f>] ? xen_evtchn_do_upcall+0x2f/0x50
[2583319.512052] [<ffffffff8154b71e>] ? xen_do_hypervisor_callback+0x1e/0x30
[2583319.512052] <EOI>
[2583319.512052] [<ffffffff810b7043>] ? queue_write_lock_slowpath+0x83/0x90
[2583319.512052] [<ffffffff814582ab>] ? neigh_periodic_work+0xbb/0x1e0
[2583319.512052] [<ffffffff8108891c>] ? process_one_work+0x15c/0x450
[2583319.512052] [<ffffffff81089b72>] ? worker_thread+0x112/0x540
[2583319.512052] [<ffffffff81089a60>] ? create_and_start_worker+0x60/0x60
[2583319.512052] [<ffffffff81090541>] ? kthread+0xc1/0xe0
[2583319.512052] [<ffffffff81090480>] ? flush_kthread_worker+0xb0/0xb0
[2583319.512052] [<ffffffff815499bc>] ? ret_from_fork+0x7c/0xb0
[2583319.512052] [<ffffffff81090480>] ? flush_kthread_worker+0xb0/0xb0
[2583319.512052] Code: cc 51 41 53 50 b8 17 00 00 00 0f 05 5b 59 c3 cc cc cc
cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 18 00 00 00 0f 05
<41> 5b 59 c3 cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc
[2583319.512819] NMI backtrace for cpu 1
[2583319.512827] CPU: 1 PID: 0 Comm: swapper/1 Not tainted
3.16.0-0.bpo.4-amd64 #1 Debian 3.16.7-ckt4-3~bpo70+1
[2583319.512831] task: ffff8801f51c0a20 ti: ffff8801f51c8000 task.ti:
ffff8801f51c8000
[2583319.512835] RIP: e030:[<ffffffff810b703f>] [<ffffffff810b703f>]
queue_write_lock_slowpath+0x7f/0x90
[2583319.512842] RSP: e02b:ffff8801fea43c00 EFLAGS: 00000202
[2583319.512845] RAX: 0000000000000007 RBX: 0000000000000001 RCX:
0000000000000000
[2583319.512848] RDX: 0000000000000008 RSI: ffffffff818bdc1c RDI:
ffffffff818bdc1c
[2583319.512851] RBP: 00000001264c55e3 R08: 000000000a6b3ca4 R09:
ffff8801fea43b88
[2583319.512854] R10: 000000000a6b3ca4 R11: ffff8801fea43b88 R12:
ffffffff818bda40
[2583319.512857] R13: ffff8800edb6d200 R14: ffff8801f4d98000 R15:
ffffffff818b7bc0
[2583319.512863] FS: 00007f9730008700(0000) GS:ffff8801fea40000(0000)
knlGS:0000000000000000
[2583319.512867] CS: e033 DS: 002b ES: 002b CR0: 000000008005003b
[2583319.512870] CR2: ffffffffff600400 CR3: 000000014478d000 CR4:
0000000000002660
[2583319.512873] Stack:
[2583319.512875] ffffffff8145998b ffff8800034a0700 ffff8800034a0700
ffffffff000000b7
[2583319.512880] 0000000000000004 ffff8801fea43ca4 ffffffff818bdc1c
00ff8801f4d98000
[2583319.512884] ffffffff8147f66f ffffffff8148afe0 ffffffff80000000
ffffffff818e6cc0
[2583319.512889] Call Trace:
[2583319.512891] <IRQ>
[2583319.512893] [<ffffffff8145998b>] ? __neigh_create+0x1eb/0x5d0
[2583319.512901] [<ffffffff8147f66f>] ? nf_hook_slow+0x7f/0x160
[2583319.512905] [<ffffffff8148afe0>] ? ip_fragment+0x870/0x870
[2583319.512908] [<ffffffff8148b747>] ? ip_finish_output+0x767/0x8d0
[2583319.512912] [<ffffffff8148cd42>] ? ip_send_skb+0x12/0x40
[2583319.512916] [<ffffffff814ba525>] ? icmp_send+0x445/0x520
[2583319.512920] [<ffffffff81093c0b>] ? hrtimer_interrupt+0x14b/0x260
[2583319.512924] [<ffffffff814583d0>] ? neigh_periodic_work+0x1e0/0x1e0
[2583319.512928] [<ffffffff81480efa>] ? ipv4_link_failure+0x1a/0x60
[2583319.512932] [<ffffffff814b716a>] ? arp_error_report+0x2a/0x40
[2583319.512936] [<ffffffff81457f4e>] ? neigh_invalidate+0x7e/0xf0
[2583319.512940] [<ffffffff81458562>] ? neigh_timer_handler+0x192/0x290
[2583319.512944] [<ffffffff814583d0>] ? neigh_periodic_work+0x1e0/0x1e0
[2583319.512949] [<ffffffff8107985c>] ? call_timer_fn+0x4c/0x150
[2583319.512953] [<ffffffff814583d0>] ? neigh_periodic_work+0x1e0/0x1e0
[2583319.512957] [<ffffffff8107b2c7>] ? run_timer_softirq+0x297/0x2e0
[2583319.512961] [<ffffffff81072c0e>] ? __do_softirq+0xde/0x2e0
[2583319.512965] [<ffffffff81073066>] ? irq_exit+0x86/0xb0
[2583319.512969] [<ffffffff8137db45>] ? xen_evtchn_do_upcall+0x35/0x50
[2583319.512974] [<ffffffff8154b71e>] ? xen_do_hypervisor_callback+0x1e/0x30
[2583319.512976] <EOI>
[2583319.512978] [<ffffffff810013aa>] ? xen_hypercall_sched_op+0xa/0x20
[2583319.512983] [<ffffffff810013aa>] ? xen_hypercall_sched_op+0xa/0x20
[2583319.512987] [<ffffffff8100b0ec>] ? xen_safe_halt+0xc/0x20
[2583319.512991] [<ffffffff8101f642>] ? default_idle+0x22/0xf0
[2583319.512995] [<ffffffff810b1818>] ? cpu_startup_entry+0x2e8/0x4b0
[2583319.512999] [<ffffffff8100b139>] ? xen_force_evtchn_callback+0x9/0x10
[2583319.513002] [<ffffffff8100ba12>] ? check_events+0x12/0x20
[2583319.513005] Code: d0 75 e9 ba ff 00 00 00 eb 04 66 90 f3 90 8b 07 83 f8
01 75 f7 f0 0f b1 17 83 f8 01 75 ee eb bc 0f b7 47 04 66 39 d0 74 9c f3 90
<0f> b7 47 04 66 39 c2 75 f5 eb 8f 66 0f 1f 44 00 00 0f 1f 44 00
[2583319.513038] NMI backtrace for cpu 3
[2583319.513046] CPU: 3 PID: 27690 Comm: serf Not tainted 3.16.0-0.bpo.4-amd64
#1 Debian 3.16.7-ckt4-3~bpo70+1
[2583319.513051] task: ffff8801f4517670 ti: ffff88013a134000 task.ti:
ffff88013a134000
[2583319.513055] RIP: e030:[<ffffffff810b7043>] [<ffffffff810b7043>]
queue_write_lock_slowpath+0x83/0x90
[2583319.513068] RSP: e02b:ffff88013a137bb0 EFLAGS: 00000202
[2583319.513074] RAX: 0000000000000007 RBX: 0000000000000001 RCX:
0000000000000000
[2583319.513080] RDX: 0000000000000009 RSI: ffffffff818bdc1c RDI:
ffffffff818bdc1c
[2583319.513086] RBP: 00000001264e5a85 R08: 0000000000000020 R09:
0000000000000001
[2583319.513092] R10: 000000000a6b3ceb R11: ffff88013a137b38 R12:
ffffffff818bda40
[2583319.513096] R13: ffff8800e8a2be00 R14: ffff8801f18f0000 R15:
ffff8801f3257200
[2583319.513102] FS: 000000c208019b70(0000) GS:ffff8801feac0000(0000)
knlGS:0000000000000000
[2583319.513105] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[2583319.513108] CR2: ffffffffff600400 CR3: 00000001f2aa7000 CR4:
0000000000002660
[2583319.513112] Stack:
[2583319.513114] ffffffff8145998b ffff8801f32572e8 ffff8801f32572e8
ffffffff000000b8
[2583319.513121] 0000000000000004 ffff88013a137c54 ffffffff818bdc1c
00ff8801f18f0000
[2583319.513128] ffffffff8147f66f ffffffff8148afe0 ffffffff80000000
ffffffff818e6cc0
[2583319.513136] Call Trace:
[2583319.513141] [<ffffffff8145998b>] ? __neigh_create+0x1eb/0x5d0
[2583319.513148] [<ffffffff8147f66f>] ? nf_hook_slow+0x7f/0x160
[2583319.513153] [<ffffffff8148afe0>] ? ip_fragment+0x870/0x870
[2583319.513158] [<ffffffff8148b747>] ? ip_finish_output+0x767/0x8d0
[2583319.513164] [<ffffffff8148baba>] ? ip_queue_xmit+0x12a/0x3b0
[2583319.513170] [<ffffffff814a278e>] ? tcp_transmit_skb+0x41e/0x900
[2583319.513175] [<ffffffff814a3522>] ? tcp_connect+0x7e2/0x930
[2583319.513179] [<ffffffff810d22ee>] ? getnstimeofday+0xe/0x30
[2583319.513183] [<ffffffff810d2321>] ? ktime_get_real+0x11/0x50
[2583319.513186] [<ffffffff814a81ce>] ? tcp_v4_connect+0x2ee/0x410
[2583319.513191] [<ffffffff814bf6d6>] ? __inet_stream_connect+0x1f6/0x350
[2583319.513195] [<ffffffff81549536>] ? _raw_spin_lock_irqsave+0x16/0x50
[2583319.513198] [<ffffffff814bfb95>] ? inet_stream_connect+0x45/0x70
[2583319.513202] [<ffffffff814339b8>] ? SYSC_connect+0xe8/0x100
[2583319.513206] [<ffffffff8100b430>] ? xen_clocksource_read+0x20/0x30
[2583319.513210] [<ffffffff8100b430>] ? xen_clocksource_read+0x20/0x30
[2583319.513214] [<ffffffff810d20a2>] ? ktime_get_ts+0x42/0xd0
[2583319.513218] [<ffffffff8108e841>] ? posix_ktime_get_ts+0x11/0x20
[2583319.513222] [<ffffffff8108fc10>] ? SyS_clock_gettime+0x40/0x70
[2583319.513226] [<ffffffff81549a6d>] ?
system_call_fast_compare_end+0x10/0x15
[2583319.513229] Code: ff 00 00 00 eb 04 66 90 f3 90 8b 07 83 f8 01 75 f7 f0
0f b1 17 83 f8 01 75 ee eb bc 0f b7 47 04 66 39 d0 74 9c f3 90 0f b7 47 04
<66> 39 c2 75 f5 eb 8f 66 0f 1f 44 00 00 0f 1f 44 00 00 65 8b 04
[2583319.512054] NMI backtrace for cpu 5
[2583319.512054] CPU: 5 PID: 0 Comm: swapper/5 Not tainted
3.16.0-0.bpo.4-amd64 #1 Debian 3.16.7-ckt4-3~bpo70+1
[2583319.651579] task: ffff8801f51ea110 ti: ffff8801f51fc000 task.ti:
ffff8801f51fc000
[2583319.651579] RIP: e030:[<ffffffff810013aa>] [<ffffffff810013aa>]
xen_hypercall_sched_op+0xa/0x20
[2583319.651579] RSP: e02b:ffff8801f51ffe80 EFLAGS: 00000246
[2583319.651579] RAX: 0000000000000000 RBX: ffffffff818e03c0 RCX:
ffffffff810013aa
[2583319.651579] RDX: ffff8801feb40000 RSI: 0000000000000000 RDI:
0000000000000001
[2583319.651579] RBP: 0000000000000000 R08: 0000000000000000 R09:
0000000000000000
[2583319.651579] R10: 0000000000000001 R11: 0000000000000246 R12:
0000000000000005
[2583319.651579] R13: ffff8801f51fc000 R14: 0000000000000000 R15:
ffff8801f51fc000
[2583319.651579] FS: 00007f9730008700(0000) GS:ffff8801feb40000(0000)
knlGS:0000000000000000
[2583319.651579] CS: e033 DS: 002b ES: 002b CR0: 000000008005003b
[2583319.651579] CR2: ffffffffff600400 CR3: 000000000d69a000 CR4:
0000000000002660
[2583319.651579] Stack:
[2583319.651579] 00000001267d6f70 ffffffff81853f20 ffffffff8100b0ec
ffffffff8101f642
[2583319.651579] 0000000000000000 ffffffff818e03c0 0000000000000000
00000000ffffffed
[2583319.651579] ffff8801f51fc000 ffffffff810b1818 000000000000000a
ffffffff8100b139
[2583319.651579] Call Trace:
[2583319.651579] [<ffffffff8100b0ec>] ? xen_safe_halt+0xc/0x20
[2583319.651579] [<ffffffff8101f642>] ? default_idle+0x22/0xf0
[2583319.651579] [<ffffffff810b1818>] ? cpu_startup_entry+0x2e8/0x4b0
[2583319.651579] [<ffffffff8100b139>] ? xen_force_evtchn_callback+0x9/0x10
[2583319.651579] [<ffffffff8100ba12>] ? check_events+0x12/0x20
[2583319.651579] Code: cc 51 41 53 b8 1c 00 00 00 0f 05 41 5b 59 c3 cc cc cc
cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 1d 00 00 00 0f 05
<41> 5b 59 c3 cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc
[2583319.514789] NMI backtrace for cpu 6
[2583319.514789] CPU: 6 PID: 0 Comm: swapper/6 Not tainted
3.16.0-0.bpo.4-amd64 #1 Debian 3.16.7-ckt4-3~bpo70+1
[2583319.712678] INFO: rcu_sched detected stalls on CPUs/tasks: { 4} (detected
by 5, t=3224310 jiffies, g=258996215, c=258996214, q=4338955)
[2583319.514789] task: ffff8801f52013f0 ti: ffff8801f5204000 task.ti:
ffff8801f5204000
[2583319.514789] RIP: e030:[<ffffffff810013aa>] [<ffffffff810013aa>]
xen_hypercall_sched_op+0xa/0x20
[2583319.514789] RSP: e02b:ffff8801f5207e80 EFLAGS: 00000246
[2583319.514789] RAX: 0000000000000000 RBX: ffffffff818e03c0 RCX:
ffffffff810013aa
[2583319.514789] RDX: ffff8801feb80000 RSI: 0000000000000000 RDI:
0000000000000001
[2583319.514789] RBP: 0000000000000000 R08: 0000000000000000 R09:
0000000000000000
[2583319.514789] R10: 0000000000000001 R11: 0000000000000246 R12:
0000000000000006
[2583319.514789] R13: ffff8801f5204000 R14: 0000000000000000 R15:
ffff8801f5204000
[2583319.514789] FS: 00007f9730008700(0000) GS:ffff8801feb80000(0000)
knlGS:0000000000000000
[2583319.514789] CS: e033 DS: 002b ES: 002b CR0: 000000008005003b
[2583319.514789] CR2: ffffffffff600400 CR3: 00000001f35fa000 CR4:
0000000000002660
[2583319.514789] Stack:
[2583319.514789] 00000001267d6ffd ffffffff81853f20 ffffffff8100b0ec
ffffffff8101f642
[2583319.514789] 0000000000000000 ffffffff818e03c0 0000000000000000
00000000ffffffed
[2583319.514789] ffff8801f5204000 ffffffff810b1818 000000000000000a
ffffffff8100b139
[2583319.514789] Call Trace:
[2583319.514789] [<ffffffff8100b0ec>] ? xen_safe_halt+0xc/0x20
[2583319.514789] [<ffffffff8101f642>] ? default_idle+0x22/0xf0
[2583319.514789] [<ffffffff810b1818>] ? cpu_startup_entry+0x2e8/0x4b0
[2583319.514789] [<ffffffff8100b139>] ? xen_force_evtchn_callback+0x9/0x10
[2583319.514789] [<ffffffff8100ba12>] ? check_events+0x12/0x20
[2583319.514789] Code: cc 51 41 53 b8 1c 00 00 00 0f 05 41 5b 59 c3 cc cc cc
cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 1d 00 00 00 0f 05
<41> 5b 59 c3 cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc
[2583319.669825] NMI backtrace for cpu 7
[2583319.669825] CPU: 7 PID: 0 Comm: swapper/7 Not tainted
3.16.0-0.bpo.4-amd64 #1 Debian 3.16.7-ckt4-3~bpo70+1
[2583319.669825] task: ffff8801f5200aa0 ti: ffff8801f5208000 task.ti:
ffff8801f5208000
[2583319.669825] RIP: e030:[<ffffffff810013aa>] [<ffffffff810013aa>]
xen_hypercall_sched_op+0xa/0x20
[2583319.669825] RSP: e02b:ffff8801f520be80 EFLAGS: 00000246
[2583319.669825] RAX: 0000000000000000 RBX: ffffffff818e03c0 RCX:
ffffffff810013aa
[2583319.669825] RDX: ffff8801febc0000 RSI: 0000000000000000 RDI:
0000000000000001
[2583319.669825] RBP: 0000000000000000 R08: 0000000000000000 R09:
0000000000000000
[2583319.669825] R10: 0000000000000001 R11: 0000000000000246 R12:
0000000000000007
[2583319.669825] R13: ffff8801f5208000 R14: 0000000000000000 R15:
ffff8801f5208000
[2583319.669825] FS: 00007f9730008700(0000) GS:ffff8801febc0000(0000)
knlGS:0000000000000000
[2583319.669825] CS: e033 DS: 002b ES: 002b CR0: 000000008005003b
[2583319.669825] CR2: ffffffffff600400 CR3: 00000000954b3000 CR4:
0000000000002660
[2583319.669825] Stack:
[2583319.669825] 00000001267d6ff1 ffffffff81853f20 ffffffff8100b0ec
ffffffff8101f642
[2583319.669825] 0000000000000000 ffffffff818e03c0 0000000000000000
00000000ffffffed
[2583319.669825] ffff8801f5208000 ffffffff810b1818 000000000000000a
ffffffff8100b139
[2583319.669825] Call Trace:
[2583319.669825] [<ffffffff8100b0ec>] ? xen_safe_halt+0xc/0x20
[2583319.669825] [<ffffffff8101f642>] ? default_idle+0x22/0xf0
[2583319.669825] [<ffffffff810b1818>] ? cpu_startup_entry+0x2e8/0x4b0
[2583319.669825] [<ffffffff8100b139>] ? xen_force_evtchn_callback+0x9/0x10
[2583319.669825] [<ffffffff8100ba12>] ? check_events+0x12/0x20
[2583319.669825] Code: cc 51 41 53 b8 1c 00 00 00 0f 05 41 5b 59 c3 cc cc cc
cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 1d 00 00 00 0f 05
<41> 5b 59 c3 cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc
[2583344.076056] BUG: soft lockup - CPU#0 stuck for 22s! [serf:27713]
[2583344.076056] Modules linked in: xt_multiport ip6table_filter ip6_tables
xt_tcpudp nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack iptable_filter
ip_tables x_tables nf_conntrack x86_pkg_temp_thermal thermal_sys coretemp
crct10dif_pclmul crct10dif_common crc32_pclmul ghash_clmulni_intel aesni_intel
aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd evdev pcspkr ext4 crc16
mbcache jbd2 xen_blkfront xen_netfront crc32c_intel
[2583344.076056] CPU: 0 PID: 27713 Comm: serf Not tainted 3.16.0-0.bpo.4-amd64
#1 Debian 3.16.7-ckt4-3~bpo70+1
[2583344.076056] task: ffff8800edbf2b60 ti: ffff8800f4db8000 task.ti:
ffff8800f4db8000
[2583344.076056] RIP: e030:[<ffffffff810b7002>] [<ffffffff810b7002>]
queue_write_lock_slowpath+0x42/0x90
[2583344.076056] RSP: e02b:ffff8800f4dbbb00 EFLAGS: 00000286
[2583344.076056] RAX: 00000000000000ff RBX: 0000000000000001 RCX:
0000000000000000
[2583344.076056] RDX: 00000000000000ff RSI: ffffffff818bdc1c RDI:
ffffffff818bdc1c
[2583344.076056] RBP: 00000001264c3d6c R08: 0000000000000020 R09:
0000000000000001
[2583344.076056] R10: 000000000a6b3c82 R11: ffff8800f4dbba88 R12:
ffffffff818bda40
[2583344.076056] R13: ffff8801f26a4e00 R14: ffff8801f18f0000 R15:
0000000000000059
[2583344.076056] FS: 000000c208049270(0000) GS:ffff8801fea00000(0000)
knlGS:0000000000000000
[2583344.076056] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[2583344.076056] CR2: 00007f9736adb000 CR3: 00000001f2aa7000 CR4:
0000000000002660
[2583344.076056] Stack:
[2583344.076056] ffffffff8145998b ffff880004156a00 ffff880004156a00
ffffffff000000b6
[2583344.076056] 0000000000000004 ffff8800f4dbbba4 ffffffff818bdc1c
00ff8801f18f0000
[2583344.076056] ffffffff8147f66f ffffffff8148afe0 ffffffff80000000
ffffffff818e6cc0
[2583344.076056] Call Trace:
[2583344.076056] [<ffffffff8145998b>] ? __neigh_create+0x1eb/0x5d0
[2583344.076056] [<ffffffff8147f66f>] ? nf_hook_slow+0x7f/0x160
[2583344.076056] [<ffffffff8148afe0>] ? ip_fragment+0x870/0x870
[2583344.076056] [<ffffffff8148b747>] ? ip_finish_output+0x767/0x8d0
[2583344.076056] [<ffffffff8148cd42>] ? ip_send_skb+0x12/0x40
[2583344.076056] [<ffffffff814b2e9f>] ? udp_send_skb+0x10f/0x280
[2583344.076056] [<ffffffff81489770>] ? ip_setup_cork+0x130/0x130
[2583344.076056] [<ffffffff814b3a98>] ? udp_sendmsg+0x308/0x8a0
[2583344.076056] [<ffffffff814331ca>] ? sock_sendmsg+0xda/0xf0
[2583344.076056] [<ffffffff814b44d2>] ? udp_poll+0x22/0xb0
[2583344.076056] [<ffffffff811feb90>] ? ep_poll_readyevents_proc+0x30/0x30
[2583344.076056] [<ffffffff81433861>] ? SYSC_sendto+0x121/0x190
[2583344.076056] [<ffffffff810e0150>] ? SyS_futex+0x150/0x1c0
[2583344.076056] [<ffffffff8100b430>] ? xen_clocksource_read+0x20/0x30
[2583344.076056] [<ffffffff810d1c84>] ? __getnstimeofday+0x34/0xb0
[2583344.076056] [<ffffffff810d22ee>] ? getnstimeofday+0xe/0x30
[2583344.076056] [<ffffffff81549a6d>] ?
system_call_fast_compare_end+0x10/0x15
[2583344.076056] Code: 75 5b 8b 07 85 c0 75 23 ba ff 00 00 00 f0 0f b1 17 85
c0 75 16 0f 1f 40 00 66 83 47 04 01 c3 66 2e 0f 1f 84 00 00 00 00 00 f3 90
<8b> 17 84 d2 75 f8 89 d1 89 d0 83 c9 01 f0 0f b1 0f 39 d0 75 e9
[2583344.132067] BUG: soft lockup - CPU#3 stuck for 22s! [serf:27690]
[2583344.132055] BUG: soft lockup - CPU#4 stuck for 22s! [kworker/4:1:59]
[2583344.132055] Modules linked in: xt_multiport ip6table_filter ip6_tables
xt_tcpudp nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack iptable_filter
ip_tables x_tables nf_conntrack x86_pkg_temp_thermal thermal_sys coretemp
crct10dif_pclmul crct10dif_common crc32_pclmul ghash_clmulni_intel aesni_intel
aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd evdev pcspkr ext4
crc16[2583344.132067] Modules linked in: xt_multiport ip6table_filter
ip6_tables xt_tcpudp nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack
iptable_filter ip_tables x_tables nf_conntrack x86_pkg_temp_thermal
thermal_sys coretemp crct10dif_pclmul crct10dif_common crc32_pclmul
ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper
ablk_helper cryptd evdev pcspkr ext4 crc16 mbcache jbd2 xen_blkfront
xen_netfront crc32c_intel
[2583344.132067] CPU: 3 PID: 27690 Comm: serf Not tainted 3.16.0-0.bpo.4-amd64
#1 Debian 3.16.7-ckt4-3~bpo70+1
[2583344.132067] task: ffff8801f4517670 ti: ffff88013a134000 task.ti:
ffff88013a134000
[2583344.132067] RIP: e030:[<ffffffff810b7043>] [<ffffffff810b7043>]
queue_write_lock_slowpath+0x83/0x90
[2583344.132067] RSP: e02b:ffff88013a137bb0 EFLAGS: 00000202
[2583344.132067] RAX: 0000000000000007 RBX: 0000000000000001 RCX:
0000000000000000
[2583344.132067] RDX: 0000000000000009 RSI: ffffffff818bdc1c RDI:
ffffffff818bdc1c
[2583344.132067] RBP: 00000001264e5a85 R08: 0000000000000020 R09:
0000000000000001
[2583344.132067] R10: 000000000a6b3ceb R11: ffff88013a137b38 R12:
ffffffff818bda40
[2583344.132067] R13: ffff8800e8a2be00 R14: ffff8801f18f0000 R15:
ffff8801f3257200
[2583344.132067] FS: 000000c208019b70(0000) GS:ffff8801feac0000(0000)
knlGS:0000000000000000
[2583344.132067] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[2583344.132067] CR2: ffffffffff600400 CR3: 00000001f2aa7000 CR4:
0000000000002660
[2583344.132067] Stack:
[2583344.132067] ffffffff8145998b ffff8801f32572e8 ffff8801f32572e8
ffffffff000000b8
[2583344.132067] 0000000000000004 ffff88013a137c54 ffffffff818bdc1c
00ff8801f18f0000
[2583344.132067] ffffffff8147f66f ffffffff8148afe0 ffffffff80000000
ffffffff818e6cc0
[2583344.132067] Call Trace:
[2583344.132067] [<ffffffff8145998b>] ? __neigh_create+0x1eb/0x5d0
[2583344.132067] [<ffffffff8147f66f>] ? nf_hook_slow+0x7f/0x160
[2583344.132067] [<ffffffff8148afe0>] ? ip_fragment+0x870/0x870
[2583344.132067] [<ffffffff8148b747>] ? ip_finish_output+0x767/0x8d0
[2583344.132067] [<ffffffff8148baba>] ? ip_queue_xmit+0x12a/0x3b0
[2583344.132067] [<ffffffff814a278e>] ? tcp_transmit_skb+0x41e/0x900
[2583344.132067] [<ffffffff814a3522>] ? tcp_connect+0x7e2/0x930
[2583344.132067] [<ffffffff810d22ee>] ? getnstimeofday+0xe/0x30
[2583344.132067] [<ffffffff810d2321>] ? ktime_get_real+0x11/0x50
[2583344.132067] [<ffffffff814a81ce>] ? tcp_v4_connect+0x2ee/0x410
[2583344.132067] [<ffffffff814bf6d6>] ? __inet_stream_connect+0x1f6/0x350
[2583344.132067] [<ffffffff81549536>] ? _raw_spin_lock_irqsave+0x16/0x50
[2583344.132067] [<ffffffff814bfb95>] ? inet_stream_connect+0x45/0x70
[2583344.132067] [<ffffffff814339b8>] ? SYSC_connect+0xe8/0x100
[2583344.132067] [<ffffffff8100b430>] ? xen_clocksource_read+0x20/0x30
[2583344.132067] [<ffffffff8100b430>] ? xen_clocksource_read+0x20/0x30
[2583344.132067] [<ffffffff810d20a2>] ? ktime_get_ts+0x42/0xd0
[2583344.132067] [<ffffffff8108e841>] ? posix_ktime_get_ts+0x11/0x20
[2583344.132067] [<ffffffff8108fc10>] ? SyS_clock_gettime+0x40/0x70
[2583344.132067] [<ffffffff81549a6d>] ?
system_call_fast_compare_end+0x10/0x15
[2583344.132067] Code: ff 00 00 00 eb 04 66 90 f3 90 8b 07 83 f8 01 75 f7 f0
0f b1 17 83 f8 01 75 ee eb bc 0f b7 47 04 66 39 d0 74 9c f3 90 0f b7 47 04
<66> 39 c2 75 f5 eb 8f 66 0f 1f 44 00 00 0f 1f 44 00 00 65 8b 04
[2583344.132055] mbcache jbd2 xen_blkfront xen_netfront crc32c_intel
[2583344.132055] CPU: 4 PID: 59 Comm: kworker/4:1 Not tainted
3.16.0-0.bpo.4-amd64 #1 Debian 3.16.7-ckt4-3~bpo70+1
[2583344.132055] Workqueue: events_power_efficient neigh_periodic_work
[2583344.132055] task: ffff8801f4da6ae0 ti: ffff8801f4e58000 task.ti:
ffff8801f4e58000
[2583344.132055] RIP: e030:[<ffffffff810b7043>] [<ffffffff810b7043>]
queue_write_lock_slowpath+0x83/0x90
[2583344.132055] RSP: e02b:ffff8801f4e5bdc0 EFLAGS: 00000a93
[2583344.132055] RAX: 000000000000c11c RBX: ffffffff818bdc1c RCX:
0000000000000008
[2583344.132055] RDX: 0000000000007ec0 RSI: 0000000000000200 RDI:
ffff8801f2783828
[2583344.132055] RBP: 00000000000000a4 R08: ffff8800fd2ed800 R09:
0000000000000000
[2583344.132055] R10: 0000000000000000 R11: 0000000000000000 R12:
ffff8801f2783800
[2583344.132055] R13: ffffffff818bdb30 R14: 0000000000000001 R15:
ffff8800fd2edd20
[2583344.132055] FS: 000000c2080ca4f0(0000) GS:ffff8801feb00000(0000)
knlGS:0000000000000000
[2583344.132055] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[2583344.132055] CR2: ffffffffff600400 CR3: 00000001f2aa7000 CR4:
0000000000002660
[2583344.132055] Stack:
[2583344.132055] ffffffff814582ab ffff88009558b480 ffff8801f4e23ac0
ffff8801feb12a00
[2583344.132055] ffff8801feb16800 0000000000000000 0000000000000000
ffffffff818bdb30
[2583344.132055] ffffffff8108891c 0000000000013200 ffff8801f4e5bfd8
0000000000013200
[2583344.132055] Call Trace:
[2583344.132055] [<ffffffff814582ab>] ? neigh_periodic_work+0xbb/0x1e0
[2583344.132055] [<ffffffff8108891c>] ? process_one_work+0x15c/0x450
[2583344.132055] [<ffffffff81089b72>] ? worker_thread+0x112/0x540
[2583344.132055] [<ffffffff81089a60>] ? create_and_start_worker+0x60/0x60
[2583344.132055] [<ffffffff81090541>] ? kthread+0xc1/0xe0
[2583344.132055] [<ffffffff81090480>] ? flush_kthread_worker+0xb0/0xb0
[2583344.132055] [<ffffffff815499bc>] ? ret_from_fork+0x7c/0xb0
[2583344.132055] [<ffffffff81090480>] ? flush_kthread_worker+0xb0/0xb0
[2583344.132055] Code: ff 00 00 00 eb 04 66 90 f3 90 8b 07 83 f8 01 75 f7 f0
0f b1 17 83 f8 01 75 ee eb bc 0f b7 47 04 66 39 d0 74 9c f3 90 0f b7 47 04
<66> 39 c2 75 f5 eb 8f 66 0f 1f 44 00 00 0f 1f 44 00 00 65 8b 04
[2583372.076054] BUG: soft lockup - CPU#0 stuck for 22s! [serf:27713]
[2583372.076054] Modules linked in: xt_multiport ip6table_filter ip6_tables
xt_tcpudp nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack iptable_filter
ip_tables x_tables nf_conntrack x86_pkg_temp_thermal thermal_sys coretemp
crct10dif_pclmul crct10dif_common crc32_pclmul ghash_clmulni_intel aesni_intel
aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd evdev pcspkr ext4 crc16
mbcache jbd2 xen_blkfront xen_netfront crc32c_intel
[2583372.076054] CPU: 0 PID: 27713 Comm: serf Not tainted 3.16.0-0.bpo.4-amd64
#1 Debian 3.16.7-ckt4-3~bpo70+1
[2583372.076054] task: ffff8800edbf2b60 ti: ffff8800f4db8000 task.ti:
ffff8800f4db8000
[2583372.076054] RIP: e030:[<ffffffff810b7002>] [<ffffffff810b7002>]
queue_write_lock_slowpath+0x42/0x90
[2583372.076054] RSP: e02b:ffff8800f4dbbb00 EFLAGS: 00000286
[2583372.076054] RAX: 00000000000000ff RBX: 0000000000000001 RCX:
0000000000000000
[2583372.076054] RDX: 00000000000000ff RSI: ffffffff818bdc1c RDI:
ffffffff818bdc1c
[2583372.076054] RBP: 00000001264c3d6c R08: 0000000000000020 R09:
0000000000000001
[2583372.076054] R10: 000000000a6b3c82 R11: ffff8800f4dbba88 R12:
ffffffff818bda40
[2583372.076054] R13: ffff8801f26a4e00 R14: ffff8801f18f0000 R15:
0000000000000059
[2583372.076054] FS: 000000c208049270(0000) GS:ffff8801fea00000(0000)
knlGS:0000000000000000
[2583372.076054] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[2583372.076054] CR2: 00007f9736adb000 CR3: 00000001f2aa7000 CR4:
0000000000002660
[2583372.076054] Stack:
[2583372.076054] ffffffff8145998b ffff880004156a00 ffff880004156a00
ffffffff000000b6
[2583372.076054] 0000000000000004 ffff8800f4dbbba4 ffffffff818bdc1c
00ff8801f18f0000
[2583372.076054] ffffffff8147f66f ffffffff8148afe0 ffffffff80000000
ffffffff818e6cc0
[2583372.076054] Call Trace:
[2583372.076054] [<ffffffff8145998b>] ? __neigh_create+0x1eb/0x5d0
[2583372.076054] [<ffffffff8147f66f>] ? nf_hook_slow+0x7f/0x160
[2583372.076054] [<ffffffff8148afe0>] ? ip_fragment+0x870/0x870
[2583372.076054] [<ffffffff8148b747>] ? ip_finish_output+0x767/0x8d0
[2583372.076054] [<ffffffff8148cd42>] ? ip_send_skb+0x12/0x40
[2583372.076054] [<ffffffff814b2e9f>] ? udp_send_skb+0x10f/0x280
[2583372.076054] [<ffffffff81489770>] ? ip_setup_cork+0x130/0x130
[2583372.076054] [<ffffffff814b3a98>] ? udp_sendmsg+0x308/0x8a0
[2583372.076054] [<ffffffff814331ca>] ? sock_sendmsg+0xda/0xf0
[2583372.076054] [<ffffffff814b44d2>] ? udp_poll+0x22/0xb0
[2583372.076054] [<ffffffff811feb90>] ? ep_poll_readyevents_proc+0x30/0x30
[2583372.076054] [<ffffffff81433861>] ? SYSC_sendto+0x121/0x190
[2583372.076054] [<ffffffff810e0150>] ? SyS_futex+0x150/0x1c0
[2583372.076054] [<ffffffff8100b430>] ? xen_clocksource_read+0x20/0x30
[2583372.076054] [<ffffffff810d1c84>] ? __getnstimeofday+0x34/0xb0
[2583372.076054] [<ffffffff810d22ee>] ? getnstimeofday+0xe/0x30
[2583372.076054] [<ffffffff81549a6d>] ?
system_call_fast_compare_end+0x10/0x15
[2583372.076054] Code: 75 5b 8b 07 85 c0 75 23 ba ff 00 00 00 f0 0f b1 17 85
c0 75 16 0f 1f 40 00 66 83 47 04 01 c3 66 2e 0f 1f 84 00 00 00 00 00 f3 90
<8b> 17 84 d2 75 f8 89 d1 89 d0 83 c9 01 f0 0f b1 0f 39 d0 75 e9
[2583372.132054] BUG: soft lockup - CPU#4 stuck for 22s! [kworker/4:1:59]
[2583372.132056] BUG: soft lockup - CPU#3 stuck for 22s! [serf:27690]
[2583372.132056] Modules linked in: xt_multiport ip6table_filter ip6_tables
xt_tcpudp nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack iptable_filter
ip_tables x_tables nf_conntrack x86_pkg_temp_thermal thermal_sys coretemp
crct10dif_pclmul crct10dif_common crc32_pclmul ghash_clmulni_intel aesni_intel
aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd evdev pcspkr ext4 crc16
mbcache jbd2 xen_blkfront xen_netfront crc32c_intel
[2583372.132054] Modules linked in: xt_multiport ip6table_filter ip6_tables
xt_tcpudp nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack iptable_filter
ip_tables x_tables nf_conntrack x86_pkg_temp_thermal thermal_sys coretemp
crct10dif_pclmul crct10dif_common crc32_pclmul ghash_clmulni_intel aesni_intel
aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd evdev pcspkr ext4 crc16
mbcache jbd2 xen_blkfront xen_netfront crc32c_intel
[2583372.132054] CPU: 4 PID: 59 Comm: kworker/4:1 Not tainted
3.16.0-0.bpo.4-amd64 #1 Debian 3.16.7-ckt4-3~bpo70+1
[2583372.132054] Workqueue: events_power_efficient neigh_periodic_work
[2583372.132054] task: ffff8801f4da6ae0 ti: ffff8801f4e58000 task.ti:
ffff8801f4e58000
[2583372.132054] RIP: e030:[<ffffffff810b7043>] [<ffffffff810b7043>]
queue_write_lock_slowpath+0x83/0x90
[2583372.132054] RSP: e02b:ffff8801f4e5bdc0 EFLAGS: 00000a93
[2583372.132054] RAX: 000000000000c11c RBX: ffffffff818bdc1c RCX:
0000000000000008
[2583372.132054] RDX: 0000000000007ec0 RSI: 0000000000000200 RDI:
ffff8801f2783828
[2583372.132054] RBP: 00000000000000a4 R08: ffff8800fd2ed800 R09:
0000000000000000
[2583372.132054] R10: 0000000000000000 R11: 0000000000000000 R12:
ffff8801f2783800
[2583372.132054] R13: ffffffff818bdb30 R14: 0000000000000001 R15:
ffff8800fd2edd20
[2583372.132054] FS: 000000c2080ca4f0(0000) GS:ffff8801feb00000(0000)
knlGS:0000000000000000
[2583372.132054] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[2583372.132054] CR2: ffffffffff600400 CR3: 00000001f2aa7000 CR4:
0000000000002660
[2583372.132054] Stack:
[2583372.132054] ffffffff814582ab ffff88009558b480 ffff8801f4e23ac0
ffff8801feb12a00
[2583372.132054] ffff8801feb16800 0000000000000000 0000000000000000
ffffffff818bdb30
[2583372.132054] ffffffff8108891c 0000000000013200 ffff8801f4e5bfd8
0000000000013200
[2583372.132054] Call Trace:
[2583372.132054] [<ffffffff814582ab>] ? neigh_periodic_work+0xbb/0x1e0
[2583372.132054] [<ffffffff8108891c>] ? process_one_work+0x15c/0x450
[2583372.132054] [<ffffffff81089b72>] ? worker_thread+0x112/0x540
[2583372.132054] [<ffffffff81089a60>] ? create_and_start_worker+0x60/0x60
[2583372.132054] [<ffffffff81090541>] ? kthread+0xc1/0xe0
[2583372.132054] [<ffffffff81090480>] ? flush_kthread_worker+0xb0/0xb0
[2583372.132054] [<ffffffff815499bc>] ? ret_from_fork+0x7c/0xb0
[2583372.132054] [<ffffffff81090480>] ? flush_kthread_worker+0xb0/0xb0
[2583372.132054] Code: ff 00 00 00 eb 04 66 90 f3 90 8b 07 83 f8 01 75 f7 f0
0f b1 17 83 f8 01 75 ee eb bc 0f b7 47 04 66 39 d0 74 9c f3 90 0f b7 47 04
<66> 39 c2 75 f5 eb 8f 66 0f 1f 44 00 00 0f 1f 44 00 00 65 8b 04
[2583372.132056] CPU: 3 PID: 27690 Comm: serf Not tainted 3.16.0-0.bpo.4-amd64
#1 Debian 3.16.7-ckt4-3~bpo70+1
[2583372.132056] task: ffff8801f4517670 ti: ffff88013a134000 task.ti:
ffff88013a134000
[2583372.132056] RIP: e030:[<ffffffff810b7043>] [<ffffffff810b7043>]
queue_write_lock_slowpath+0x83/0x90
[2583372.132056] RSP: e02b:ffff88013a137bb0 EFLAGS: 00000202
[2583372.132056] RAX: 0000000000000007 RBX: 0000000000000001 RCX:
0000000000000000
[2583372.132056] RDX: 0000000000000009 RSI: ffffffff818bdc1c RDI:
ffffffff818bdc1c
[2583372.132056] RBP: 00000001264e5a85 R08: 0000000000000020 R09:
0000000000000001
[2583372.132056] R10: 000000000a6b3ceb R11: ffff88013a137b38 R12:
ffffffff818bda40
[2583372.132056] R13: ffff8800e8a2be00 R14: ffff8801f18f0000 R15:
ffff8801f3257200
[2583372.132056] FS: 000000c208019b70(0000) GS:ffff8801feac0000(0000)
knlGS:0000000000000000
[2583372.132056] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[2583372.132056] CR2: ffffffffff600400 CR3: 00000001f2aa7000 CR4:
0000000000002660
[2583372.132056] Stack:
[2583372.132056] ffffffff8145998b ffff8801f32572e8 ffff8801f32572e8
ffffffff000000b8
[2583372.132056] 0000000000000004 ffff88013a137c54 ffffffff818bdc1c
00ff8801f18f0000
[2583372.132056] ffffffff8147f66f ffffffff8148afe0 ffffffff80000000
ffffffff818e6cc0
[2583372.132056] Call Trace:
[2583372.132056] [<ffffffff8145998b>] ? __neigh_create+0x1eb/0x5d0
[2583372.132056] [<ffffffff8147f66f>] ? nf_hook_slow+0x7f/0x160
[2583372.132056] [<ffffffff8148afe0>] ? ip_fragment+0x870/0x870
[2583372.132056] [<ffffffff8148b747>] ? ip_finish_output+0x767/0x8d0
[2583372.132056] [<ffffffff8148baba>] ? ip_queue_xmit+0x12a/0x3b0
[2583372.132056] [<ffffffff814a278e>] ? tcp_transmit_skb+0x41e/0x900
[2583372.132056] [<ffffffff814a3522>] ? tcp_connect+0x7e2/0x930
[2583372.132056] [<ffffffff810d22ee>] ? getnstimeofday+0xe/0x30
[2583372.132056] [<ffffffff810d2321>] ? ktime_get_real+0x11/0x50
[2583372.132056] [<ffffffff814a81ce>] ? tcp_v4_connect+0x2ee/0x410
[2583372.132056] [<ffffffff814bf6d6>] ? __inet_stream_connect+0x1f6/0x350
[2583372.132056] [<ffffffff81549536>] ? _raw_spin_lock_irqsave+0x16/0x50
[2583372.132056] [<ffffffff814bfb95>] ? inet_stream_connect+0x45/0x70
[2583372.132056] [<ffffffff814339b8>] ? SYSC_connect+0xe8/0x100
[2583372.132056] [<ffffffff8100b430>] ? xen_clocksource_read+0x20/0x30
[2583372.132056] [<ffffffff8100b430>] ? xen_clocksource_read+0x20/0x30
[2583372.132056] [<ffffffff810d20a2>] ? ktime_get_ts+0x42/0xd0
[2583372.132056] [<ffffffff8108e841>] ? posix_ktime_get_ts+0x11/0x20
[2583372.132056] [<ffffffff8108fc10>] ? SyS_clock_gettime+0x40/0x70
[2583372.132056] [<ffffffff81549a6d>] ?
system_call_fast_compare_end+0x10/0x15
[2583372.132056] Code: ff 00 00 00 eb 04 66 90 f3 90 8b 07 83 f8 01 75 f7 f0
0f b1 17 83 f8 01 75 ee eb bc 0f b7 47 04 66 39 d0 74 9c f3 90 0f b7 47 04
<66> 39 c2 75 f5 eb 8f 66 0f 1f 44 00 00 0f 1f 44 00 00 65 8b 04
[2583382.724053] INFO: rcu_sched self-detected stall on CPU { 4} (t=3240063
jiffies g=258996215 c=258996214 q=4339034)
[2583382.724053] sending NMI to all CPUs:
[2583382.724053] NMI backtrace for cpu 4
[2583382.724053] CPU: 4 PID: 59 Comm: kworker/4:1 Not tainted
3.16.0-0.bpo.4-amd64 #1 Debian 3.16.7-ckt4-3~bpo70+1
[2583382.724053] Workqueue: events_power_efficient neigh_periodic_work
[2583382.724053] task: ffff8801f4da6ae0 ti: ffff8801f4e58000 task.ti:
ffff8801f4e58000
[2583382.724053] RIP: e030:[<ffffffff8100130a>] [<ffffffff8100130a>]
xen_hypercall_vcpu_op+0xa/0x20
[2583382.724053] RSP: e02b:ffff8801feb03c30 EFLAGS: 00000046
[2583382.724053] RAX: 0000000000000000 RBX: ffffffff818e03c0 RCX:
ffffffff8100130a
[2583382.724053] RDX: 0000000000000000 RSI: 0000000000000004 RDI:
000000000000000b
[2583382.724053] RBP: ffffffff818dff60 R08: ffffffff818dff60 R09:
0000000000000000
[2583382.724053] R10: 0000000000025f1b R11: 0000000000000246 R12:
0000000000000005
[2583382.724053] R13: 0000000000000004 R14: ffffffff818e0400 R15:
ffffffff818e0400
[2583382.724053] FS: 000000c2080ca4f0(0000) GS:ffff8801feb00000(0000)
knlGS:0000000000000000
[2583382.724053] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[2583382.724053] CR2: ffffffffff600400 CR3: 00000001f2aa7000 CR4:
0000000000002660
[2583382.724053] Stack:
[2583382.724053] 0000000000025f1a 0000000000000004 ffffffff8137daf3
ffffffff818dff60
[2583382.724053] ffffffff81011713 0000000000000004 0000000000000001
ffffffff81852480
[2583382.724053] 0000000000000004 ffffffff81852480 ffffffff8104b700
ffff8801feb0d5e0
[2583382.724053] Call Trace:
[2583382.724053] <IRQ>
[2583382.724053] [<ffffffff8137daf3>] ? xen_send_IPI_one+0x43/0x60
[2583382.724053] [<ffffffff81011713>] ? __xen_send_IPI_mask+0x33/0x60
[2583382.724053] [<ffffffff8104b700>] ?
arch_trigger_all_cpu_backtrace+0x120/0x130
[2583382.724053] [<ffffffff810d0210>] ? rcu_check_callbacks+0x410/0x680
[2583382.724053] [<ffffffff810ac382>] ? trigger_load_balance+0x52/0x210
[2583382.724053] [<ffffffff8107bd14>] ? update_process_times+0x44/0x80
[2583382.724053] [<ffffffff810db39f>] ? tick_sched_handle.isra.12+0x2f/0x70
[2583382.724053] [<ffffffff810db4ca>] ? tick_sched_timer+0x4a/0x80
[2583382.724053] [<ffffffff81093350>] ? __run_hrtimer+0x70/0x210
[2583382.724053] [<ffffffff810db480>] ? tick_nohz_handler+0xa0/0xa0
[2583382.724053] [<ffffffff81093bc1>] ? hrtimer_interrupt+0x101/0x260
[2583382.724053] [<ffffffff8100b2e8>] ? xen_timer_interrupt+0x28/0x150
[2583382.724053] [<ffffffff813b7b21>] ? add_interrupt_randomness+0x51/0x200
[2583382.724053] [<ffffffff810c4f54>] ? handle_irq_event_percpu+0x54/0x1e0
[2583382.724053] [<ffffffff810c891a>] ? handle_percpu_irq+0x4a/0x80
[2583382.724053] [<ffffffff810c473d>] ? generic_handle_irq+0x1d/0x30
[2583382.724053] [<ffffffff8137e51d>] ? evtchn_2l_handle_events+0x24d/0x260
[2583382.724053] [<ffffffff8137bdff>] ? __xen_evtchn_do_upcall+0x3f/0x70
[2583382.724053] [<ffffffff8137db3f>] ? xen_evtchn_do_upcall+0x2f/0x50
[2583382.724053] [<ffffffff8154b71e>] ? xen_do_hypervisor_callback+0x1e/0x30
[2583382.724053] <EOI>
[2583382.724053] [<ffffffff810b7043>] ? queue_write_lock_slowpath+0x83/0x90
[2583382.724053] [<ffffffff814582ab>] ? neigh_periodic_work+0xbb/0x1e0
[2583382.724053] [<ffffffff8108891c>] ? process_one_work+0x15c/0x450
[2583382.724053] [<ffffffff81089b72>] ? worker_thread+0x112/0x540
[2583382.724053] [<ffffffff81089a60>] ? create_and_start_worker+0x60/0x60
[2583382.724053] [<ffffffff81090541>] ? kthread+0xc1/0xe0
[2583382.724053] [<ffffffff81090480>] ? flush_kthread_worker+0xb0/0xb0
[2583382.724053] [<ffffffff815499bc>] ? ret_from_fork+0x7c/0xb0
[2583382.724053] [<ffffffff81090480>] ? flush_kthread_worker+0xb0/0xb0
[2583382.724053] Code: cc 51 41 53 50 b8 17 00 00 00 0f 05 5b 59 c3 cc cc cc
cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 18 00 00 00 0f 05
<41> 5b 59 c3 cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc
[2583382.724351] NMI backtrace for cpu 1
[2583382.724362] CPU: 1 PID: 0 Comm: swapper/1 Not tainted
3.16.0-0.bpo.4-amd64 #1 Debian 3.16.7-ckt4-3~bpo70+1
[2583382.724370] task: ffff8801f51c0a20 ti: ffff8801f51c8000 task.ti:
ffff8801f51c8000
[2583382.724376] RIP: e030:[<ffffffff810b7043>] [<ffffffff810b7043>]
queue_write_lock_slowpath+0x83/0x90
[2583382.724386] RSP: e02b:ffff8801fea43c00 EFLAGS: 00000202
[2583382.724391] RAX: 0000000000000007 RBX: 0000000000000001 RCX:
0000000000000000
[2583382.724398] RDX: 0000000000000008 RSI: ffffffff818bdc1c RDI:
ffffffff818bdc1c
[2583382.724404] RBP: 00000001264c55e3 R08: 000000000a6b3ca4 R09:
ffff8801fea43b88
[2583382.724409] R10: 000000000a6b3ca4 R11: ffff8801fea43b88 R12:
ffffffff818bda40
[2583382.724414] R13: ffff8800edb6d200 R14: ffff8801f4d98000 R15:
ffffffff818b7bc0
[2583382.724422] FS: 00007f9730008700(0000) GS:ffff8801fea40000(0000)
knlGS:0000000000000000
[2583382.724428] CS: e033 DS: 002b ES: 002b CR0: 000000008005003b
[2583382.724432] CR2: ffffffffff600400 CR3: 000000014478d000 CR4:
0000000000002660
[2583382.724438] Stack:
[2583382.724441] ffffffff8145998b ffff8800034a0700 ffff8800034a0700
ffffffff000000b7
[2583382.724449] 0000000000000004 ffff8801fea43ca4 ffffffff818bdc1c
00ff8801f4d98000
[2583382.724456] ffffffff8147f66f ffffffff8148afe0 ffffffff80000000
ffffffff818e6cc0
[2583382.724463] Call Trace:
[2583382.724467] <IRQ>
[2583382.724485] [<ffffffff8145998b>] ? __neigh_create+0x1eb/0x5d0
[2583382.724501] [<ffffffff8147f66f>] ? nf_hook_slow+0x7f/0x160
[2583382.724505] [<ffffffff8148afe0>] ? ip_fragment+0x870/0x870
[2583382.724509] [<ffffffff8148b747>] ? ip_finish_output+0x767/0x8d0
[2583382.724513] [<ffffffff8148cd42>] ? ip_send_skb+0x12/0x40
[2583382.724517] [<ffffffff814ba525>] ? icmp_send+0x445/0x520
[2583382.724521] [<ffffffff81093c0b>] ? hrtimer_interrupt+0x14b/0x260
[2583382.724525] [<ffffffff814583d0>] ? neigh_periodic_work+0x1e0/0x1e0
[2583382.724529] [<ffffffff81480efa>] ? ipv4_link_failure+0x1a/0x60
[2583382.724534] [<ffffffff814b716a>] ? arp_error_report+0x2a/0x40
[2583382.724539] [<ffffffff81457f4e>] ? neigh_invalidate+0x7e/0xf0
[2583382.724543] [<ffffffff81458562>] ? neigh_timer_handler+0x192/0x290
[2583382.724546] [<ffffffff814583d0>] ? neigh_periodic_work+0x1e0/0x1e0
[2583382.724552] [<ffffffff8107985c>] ? call_timer_fn+0x4c/0x150
[2583382.724556] [<ffffffff814583d0>] ? neigh_periodic_work+0x1e0/0x1e0
[2583382.724560] [<ffffffff8107b2c7>] ? run_timer_softirq+0x297/0x2e0
[2583382.724565] [<ffffffff81072c0e>] ? __do_softirq+0xde/0x2e0
[2583382.724569] [<ffffffff81073066>] ? irq_exit+0x86/0xb0
[2583382.724573] [<ffffffff8137db45>] ? xen_evtchn_do_upcall+0x35/0x50
[2583382.724578] [<ffffffff8154b71e>] ? xen_do_hypervisor_callback+0x1e/0x30
[2583382.724581] <EOI>
[2583382.724583] [<ffffffff810013aa>] ? xen_hypercall_sched_op+0xa/0x20
[2583382.724589] [<ffffffff810013aa>] ? xen_hypercall_sched_op+0xa/0x20
[2583382.724593] [<ffffffff8100b0ec>] ? xen_safe_halt+0xc/0x20
[2583382.724598] [<ffffffff8101f642>] ? default_idle+0x22/0xf0
[2583382.724602] [<ffffffff810b1818>] ? cpu_startup_entry+0x2e8/0x4b0
[2583382.724606] [<ffffffff8100b139>] ? xen_force_evtchn_callback+0x9/0x10
[2583382.724609] [<ffffffff8100ba12>] ? check_events+0x12/0x20
[2583382.724612] Code: ff 00 00 00 eb 04 66 90 f3 90 8b 07 83 f8 01 75 f7 f0
0f b1 17 83 f8 01 75 ee eb bc 0f b7 47 04 66 39 d0 74 9c f3 90 0f b7 47 04
<66> 39 c2 75 f5 eb 8f 66 0f 1f 44 00 00 0f 1f 44 00 00 65 8b 04
[2583382.724645] NMI backtrace for cpu 3
[2583382.724653] CPU: 3 PID: 27690 Comm: serf Not tainted 3.16.0-0.bpo.4-amd64
#1 Debian 3.16.7-ckt4-3~bpo70+1
[2583382.724658] task: ffff8801f4517670 ti: ffff88013a134000 task.ti:
ffff88013a134000
[2583382.724662] RIP: e030:[<ffffffff810b703f>] [<ffffffff810b703f>]
queue_write_lock_slowpath+0x7f/0x90
[2583382.724669] RSP: e02b:ffff88013a137bb0 EFLAGS: 00000202
[2583382.724672] RAX: 0000000000000007 RBX: 0000000000000001 RCX:
0000000000000000
[2583382.724675] RDX: 0000000000000009 RSI: ffffffff818bdc1c RDI:
ffffffff818bdc1c
[2583382.724678] RBP: 00000001264e5a85 R08: 0000000000000020 R09:
0000000000000001
[2583382.724682] R10: 000000000a6b3ceb R11: ffff88013a137b38 R12:
ffffffff818bda40
[2583382.724685] R13: ffff8800e8a2be00 R14: ffff8801f18f0000 R15:
ffff8801f3257200
[2583382.724690] FS: 000000c208019b70(0000) GS:ffff8801feac0000(0000)
knlGS:0000000000000000
[2583382.724695] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[2583382.724697] CR2: ffffffffff600400 CR3: 00000001f2aa7000 CR4:
0000000000002660
[2583382.724701] Stack:
[2583382.724703] ffffffff8145998b ffff8801f32572e8 ffff8801f32572e8
ffffffff000000b8
[2583382.724708] 0000000000000004 ffff88013a137c54 ffffffff818bdc1c
00ff8801f18f0000
[2583382.724712] ffffffff8147f66f ffffffff8148afe0 ffffffff80000000
ffffffff818e6cc0
[2583382.724717] Call Trace:
[2583382.724721] [<ffffffff8145998b>] ? __neigh_create+0x1eb/0x5d0
[2583382.724727] [<ffffffff8147f66f>] ? nf_hook_slow+0x7f/0x160
[2583382.724730] [<ffffffff8148afe0>] ? ip_fragment+0x870/0x870
[2583382.724734] [<ffffffff8148b747>] ? ip_finish_output+0x767/0x8d0
[2583382.724737] [<ffffffff8148baba>] ? ip_queue_xmit+0x12a/0x3b0
[2583382.724743] [<ffffffff814a278e>] ? tcp_transmit_skb+0x41e/0x900
[2583382.724747] [<ffffffff814a3522>] ? tcp_connect+0x7e2/0x930
[2583382.724752] [<ffffffff810d22ee>] ? getnstimeofday+0xe/0x30
[2583382.724756] [<ffffffff810d2321>] ? ktime_get_real+0x11/0x50
[2583382.724760] [<ffffffff814a81ce>] ? tcp_v4_connect+0x2ee/0x410
[2583382.724764] [<ffffffff814bf6d6>] ? __inet_stream_connect+0x1f6/0x350
[2583382.724768] [<ffffffff81549536>] ? _raw_spin_lock_irqsave+0x16/0x50
[2583382.724772] [<ffffffff814bfb95>] ? inet_stream_connect+0x45/0x70
[2583382.724777] [<ffffffff814339b8>] ? SYSC_connect+0xe8/0x100
[2583382.724782] [<ffffffff8100b430>] ? xen_clocksource_read+0x20/0x30
[2583382.724785] [<ffffffff8100b430>] ? xen_clocksource_read+0x20/0x30
[2583382.724790] [<ffffffff810d20a2>] ? ktime_get_ts+0x42/0xd0
[2583382.724794] [<ffffffff8108e841>] ? posix_ktime_get_ts+0x11/0x20
[2583382.724799] [<ffffffff8108fc10>] ? SyS_clock_gettime+0x40/0x70
[2583382.724802] [<ffffffff81549a6d>] ?
system_call_fast_compare_end+0x10/0x15
[2583382.724805] Code: d0 75 e9 ba ff 00 00 00 eb 04 66 90 f3 90 8b 07 83 f8
01 75 f7 f0 0f b1 17 83 f8 01 75 ee eb bc 0f b7 47 04 66 39 d0 74 9c f3 90
<0f> b7 47 04 66 39 c2 75 f5 eb 8f 66 0f 1f 44 00 00 0f 1f 44 00
[2583382.724838] NMI backtrace for cpu 0
[2583382.724846] CPU: 0 PID: 27713 Comm: serf Not tainted 3.16.0-0.bpo.4-amd64
#1 Debian 3.16.7-ckt4-3~bpo70+1
[2583382.724851] task: ffff8800edbf2b60 ti: ffff8800f4db8000 task.ti:
ffff8800f4db8000
[2583382.724855] RIP: e030:[<ffffffff810b7004>] [<ffffffff810b7004>]
queue_write_lock_slowpath+0x44/0x90
[2583382.724863] RSP: e02b:ffff8800f4dbbb00 EFLAGS: 00000286
[2583382.724866] RAX: 00000000000000ff RBX: 0000000000000001 RCX:
0000000000000000
[2583382.724869] RDX: 00000000000000ff RSI: ffffffff818bdc1c RDI:
ffffffff818bdc1c
[2583382.724872] RBP: 00000001264c3d6c R08: 0000000000000020 R09:
0000000000000001
[2583382.724875] R10: 000000000a6b3c82 R11: ffff8800f4dbba88 R12:
ffffffff818bda40
[2583382.724879] R13: ffff8801f26a4e00 R14: ffff8801f18f0000 R15:
0000000000000059
[2583382.724884] FS: 000000c208049270(0000) GS:ffff8801fea00000(0000)
knlGS:0000000000000000
[2583382.724888] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[2583382.724890] CR2: 00007f9736adb000 CR3: 00000001f2aa7000 CR4:
0000000000002660
[2583382.724894] Stack:
[2583382.724896] ffffffff8145998b ffff880004156a00 ffff880004156a00
ffffffff000000b6
[2583382.724901] 0000000000000004 ffff8800f4dbbba4 ffffffff818bdc1c
00ff8801f18f0000
[2583382.724905] ffffffff8147f66f ffffffff8148afe0 ffffffff80000000
ffffffff818e6cc0
[2583382.724909] Call Trace:
[2583382.724913] [<ffffffff8145998b>] ? __neigh_create+0x1eb/0x5d0
[2583382.724918] [<ffffffff8147f66f>] ? nf_hook_slow+0x7f/0x160
[2583382.724921] [<ffffffff8148afe0>] ? ip_fragment+0x870/0x870
[2583382.724925] [<ffffffff8148b747>] ? ip_finish_output+0x767/0x8d0
[2583382.724929] [<ffffffff8148cd42>] ? ip_send_skb+0x12/0x40
[2583382.724933] [<ffffffff814b2e9f>] ? udp_send_skb+0x10f/0x280
[2583382.724936] [<ffffffff81489770>] ? ip_setup_cork+0x130/0x130
[2583382.724940] [<ffffffff814b3a98>] ? udp_sendmsg+0x308/0x8a0
[2583382.724945] [<ffffffff814331ca>] ? sock_sendmsg+0xda/0xf0
[2583382.724949] [<ffffffff814b44d2>] ? udp_poll+0x22/0xb0
[2583382.724954] [<ffffffff811feb90>] ? ep_poll_readyevents_proc+0x30/0x30
[2583382.724957] [<ffffffff81433861>] ? SYSC_sendto+0x121/0x190
[2583382.724963] [<ffffffff810e0150>] ? SyS_futex+0x150/0x1c0
[2583382.724966] [<ffffffff8100b430>] ? xen_clocksource_read+0x20/0x30
[2583382.724970] [<ffffffff810d1c84>] ? __getnstimeofday+0x34/0xb0
[2583382.724974] [<ffffffff810d22ee>] ? getnstimeofday+0xe/0x30
[2583382.724978] [<ffffffff81549a6d>] ?
system_call_fast_compare_end+0x10/0x15
[2583382.724981] Code: 8b 07 85 c0 75 23 ba ff 00 00 00 f0 0f b1 17 85 c0 75
16 0f 1f 40 00 66 83 47 04 01 c3 66 2e 0f 1f 84 00 00 00 00 00 f3 90 8b 17
<84> d2 75 f8 89 d1 89 d0 83 c9 01 f0 0f b1 0f 39 d0 75 e9 ba ff
[2583382.725011] NMI backtrace for cpu 2
[2583382.725020] CPU: 2 PID: 0 Comm: swapper/2 Not tainted
3.16.0-0.bpo.4-amd64 #1 Debian 3.16.7-ckt4-3~bpo70+1
[2583382.725027] task: ffff8801f51c00d0 ti: ffff8801f51ec000 task.ti:
ffff8801f51ec000
[2583382.725033] RIP: e030:[<ffffffff810013aa>] [<ffffffff810013aa>]
xen_hypercall_sched_op+0xa/0x20
[2583382.725041] RSP: e02b:ffff8801f51efe80 EFLAGS: 00000246
[2583382.725045] RAX: 0000000000000000 RBX: ffffffff818e03c0 RCX:
ffffffff810013aa
[2583382.725050] RDX: ffff8801fea80000 RSI: 0000000000000000 RDI:
0000000000000001
[2583382.725055] RBP: 0000000000000000 R08: 0000000000000000 R09:
0000000000000000
[2583382.725060] R10: 0000000000000001 R11: 0000000000000246 R12:
0000000000000002
[2583382.725065] R13: ffff8801f51ec000 R14: 0000000000000000 R15:
ffff8801f51ec000
[2583382.725072] FS: 00007f9730008700(0000) GS:ffff8801fea80000(0000)
knlGS:0000000000000000
[2583382.725078] CS: e033 DS: 002b ES: 002b CR0: 000000008005003b
[2583382.725081] CR2: ffffffffff600400 CR3: 00000000954b3000 CR4:
0000000000002660
[2583382.725086] Stack:
[2583382.728059] 00000001267dad6c ffffffff81853f20 ffffffff8100b0ec
ffffffff8101f642
[2583382.728059] 0000000000000000 ffffffff818e03c0 0000000000000000
00000000ffffffed
[2583382.728059] ffff8801f51ec000 ffffffff810b1818 000000000000000a
ffffffff8100b139
[2583382.728059] Call Trace:
[2583382.728059] [<ffffffff8100b0ec>] ? xen_safe_halt+0xc/0x20
[2583382.728059] [<ffffffff8101f642>] ? default_idle+0x22/0xf0
[2583382.728059] [<ffffffff810b1818>] ? cpu_startup_entry+0x2e8/0x4b0
[2583382.728059] [<ffffffff8100b139>] ? xen_force_evtchn_callback+0x9/0x10
[2583382.728059] [<ffffffff8100ba12>] ? check_events+0x12/0x20
[2583382.728059] Code: cc 51 41 53 b8 1c 00 00 00 0f 05 41 5b 59 c3 cc cc cc
cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 1d 00 00 00 0f 05
<41> 5b 59 c3 cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc
[2583382.728055] NMI backtrace for cpu 6
[2583382.728055] CPU: 6 PID: 0 Comm: swapper/6 Not tainted
3.16.0-0.bpo.4-amd64 #1 Debian 3.16.7-ckt4-3~bpo70+1
[2583382.728055] task: ffff8801f52013f0 ti: ffff8801f5204000 task.ti:
ffff8801f5204000
[2583382.728055] RIP: e030:[<ffffffff810013aa>] [<ffffffff810013aa>]
xen_hypercall_sched_op+0xa/0x20
[2583382.924527] RSP: e02b:ffff8801f5207e80 EFLAGS: 00000246
[2583382.924527] RAX: 0000000000000000 RBX: ffffffff818e03c0 RCX:
ffffffff810013aa
[2583382.924527] RDX: ffff8801feb80000 RSI: 0000000000000000 RDI:
0000000000000001
[2583382.924542] INFO: rcu_sched detected stalls on CPUs/tasks: { 4} (detected
by 2, t=3240113 jiffies, g=258996215, c=258996214, q=4339034)
[2583382.924527] RBP: 0000000000000000 R08: 0000000000000000 R09:
0000000000000000
[2583382.924527] R10: 0000000000000001 R11: 0000000000000246 R12:
0000000000000006
[2583382.924527] R13: ffff8801f5204000 R14: 0000000000000000 R15:
ffff8801f5204000
[2583382.924527] FS: 00007f9730008700(0000) GS:ffff8801feb80000(0000)
knlGS:0000000000000000
[2583382.924527] CS: e033 DS: 002b ES: 002b CR0: 000000008005003b
[2583382.924527] CR2: ffffffffff600400 CR3: 000000000351d000 CR4:
0000000000002660
[2583382.924527] Stack:
[2583382.924527] 00000001267dadbb ffffffff81853f20 ffffffff8100b0ec
ffffffff8101f642
[2583382.924527] 0000000000000000 ffffffff818e03c0 0000000000000000
00000000ffffffed
[2583382.924527] ffff8801f5204000 ffffffff810b1818 000000000000000a
ffffffff8100b139
[2583382.924527] Call Trace:
[2583382.924527] [<ffffffff8100b0ec>] ? xen_safe_halt+0xc/0x20
[2583382.924527] [<ffffffff8101f642>] ? default_idle+0x22/0xf0
[2583382.924527] [<ffffffff810b1818>] ? cpu_startup_entry+0x2e8/0x4b0
[2583382.924527] [<ffffffff8100b139>] ? xen_force_evtchn_callback+0x9/0x10
[2583382.924527] [<ffffffff8100ba12>] ? check_events+0x12/0x20
[2583382.924527] Code: cc 51 41 53 b8 1c 00 00 00 0f 05 41 5b 59 c3 cc cc cc
cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 1d 00 00 00 0f 05
<41> 5b 59 c3 cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc
[2583382.924518] NMI backtrace for cpu 5
[2583382.924518] CPU: 5 PID: 0 Comm: swapper/5 Not tainted
3.16.0-0.bpo.4-amd64 #1 Debian 3.16.7-ckt4-3~bpo70+1
[2583382.924518] task: ffff8801f51ea110 ti: ffff8801f51fc000 task.ti:
ffff8801f51fc000
[2583382.924518] RIP: e030:[<ffffffff810013aa>] [<ffffffff810013aa>]
xen_hypercall_sched_op+0xa/0x20
[2583382.924518] RSP: e02b:ffff8801f51ffe80 EFLAGS: 00000246
[2583382.924518] RAX: 0000000000000000 RBX: ffffffff818e03c0 RCX:
ffffffff810013aa
[2583382.924518] RDX: ffff8801feb40000 RSI: 0000000000000000 RDI:
0000000000000001
[2583382.924518] RBP: 0000000000000000 R08: 0000000000000000 R09:
0000000000000000
[2583382.924518] R10: 0000000000000001 R11: 0000000000000246 R12:
0000000000000005
[2583382.924518] R13: ffff8801f51fc000 R14: 0000000000000000 R15:
ffff8801f51fc000
[2583382.924518] FS: 00007f9730008700(0000) GS:ffff8801feb40000(0000)
knlGS:0000000000000000
[2583382.924518] CS: e033 DS: 002b ES: 002b CR0: 000000008005003b
[2583382.924518] CR2: ffffffffff600400 CR3: 0000000003adf000 CR4:
0000000000002660
[2583382.924518] Stack:
[2583382.924518] 00000001267dad99 ffffffff81853f20 ffffffff8100b0ec
ffffffff8101f642
[2583382.924518] 0000000000000000 ffffffff818e03c0 0000000000000000
00000000ffffffed
[2583382.924518] ffff8801f51fc000 ffffffff810b1818 000000000000000a
ffffffff8100b139
[2583382.924518] Call Trace:
[2583382.924518] [<ffffffff8100b0ec>] ? xen_safe_halt+0xc/0x20
[2583382.924518] [<ffffffff8101f642>] ? default_idle+0x22/0xf0
[2583382.924518] [<ffffffff810b1818>] ? cpu_startup_entry+0x2e8/0x4b0
[2583382.924518] [<ffffffff8100b139>] ? xen_force_evtchn_callback+0x9/0x10
[2583382.924518] [<ffffffff8100ba12>] ? check_events+0x12/0x20
[2583382.924518] Code: cc 51 41 53 b8 1c 00 00 00 0f 05 41 5b 59 c3 cc cc cc
cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 1d 00 00 00 0f 05
<41> 5b 59 c3 cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc
[2583382.924529] NMI backtrace for cpu 7
[2583382.924529] CPU: 7 PID: 0 Comm: swapper/7 Not tainted
3.16.0-0.bpo.4-amd64 #1 Debian 3.16.7-ckt4-3~bpo70+1
[2583382.924529] task: ffff8801f5200aa0 ti: ffff8801f5208000 task.ti:
ffff8801f5208000
[2583382.924529] RIP: e030:[<ffffffff810013aa>] [<ffffffff810013aa>]
xen_hypercall_sched_op+0xa/0x20
[2583382.924529] RSP: e02b:ffff8801f520be80 EFLAGS: 00000246
[2583382.924529] RAX: 0000000000000000 RBX: ffffffff818e03c0 RCX:
ffffffff810013aa
[2583382.924529] RDX: ffff8801febc0000 RSI: 0000000000000000 RDI:
0000000000000001
[2583382.924529] RBP: 0000000000000000 R08: 0000000000000000 R09:
0000000000000000
[2583382.924529] R10: 0000000000000001 R11: 0000000000000246 R12:
0000000000000007
[2583382.924529] R13: ffff8801f5208000 R14: 0000000000000000 R15:
ffff8801f5208000
[2583382.924529] FS: 00007f9730008700(0000) GS:ffff8801febc0000(0000)
knlGS:0000000000000000
[2583382.924529] CS: e033 DS: 002b ES: 002b CR0: 000000008005003b
[2583382.924529] CR2: ffffffffff600400 CR3: 00000001f35fa000 CR4:
0000000000002660
[2583382.924529] Stack:
[2583382.924529] 00000001267dad91 ffffffff81853f20 ffffffff8100b0ec
ffffffff8101f642
[2583382.924529] 0000000000000000 ffffffff818e03c0 0000000000000000
00000000ffffffed
[2583382.924529] ffff8801f5208000 ffffffff810b1818 000000000000000a
ffffffff8100b139
[2583382.924529] Call Trace:
[2583382.924529] [<ffffffff8100b0ec>] ? xen_safe_halt+0xc/0x20
[2583382.924529] [<ffffffff8101f642>] ? default_idle+0x22/0xf0
[2583382.924529] [<ffffffff810b1818>] ? cpu_startup_entry+0x2e8/0x4b0
[2583382.924529] [<ffffffff8100b139>] ? xen_force_evtchn_callback+0x9/0x10
[2583382.924529] [<ffffffff8100ba12>] ? check_events+0x12/0x20
[2583382.924529] Code: cc 51 41 53 b8 1c 00 00 00 0f 05 41 5b 59 c3 cc cc cc
cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 1d 00 00 00 0f 05
<41> 5b 59 c3 cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc
[2583408.076053] BUG: soft lockup - CPU#0 stuck for 23s! [serf:27713]
[2583408.076053] Modules linked in: xt_multiport ip6table_filter ip6_tables
xt_tcpudp nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack iptable_filter
ip_tables x_tables nf_conntrack x86_pkg_temp_thermal thermal_sys coretemp
crct10dif_pclmul crct10dif_common crc32_pclmul ghash_clmulni_intel aesni_intel
aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd evdev pcspkr ext4 crc16
mbcache jbd2 xen_blkfront xen_netfront crc32c_intel
[2583408.076053] CPU: 0 PID: 27713 Comm: serf Not tainted 3.16.0-0.bpo.4-amd64
#1 Debian 3.16.7-ckt4-3~bpo70+1
[2583408.076053] task: ffff8800edbf2b60 ti: ffff8800f4db8000 task.ti:
ffff8800f4db8000
[2583408.076053] RIP: e030:[<ffffffff810b7002>] [<ffffffff810b7002>]
queue_write_lock_slowpath+0x42/0x90
[2583408.076053] RSP: e02b:ffff8800f4dbbb00 EFLAGS: 00000286
[2583408.076053] RAX: 00000000000000ff RBX: 0000000000000001 RCX:
0000000000000000
[2583408.076053] RDX: 00000000000000ff RSI: ffffffff818bdc1c RDI:
ffffffff818bdc1c
[2583408.076053] RBP: 00000001264c3d6c R08: 0000000000000020 R09:
0000000000000001
[2583408.076053] R10: 000000000a6b3c82 R11: ffff8800f4dbba88 R12:
ffffffff818bda40
[2583408.076053] R13: ffff8801f26a4e00 R14: ffff8801f18f0000 R15:
0000000000000059
[2583408.076053] FS: 000000c208049270(0000) GS:ffff8801fea00000(0000)
knlGS:0000000000000000
[2583408.076053] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[2583408.076053] CR2: 00007f9736adb000 CR3: 00000001f2aa7000 CR4:
0000000000002660
[2583408.076053] Stack:
[2583408.076053] ffffffff8145998b ffff880004156a00 ffff880004156a00
ffffffff000000b6
[2583408.076053] 0000000000000004 ffff8800f4dbbba4 ffffffff818bdc1c
00ff8801f18f0000
[2583408.076053] ffffffff8147f66f ffffffff8148afe0 ffffffff80000000
ffffffff818e6cc0
[2583408.076053] Call Trace:
[2583408.076053] [<ffffffff8145998b>] ? __neigh_create+0x1eb/0x5d0
[2583408.076053] [<ffffffff8147f66f>] ? nf_hook_slow+0x7f/0x160
[2583408.076053] [<ffffffff8148afe0>] ? ip_fragment+0x870/0x870
[2583408.076053] [<ffffffff8148b747>] ? ip_finish_output+0x767/0x8d0
[2583408.076053] [<ffffffff8148cd42>] ? ip_send_skb+0x12/0x40
[2583408.076053] [<ffffffff814b2e9f>] ? udp_send_skb+0x10f/0x280
[2583408.076053] [<ffffffff81489770>] ? ip_setup_cork+0x130/0x130
[2583408.076053] [<ffffffff814b3a98>] ? udp_sendmsg+0x308/0x8a0
[2583408.076053] [<ffffffff814331ca>] ? sock_sendmsg+0xda/0xf0
[2583408.076053] [<ffffffff814b44d2>] ? udp_poll+0x22/0xb0
[2583408.076053] [<ffffffff811feb90>] ? ep_poll_readyevents_proc+0x30/0x30
[2583408.076053] [<ffffffff81433861>] ? SYSC_sendto+0x121/0x190
[2583408.076053] [<ffffffff810e0150>] ? SyS_futex+0x150/0x1c0
[2583408.076053] [<ffffffff8100b430>] ? xen_clocksource_read+0x20/0x30
[2583408.076053] [<ffffffff810d1c84>] ? __getnstimeofday+0x34/0xb0
[2583408.076053] [<ffffffff810d22ee>] ? getnstimeofday+0xe/0x30
[2583408.076053] [<ffffffff81549a6d>] ?
system_call_fast_compare_end+0x10/0x15
[2583408.076053] Code: 75 5b 8b 07 85 c0 75 23 ba ff 00 00 00 f0 0f b1 17 85
c0 75 16 0f 1f 40 00 66 83 47 04 01 c3 66 2e 0f 1f 84 00 00 00 00 00 f3 90
<8b> 17 84 d2 75 f8 89 d1 89 d0 83 c9 01 f0 0f b1 0f 39 d0 75 e9
[2583408.132055] BUG: soft lockup - CPU#3 stuck for 23s! [serf:27690]
[2583408.132057] BUG: soft lockup - CPU#4 stuck for 23s! [kworker/4:1:59]
[2583408.132057] Modules linked in: xt_multiport ip6table_filter ip6_tables
xt_tcpudp nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack iptable_filter
ip_tables x_tables nf_conntrack x86_pkg_temp_thermal thermal_sys coretemp
crct10dif_pclmul crct10dif_common crc32_pclmul ghash_clmulni_intel aesni_intel
aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd evdev pcspkr ext4 crc16
mbcache[2583408.132055] Modules linked in: xt_multiport ip6table_filter
ip6_tables xt_tcpudp nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack
iptable_filter ip_tables x_tables nf_conntrack x86_pkg_temp_thermal
thermal_sys coretemp crct10dif_pclmul crct10dif_common crc32_pclmul
ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper
ablk_helper cryptd evdev pcspkr ext4 crc16 mbcache jbd2 xen_blkfront
xen_netfront crc32c_intel
[2583408.132055] CPU: 3 PID: 27690 Comm: serf Not tainted 3.16.0-0.bpo.4-amd64
#1 Debian 3.16.7-ckt4-3~bpo70+1
[2583408.132055] task: ffff8801f4517670 ti: ffff88013a134000 task.ti:
ffff88013a134000
[2583408.132055] RIP: e030:[<ffffffff810b7043>] [<ffffffff810b7043>]
queue_write_lock_slowpath+0x83/0x90
[2583408.132055] RSP: e02b:ffff88013a137bb0 EFLAGS: 00000202
[2583408.132055] RAX: 0000000000000007 RBX: 0000000000000001 RCX:
0000000000000000
[2583408.132055] RDX: 0000000000000009 RSI: ffffffff818bdc1c RDI:
ffffffff818bdc1c
[2583408.132055] RBP: 00000001264e5a85 R08: 0000000000000020 R09:
0000000000000001
[2583408.132055] R10: 000000000a6b3ceb R11: ffff88013a137b38 R12:
ffffffff818bda40
[2583408.132055] R13: ffff8800e8a2be00 R14: ffff8801f18f0000 R15:
ffff8801f3257200
[2583408.132055] FS: 000000c208019b70(0000) GS:ffff8801feac0000(0000)
knlGS:0000000000000000
[2583408.132055] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[2583408.132055] CR2: ffffffffff600400 CR3: 00000001f2aa7000 CR4:
0000000000002660
[2583408.132055] Stack:
[2583408.132055] ffffffff8145998b ffff8801f32572e8 ffff8801f32572e8
ffffffff000000b8
[2583408.132055] 0000000000000004 ffff88013a137c54 ffffffff818bdc1c
00ff8801f18f0000
[2583408.132055] ffffffff8147f66f ffffffff8148afe0 ffffffff80000000
ffffffff818e6cc0
[2583408.132055] Call Trace:
[2583408.132055] [<ffffffff8145998b>] ? __neigh_create+0x1eb/0x5d0
[2583408.132055] [<ffffffff8147f66f>] ? nf_hook_slow+0x7f/0x160
[2583408.132055] [<ffffffff8148afe0>] ? ip_fragment+0x870/0x870
[2583408.132055] [<ffffffff8148b747>] ? ip_finish_output+0x767/0x8d0
[2583408.132055] [<ffffffff8148baba>] ? ip_queue_xmit+0x12a/0x3b0
[2583408.132055] [<ffffffff814a278e>] ? tcp_transmit_skb+0x41e/0x900
[2583408.132055] [<ffffffff814a3522>] ? tcp_connect+0x7e2/0x930
[2583408.132055] [<ffffffff810d22ee>] ? getnstimeofday+0xe/0x30
[2583408.132055] [<ffffffff810d2321>] ? ktime_get_real+0x11/0x50
[2583408.132055] [<ffffffff814a81ce>] ? tcp_v4_connect+0x2ee/0x410
[2583408.132055] [<ffffffff814bf6d6>] ? __inet_stream_connect+0x1f6/0x350
[2583408.132055] [<ffffffff81549536>] ? _raw_spin_lock_irqsave+0x16/0x50
[2583408.132055] [<ffffffff814bfb95>] ? inet_stream_connect+0x45/0x70
[2583408.132055] [<ffffffff814339b8>] ? SYSC_connect+0xe8/0x100
[2583408.132055] [<ffffffff8100b430>] ? xen_clocksource_read+0x20/0x30
[2583408.132055] [<ffffffff8100b430>] ? xen_clocksource_read+0x20/0x30
[2583408.132055] [<ffffffff810d20a2>] ? ktime_get_ts+0x42/0xd0
[2583408.132055] [<ffffffff8108e841>] ? posix_ktime_get_ts+0x11/0x20
[2583408.132055] [<ffffffff8108fc10>] ? SyS_clock_gettime+0x40/0x70
[2583408.132055] [<ffffffff81549a6d>] ?
system_call_fast_compare_end+0x10/0x15
[2583408.132055] Code: ff 00 00 00 eb 04 66 90 f3 90 8b 07 83 f8 01 75 f7 f0
0f b1 17 83 f8 01 75 ee eb bc 0f b7 47 04 66 39 d0 74 9c f3 90 0f b7 47 04
<66> 39 c2 75 f5 eb 8f 66 0f 1f 44 00 00 0f 1f 44 00 00 65 8b 04
[2583408.132057] jbd2 xen_blkfront xen_netfront crc32c_intel
[2583408.132057] CPU: 4 PID: 59 Comm: kworker/4:1 Not tainted
3.16.0-0.bpo.4-amd64 #1 Debian 3.16.7-ckt4-3~bpo70+1
[2583408.132057] Workqueue: events_power_efficient neigh_periodic_work
[2583408.132057] task: ffff8801f4da6ae0 ti: ffff8801f4e58000 task.ti:
ffff8801f4e58000
[2583408.132057] RIP: e030:[<ffffffff810b703d>] [<ffffffff810b703d>]
queue_write_lock_slowpath+0x7d/0x90
[2583408.132057] RSP: e02b:ffff8801f4e5bdc0 EFLAGS: 00000a93
[2583408.132057] RAX: 000000000000c11c RBX: ffffffff818bdc1c RCX:
0000000000000008
[2583408.132057] RDX: 0000000000007ec0 RSI: 0000000000000200 RDI:
ffff8801f2783828
[2583408.132057] RBP: 00000000000000a4 R08: ffff8800fd2ed800 R09:
0000000000000000
[2583408.132057] R10: 0000000000000000 R11: 0000000000000000 R12:
ffff8801f2783800
[2583408.132057] R13: ffffffff818bdb30 R14: 0000000000000001 R15:
ffff8800fd2edd20
[2583408.132057] FS: 000000c2080ca4f0(0000) GS:ffff8801feb00000(0000)
knlGS:0000000000000000
[2583408.132057] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[2583408.132057] CR2: ffffffffff600400 CR3: 00000001f2aa7000 CR4:
0000000000002660
[2583408.132057] Stack:
[2583408.132057] ffffffff814582ab ffff88009558b480 ffff8801f4e23ac0
ffff8801feb12a00
[2583408.132057] ffff8801feb16800 0000000000000000 0000000000000000
ffffffff818bdb30
[2583408.132057] ffffffff8108891c 0000000000013200 ffff8801f4e5bfd8
0000000000013200
[2583408.132057] Call Trace:
[2583408.132057] [<ffffffff814582ab>] ? neigh_periodic_work+0xbb/0x1e0
[2583408.132057] [<ffffffff8108891c>] ? process_one_work+0x15c/0x450
[2583408.132057] [<ffffffff81089b72>] ? worker_thread+0x112/0x540
[2583408.132057] [<ffffffff81089a60>] ? create_and_start_worker+0x60/0x60
[2583408.132057] [<ffffffff81090541>] ? kthread+0xc1/0xe0
[2583408.132057] [<ffffffff81090480>] ? flush_kthread_worker+0xb0/0xb0
[2583408.132057] [<ffffffff815499bc>] ? ret_from_fork+0x7c/0xb0
[2583408.132057] [<ffffffff81090480>] ? flush_kthread_worker+0xb0/0xb0
[2583408.132057] Code: 0f 39 d0 75 e9 ba ff 00 00 00 eb 04 66 90 f3 90 8b 07
83 f8 01 75 f7 f0 0f b1 17 83 f8 01 75 ee eb bc 0f b7 47 04 66 39 d0 74 9c
<f3> 90 0f b7 47 04 66 39 c2 75 f5 eb 8f 66 0f 1f 44 00 00 0f 1f
[2583436.076052] BUG: soft lockup - CPU#0 stuck for 23s! [serf:27713]
[2583436.076052] Modules linked in: xt_multiport ip6table_filter ip6_tables
xt_tcpudp nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack iptable_filter
ip_tables x_tables nf_conntrack x86_pkg_temp_thermal thermal_sys coretemp
crct10dif_pclmul crct10dif_common crc32_pclmul ghash_clmulni_intel aesni_intel
aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd evdev pcspkr ext4 crc16
mbcache jbd2 xen_blkfront xen_netfront crc32c_intel
[2583436.076052] CPU: 0 PID: 27713 Comm: serf Not tainted 3.16.0-0.bpo.4-amd64
#1 Debian 3.16.7-ckt4-3~bpo70+1
[2583436.076052] task: ffff8800edbf2b60 ti: ffff8800f4db8000 task.ti:
ffff8800f4db8000
[2583436.076052] RIP: e030:[<ffffffff810b7004>] [<ffffffff810b7004>]
queue_write_lock_slowpath+0x44/0x90
[2583436.076052] RSP: e02b:ffff8800f4dbbb00 EFLAGS: 00000286
[2583436.076052] RAX: 00000000000000ff RBX: 0000000000000001 RCX:
0000000000000000
[2583436.076052] RDX: 00000000000000ff RSI: ffffffff818bdc1c RDI:
ffffffff818bdc1c
[2583436.076052] RBP: 00000001264c3d6c R08: 0000000000000020 R09:
0000000000000001
[2583436.076052] R10: 000000000a6b3c82 R11: ffff8800f4dbba88 R12:
ffffffff818bda40
[2583436.076052] R13: ffff8801f26a4e00 R14: ffff8801f18f0000 R15:
0000000000000059
[2583436.076052] FS: 000000c208049270(0000) GS:ffff8801fea00000(0000)
knlGS:0000000000000000
[2583436.076052] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[2583436.076052] CR2: 00007f9736adb000 CR3: 00000001f2aa7000 CR4:
0000000000002660
[2583436.076052] Stack:
[2583436.076052] ffffffff8145998b ffff880004156a00 ffff880004156a00
ffffffff000000b6
[2583436.076052] 0000000000000004 ffff8800f4dbbba4 ffffffff818bdc1c
00ff8801f18f0000
[2583436.076052] ffffffff8147f66f ffffffff8148afe0 ffffffff80000000
ffffffff818e6cc0
[2583436.076052] Call Trace:
[2583436.076052] [<ffffffff8145998b>] ? __neigh_create+0x1eb/0x5d0
[2583436.076052] [<ffffffff8147f66f>] ? nf_hook_slow+0x7f/0x160
[2583436.076052] [<ffffffff8148afe0>] ? ip_fragment+0x870/0x870
[2583436.076052] [<ffffffff8148b747>] ? ip_finish_output+0x767/0x8d0
[2583436.076052] [<ffffffff8148cd42>] ? ip_send_skb+0x12/0x40
[2583436.076052] [<ffffffff814b2e9f>] ? udp_send_skb+0x10f/0x280
[2583436.076052] [<ffffffff81489770>] ? ip_setup_cork+0x130/0x130
[2583436.076052] [<ffffffff814b3a98>] ? udp_sendmsg+0x308/0x8a0
[2583436.076052] [<ffffffff814331ca>] ? sock_sendmsg+0xda/0xf0
[2583436.076052] [<ffffffff814b44d2>] ? udp_poll+0x22/0xb0
[2583436.076052] [<ffffffff811feb90>] ? ep_poll_readyevents_proc+0x30/0x30
[2583436.076052] [<ffffffff81433861>] ? SYSC_sendto+0x121/0x190
[2583436.076052] [<ffffffff810e0150>] ? SyS_futex+0x150/0x1c0
[2583436.076052] [<ffffffff8100b430>] ? xen_clocksource_read+0x20/0x30
[2583436.076052] [<ffffffff810d1c84>] ? __getnstimeofday+0x34/0xb0
[2583436.076052] [<ffffffff810d22ee>] ? getnstimeofday+0xe/0x30
[2583436.076052] [<ffffffff81549a6d>] ?
system_call_fast_compare_end+0x10/0x15
[2583436.076052] Code: 8b 07 85 c0 75 23 ba ff 00 00 00 f0 0f b1 17 85 c0 75
16 0f 1f 40 00 66 83 47 04 01 c3 66 2e 0f 1f 84 00 00 00 00 00 f3 90 8b 17
<84> d2 75 f8 89 d1 89 d0 83 c9 01 f0 0f b1 0f 39 d0 75 e9 ba ff
[2583436.132051] BUG: soft lockup - CPU#3 stuck for 22s! [serf:27690]
[2583436.132053] BUG: soft lockup - CPU#4 stuck for 22s! [kworker/4:1:59]
[2583436.132053] Modules linked in: xt_multiport ip6table_filter ip6_tables
xt_tcpudp nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack iptable_filter
ip_tables x_tables nf_conntrack x86_pkg_temp_thermal thermal_sys coretemp
crct10dif_pclmul crct10dif_common crc32_pclmul ghash_clmulni_intel aesni_intel
aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd evdev pcspkr ext4 crc16
mbcache jbd2 xen_blkfront xen_netfront crc32c_intel[2583436.132051] Modules
linked in: xt_multiport ip6table_filter ip6_tables xt_tcpudp nf_conntrack_ipv4
nf_defrag_ipv4 xt_conntrack iptable_filter ip_tables x_tables nf_conntrack
x86_pkg_temp_thermal thermal_sys coretemp crct10dif_pclmul crct10dif_common
crc32_pclmul ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul
glue_helper ablk_helper cryptd evdev pcspkr ext4 crc16 mbcache jbd2
xen_blkfront xen_netfront crc32c_intel
[2583436.132051] CPU: 3 PID: 27690 Comm: serf Not tainted 3.16.0-0.bpo.4-amd64
#1 Debian 3.16.7-ckt4-3~bpo70+1
[2583436.132051] task: ffff8801f4517670 ti: ffff88013a134000 task.ti:
ffff88013a134000
[2583436.132051] RIP: e030:[<ffffffff810b7043>] [<ffffffff810b7043>]
queue_write_lock_slowpath+0x83/0x90
[2583436.132051] RSP: e02b:ffff88013a137bb0 EFLAGS: 00000202
[2583436.132051] RAX: 0000000000000007 RBX: 0000000000000001 RCX:
0000000000000000
[2583436.132051] RDX: 0000000000000009 RSI: ffffffff818bdc1c RDI:
ffffffff818bdc1c
[2583436.132051] RBP: 00000001264e5a85 R08: 0000000000000020 R09:
0000000000000001
[2583436.132051] R10: 000000000a6b3ceb R11: ffff88013a137b38 R12:
ffffffff818bda40
[2583436.132051] R13: ffff8800e8a2be00 R14: ffff8801f18f0000 R15:
ffff8801f3257200
[2583436.132051] FS: 000000c208019b70(0000) GS:ffff8801feac0000(0000)
knlGS:0000000000000000
[2583436.132051] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[2583436.132051] CR2: ffffffffff600400 CR3: 00000001f2aa7000 CR4:
0000000000002660
[2583436.132051] Stack:
[2583436.132051] ffffffff8145998b ffff8801f32572e8 ffff8801f32572e8
ffffffff000000b8
[2583436.132051] 0000000000000004 ffff88013a137c54 ffffffff818bdc1c
00ff8801f18f0000
[2583436.132051] ffffffff8147f66f ffffffff8148afe0 ffffffff80000000
ffffffff818e6cc0
[2583436.132051] Call Trace:
[2583436.132051] [<ffffffff8145998b>] ? __neigh_create+0x1eb/0x5d0
[2583436.132051] [<ffffffff8147f66f>] ? nf_hook_slow+0x7f/0x160
[2583436.132051] [<ffffffff8148afe0>] ? ip_fragment+0x870/0x870
[2583436.132051] [<ffffffff8148b747>] ? ip_finish_output+0x767/0x8d0
[2583436.132051] [<ffffffff8148baba>] ? ip_queue_xmit+0x12a/0x3b0
[2583436.132051] [<ffffffff814a278e>] ? tcp_transmit_skb+0x41e/0x900
[2583436.132051] [<ffffffff814a3522>] ? tcp_connect+0x7e2/0x930
[2583436.132051] [<ffffffff810d22ee>] ? getnstimeofday+0xe/0x30
[2583436.132051] [<ffffffff810d2321>] ? ktime_get_real+0x11/0x50
[2583436.132051] [<ffffffff814a81ce>] ? tcp_v4_connect+0x2ee/0x410
[2583436.132051] [<ffffffff814bf6d6>] ? __inet_stream_connect+0x1f6/0x350
[2583436.132051] [<ffffffff81549536>] ? _raw_spin_lock_irqsave+0x16/0x50
[2583436.132051] [<ffffffff814bfb95>] ? inet_stream_connect+0x45/0x70
[2583436.132051] [<ffffffff814339b8>] ? SYSC_connect+0xe8/0x100
[2583436.132051] [<ffffffff8100b430>] ? xen_clocksource_read+0x20/0x30
[2583436.132051] [<ffffffff8100b430>] ? xen_clocksource_read+0x20/0x30
[2583436.132051] [<ffffffff810d20a2>] ? ktime_get_ts+0x42/0xd0
[2583436.132051] [<ffffffff8108e841>] ? posix_ktime_get_ts+0x11/0x20
[2583436.132051] [<ffffffff8108fc10>] ? SyS_clock_gettime+0x40/0x70
[2583436.132051] [<ffffffff81549a6d>] ?
system_call_fast_compare_end+0x10/0x15
[2583436.132051] Code: ff 00 00 00 eb 04 66 90 f3 90 8b 07 83 f8 01 75 f7 f0
0f b1 17 83 f8 01 75 ee eb bc 0f b7 47 04 66 39 d0 74 9c f3 90 0f b7 47 04
<66> 39 c2 75 f5 eb 8f 66 0f 1f 44 00 00 0f 1f 44 00 00 65 8b 04
[2583436.132053]
[2583436.132053] CPU: 4 PID: 59 Comm: kworker/4:1 Not tainted
3.16.0-0.bpo.4-amd64 #1 Debian 3.16.7-ckt4-3~bpo70+1
[2583436.132053] Workqueue: events_power_efficient neigh_periodic_work
[2583436.132053] task: ffff8801f4da6ae0 ti: ffff8801f4e58000 task.ti:
ffff8801f4e58000
[2583436.132053] RIP: e030:[<ffffffff810b7043>] [<ffffffff810b7043>]
queue_write_lock_slowpath+0x83/0x90
[2583436.132053] RSP: e02b:ffff8801f4e5bdc0 EFLAGS: 00000a93
[2583436.132053] RAX: 000000000000c11c RBX: ffffffff818bdc1c RCX:
0000000000000008
[2583436.132053] RDX: 0000000000007ec0 RSI: 0000000000000200 RDI:
ffff8801f2783828
[2583436.132053] RBP: 00000000000000a4 R08: ffff8800fd2ed800 R09:
0000000000000000
[2583436.132053] R10: 0000000000000000 R11: 0000000000000000 R12:
ffff8801f2783800
[2583436.132053] R13: ffffffff818bdb30 R14: 0000000000000001 R15:
ffff8800fd2edd20
[2583436.132053] FS: 000000c2080ca4f0(0000) GS:ffff8801feb00000(0000)
knlGS:0000000000000000
[2583436.132053] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[2583436.132053] CR2: ffffffffff600400 CR3: 00000001f2aa7000 CR4:
0000000000002660
[2583436.132053] Stack:
[2583436.132053] ffffffff814582ab ffff88009558b480 ffff8801f4e23ac0
ffff8801feb12a00
[2583436.132053] ffff8801feb16800 0000000000000000 0000000000000000
ffffffff818bdb30
[2583436.132053] ffffffff8108891c 0000000000013200 ffff8801f4e5bfd8
0000000000013200
[2583436.132053] Call Trace:
[2583436.132053] [<ffffffff814582ab>] ? neigh_periodic_work+0xbb/0x1e0
[2583436.132053] [<ffffffff8108891c>] ? process_one_work+0x15c/0x450
[2583436.132053] [<ffffffff81089b72>] ? worker_thread+0x112/0x540
[2583436.132053] [<ffffffff81089a60>] ? create_and_start_worker+0x60/0x60
[2583436.132053] [<ffffffff81090541>] ? kthread+0xc1/0xe0
[2583436.132053] [<ffffffff81090480>] ? flush_kthread_worker+0xb0/0xb0
[2583436.132053] [<ffffffff815499bc>] ? ret_from_fork+0x7c/0xb0
[2583436.132053] [<ffffffff81090480>] ? flush_kthread_worker+0xb0/0xb0
[2583436.132053] Code: ff 00 00 00 eb 04 66 90 f3 90 8b 07 83 f8 01 75 f7 f0
0f b1 17 83 f8 01 75 ee eb bc 0f b7 47 04 66 39 d0 74 9c f3 90 0f b7 47 04
<66> 39 c2 75 f5 eb 8f 66 0f 1f 44 00 00 0f 1f 44 00 00 65 8b 04
[2583445.936057] INFO: rcu_sched self-detected stall on CPU { 4} (t=3255866
jiffies g=258996215 c=258996214 q=4340556)
[2583445.936057] sending NMI to all CPUs:
[2583445.936108] NMI backtrace for cpu 0
[2583445.936125] CPU: 0 PID: 27713 Comm: serf Not tainted 3.16.0-0.bpo.4-amd64
#1 Debian 3.16.7-ckt4-3~bpo70+1
[2583445.936135] task: ffff8800edbf2b60 ti: ffff8800f4db8000 task.ti:
ffff8800f4db8000
[2583445.936143] RIP: e030:[<ffffffff810b7002>] [<ffffffff810b7002>]
queue_write_lock_slowpath+0x42/0x90
[2583445.936162] RSP: e02b:ffff8800f4dbbb00 EFLAGS: 00000286
[2583445.936167] RAX: 00000000000000ff RBX: 0000000000000001 RCX:
0000000000000000
[2583445.936175] RDX: 00000000000000ff RSI: ffffffff818bdc1c RDI:
ffffffff818bdc1c
[2583445.936181] RBP: 00000001264c3d6c R08: 0000000000000020 R09:
0000000000000001
[2583445.936188] R10: 000000000a6b3c82 R11: ffff8800f4dbba88 R12:
ffffffff818bda40
[2583445.936195] R13: ffff8801f26a4e00 R14: ffff8801f18f0000 R15:
0000000000000059
[2583445.936208] FS: 000000c208049270(0000) GS:ffff8801fea00000(0000)
knlGS:0000000000000000
[2583445.936217] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[2583445.936224] CR2: 00007f9736adb000 CR3: 00000001f2aa7000 CR4:
0000000000002660
[2583445.936231] Stack:
[2583445.936235] ffffffff8145998b ffff880004156a00 ffff880004156a00
ffffffff000000b6
[2583445.936245] 0000000000000004 ffff8800f4dbbba4 ffffffff818bdc1c
00ff8801f18f0000
[2583445.936255] ffffffff8147f66f ffffffff8148afe0 ffffffff80000000
ffffffff818e6cc0
[2583445.936266] Call Trace:
[2583445.936278] [<ffffffff8145998b>] ? __neigh_create+0x1eb/0x5d0
[2583445.936291] [<ffffffff8147f66f>] ? nf_hook_slow+0x7f/0x160
[2583445.936299] [<ffffffff8148afe0>] ? ip_fragment+0x870/0x870
[2583445.936307] [<ffffffff8148b747>] ? ip_finish_output+0x767/0x8d0
[2583445.936316] [<ffffffff8148cd42>] ? ip_send_skb+0x12/0x40
[2583445.936325] [<ffffffff814b2e9f>] ? udp_send_skb+0x10f/0x280
[2583445.936332] [<ffffffff81489770>] ? ip_setup_cork+0x130/0x130
[2583445.936340] [<ffffffff814b3a98>] ? udp_sendmsg+0x308/0x8a0
[2583445.936351] [<ffffffff814331ca>] ? sock_sendmsg+0xda/0xf0
[2583445.936359] [<ffffffff814b44d2>] ? udp_poll+0x22/0xb0
[2583445.936370] [<ffffffff811feb90>] ? ep_poll_readyevents_proc+0x30/0x30
[2583445.936378] [<ffffffff81433861>] ? SYSC_sendto+0x121/0x190
[2583445.936390] [<ffffffff810e0150>] ? SyS_futex+0x150/0x1c0
[2583445.936402] [<ffffffff8100b430>] ? xen_clocksource_read+0x20/0x30
[2583445.936412] [<ffffffff810d1c84>] ? __getnstimeofday+0x34/0xb0
[2583445.936422] [<ffffffff810d22ee>] ? getnstimeofday+0xe/0x30
[2583445.936432] [<ffffffff81549a6d>] ?
system_call_fast_compare_end+0x10/0x15
[2583445.936439] Code: 75 5b 8b 07 85 c0 75 23 ba ff 00 00 00 f0 0f b1 17 85
c0 75 16 0f 1f 40 00 66 83 47 04 01 c3 66 2e 0f 1f 84 00 00 00 00 00 f3 90
<8b> 17 84 d2 75 f8 89 d1 89 d0 83 c9 01 f0 0f b1 0f 39 d0 75 e9
[2583445.936512] NMI backtrace for cpu 3
[2583445.936528] CPU: 3 PID: 27690 Comm: serf Not tainted 3.16.0-0.bpo.4-amd64
#1 Debian 3.16.7-ckt4-3~bpo70+1
[2583445.936538] task: ffff8801f4517670 ti: ffff88013a134000 task.ti:
ffff88013a134000
[2583445.936546] RIP: e030:[<ffffffff810b7043>] [<ffffffff810b7043>]
queue_write_lock_slowpath+0x83/0x90
[2583445.936563] RSP: e02b:ffff88013a137bb0 EFLAGS: 00000202
[2583445.936569] RAX: 0000000000000007 RBX: 0000000000000001 RCX:
0000000000000000
[2583445.936576] RDX: 0000000000000009 RSI: ffffffff818bdc1c RDI:
ffffffff818bdc1c
[2583445.936583] RBP: 00000001264e5a85 R08: 0000000000000020 R09:
0000000000000001
[2583445.936590] R10: 000000000a6b3ceb R11: ffff88013a137b38 R12:
ffffffff818bda40
[2583445.936596] R13: ffff8800e8a2be00 R14: ffff8801f18f0000 R15:
ffff8801f3257200
[2583445.936607] FS: 000000c208019b70(0000) GS:ffff8801feac0000(0000)
knlGS:0000000000000000
[2583445.936615] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[2583445.936621] CR2: ffffffffff600400 CR3: 00000001f2aa7000 CR4:
0000000000002660
[2583445.936628] Stack:
[2583445.936632] ffffffff8145998b ffff8801f32572e8 ffff8801f32572e8
ffffffff000000b8
[2583445.936643] 0000000000000004 ffff88013a137c54 ffffffff818bdc1c
00ff8801f18f0000
[2583445.936653] ffffffff8147f66f ffffffff8148afe0 ffffffff80000000
ffffffff818e6cc0
[2583445.936663] Call Trace:
[2583445.936673] [<ffffffff8145998b>] ? __neigh_create+0x1eb/0x5d0
[2583445.936683] [<ffffffff8147f66f>] ? nf_hook_slow+0x7f/0x160
[2583445.936691] [<ffffffff8148afe0>] ? ip_fragment+0x870/0x870
[2583445.936699] [<ffffffff8148b747>] ? ip_finish_output+0x767/0x8d0
[2583445.936706] [<ffffffff8148baba>] ? ip_queue_xmit+0x12a/0x3b0
[2583445.936717] [<ffffffff814a278e>] ? tcp_transmit_skb+0x41e/0x900
[2583445.936726] [<ffffffff814a3522>] ? tcp_connect+0x7e2/0x930
[2583445.936738] [<ffffffff810d22ee>] ? getnstimeofday+0xe/0x30
[2583445.936746] [<ffffffff810d2321>] ? ktime_get_real+0x11/0x50
[2583445.936754] [<ffffffff814a81ce>] ? tcp_v4_connect+0x2ee/0x410
[2583445.936764] [<ffffffff814bf6d6>] ? __inet_stream_connect+0x1f6/0x350
[2583445.936774] [<ffffffff81549536>] ? _raw_spin_lock_irqsave+0x16/0x50
[2583445.936782] [<ffffffff814bfb95>] ? inet_stream_connect+0x45/0x70
[2583445.936790] [<ffffffff814339b8>] ? SYSC_connect+0xe8/0x100
[2583445.936800] [<ffffffff8100b430>] ? xen_clocksource_read+0x20/0x30
[2583445.936808] [<ffffffff8100b430>] ? xen_clocksource_read+0x20/0x30
[2583445.936816] [<ffffffff810d20a2>] ? ktime_get_ts+0x42/0xd0
[2583445.936827] [<ffffffff8108e841>] ? posix_ktime_get_ts+0x11/0x20
[2583445.936836] [<ffffffff8108fc10>] ? SyS_clock_gettime+0x40/0x70
[2583445.936845] [<ffffffff81549a6d>] ?
system_call_fast_compare_end+0x10/0x15
[2583445.936851] Code: ff 00 00 00 eb 04 66 90 f3 90 8b 07 83 f8 01 75 f7 f0
0f b1 17 83 f8 01 75 ee eb bc 0f b7 47 04 66 39 d0 74 9c f3 90 0f b7 47 04
<66> 39 c2 75 f5 eb 8f 66 0f 1f 44 00 00 0f 1f 44 00 00 65 8b 04
[2583445.936930] NMI backtrace for cpu 1
[2583445.936953] CPU: 1 PID: 0 Comm: swapper/1 Not tainted
3.16.0-0.bpo.4-amd64 #1 Debian 3.16.7-ckt4-3~bpo70+1
[2583445.936964] task: ffff8801f51c0a20 ti: ffff8801f51c8000 task.ti:
ffff8801f51c8000
[2583445.936971] RIP: e030:[<ffffffff810b703f>] [<ffffffff810b703f>]
queue_write_lock_slowpath+0x7f/0x90
[2583445.936986] RSP: e02b:ffff8801fea43c00 EFLAGS: 00000202
[2583445.936992] RAX: 0000000000000007 RBX: 0000000000000001 RCX:
0000000000000000
[2583445.936999] RDX: 0000000000000008 RSI: ffffffff818bdc1c RDI:
ffffffff818bdc1c
[2583445.937006] RBP: 00000001264c55e3 R08: 000000000a6b3ca4 R09:
ffff8801fea43b88
[2583445.937012] R10: 000000000a6b3ca4 R11: ffff8801fea43b88 R12:
ffffffff818bda40
[2583445.937018] R13: ffff8800edb6d200 R14: ffff8801f4d98000 R15:
ffffffff818b7bc0
[2583445.937031] FS: 00007f9730008700(0000) GS:ffff8801fea40000(0000)
knlGS:0000000000000000
[2583445.937039] CS: e033 DS: 002b ES: 002b CR0: 000000008005003b
[2583445.937044] CR2: ffffffffff600400 CR3: 000000014478d000 CR4:
0000000000002660
[2583445.937051] Stack:
[2583445.937054] ffffffff8145998b ffff8800034a0700 ffff8800034a0700
ffffffff000000b7
[2583445.937066] 0000000000000004 ffff8801fea43ca4 ffffffff818bdc1c
00ff8801f4d98000
[2583445.937077] ffffffff8147f66f ffffffff8148afe0 ffffffff80000000
ffffffff818e6cc0
[2583445.937086] Call Trace:
[2583445.937090] <IRQ>
[2583445.937093] [<ffffffff8145998b>] ? __neigh_create+0x1eb/0x5d0
[2583445.937108] [<ffffffff8147f66f>] ? nf_hook_slow+0x7f/0x160
[2583445.937115] [<ffffffff8148afe0>] ? ip_fragment+0x870/0x870
[2583445.937122] [<ffffffff8148b747>] ? ip_finish_output+0x767/0x8d0
[2583445.937129] [<ffffffff8148cd42>] ? ip_send_skb+0x12/0x40
[2583445.937136] [<ffffffff814ba525>] ? icmp_send+0x445/0x520
[2583445.937145] [<ffffffff81093c0b>] ? hrtimer_interrupt+0x14b/0x260
[2583445.937153] [<ffffffff814583d0>] ? neigh_periodic_work+0x1e0/0x1e0
[2583445.937162] [<ffffffff81480efa>] ? ipv4_link_failure+0x1a/0x60
[2583445.937170] [<ffffffff814b716a>] ? arp_error_report+0x2a/0x40
[2583445.937178] [<ffffffff81457f4e>] ? neigh_invalidate+0x7e/0xf0
[2583445.937186] [<ffffffff81458562>] ? neigh_timer_handler+0x192/0x290
[2583445.937194] [<ffffffff814583d0>] ? neigh_periodic_work+0x1e0/0x1e0
[2583445.937204] [<ffffffff8107985c>] ? call_timer_fn+0x4c/0x150
[2583445.937212] [<ffffffff814583d0>] ? neigh_periodic_work+0x1e0/0x1e0
[2583445.937220] [<ffffffff8107b2c7>] ? run_timer_softirq+0x297/0x2e0
[2583445.937228] [<ffffffff81072c0e>] ? __do_softirq+0xde/0x2e0
[2583445.937235] [<ffffffff81073066>] ? irq_exit+0x86/0xb0
[2583445.937246] [<ffffffff8137db45>] ? xen_evtchn_do_upcall+0x35/0x50
[2583445.937255] [<ffffffff8154b71e>] ? xen_do_hypervisor_callback+0x1e/0x30
[2583445.937260] <EOI>
[2583445.937263] [<ffffffff810013aa>] ? xen_hypercall_sched_op+0xa/0x20
[2583445.937274] [<ffffffff810013aa>] ? xen_hypercall_sched_op+0xa/0x20
[2583445.937282] [<ffffffff8100b0ec>] ? xen_safe_halt+0xc/0x20
[2583445.937293] [<ffffffff8101f642>] ? default_idle+0x22/0xf0
[2583445.937301] [<ffffffff810b1818>] ? cpu_startup_entry+0x2e8/0x4b0
[2583445.937309] [<ffffffff8100b139>] ? xen_force_evtchn_callback+0x9/0x10
[2583445.937315] [<ffffffff8100ba12>] ? check_events+0x12/0x20
[2583445.937321] Code: d0 75 e9 ba ff 00 00 00 eb 04 66 90 f3 90 8b 07 83 f8
01 75 f7 f0 0f b1 17 83 f8 01 75 ee eb bc 0f b7 47 04 66 39 d0 74 9c f3 90
<0f> b7 47 04 66 39 c2 75 f5 eb 8f 66 0f 1f 44 00 00 0f [2583445.948054] INFO:
rcu_sched detected stalls on CPUs/tasks: { 4} (detected by 0, t=3255868
jiffies, g=258996215, c=258996214, q=4340578)
[2583445.940058] 1f 44 00
[2583445.936057] NMI backtrace for cpu 4
[2583445.936057] CPU: 4 PID: 59 Comm: kworker/4:1 Not tainted
3.16.0-0.bpo.4-amd64 #1 Debian 3.16.7-ckt4-3~bpo70+1
[2583445.936057] Workqueue: events_power_efficient neigh_periodic_work
[2583445.936057] task: ffff8801f4da6ae0 ti: ffff8801f4e58000 task.ti:
ffff8801f4e58000
[2583445.936057] RIP: e030:[<ffffffff8100130a>] [<ffffffff8100130a>]
xen_hypercall_vcpu_op+0xa/0x20
[2583445.936057] RSP: e02b:ffff8801feb03c30 EFLAGS: 00000046
[2583445.936057] RAX: 0000000000000000 RBX: ffffffff818e03c0 RCX:
ffffffff8100130a
[2583445.936057] RDX: 0000000000000000 RSI: 0000000000000004 RDI:
000000000000000b
[2583445.936057] RBP: ffffffff818dff60 R08: ffffffff818dff60 R09:
0000000000000000
[2583445.936057] R10: 0000000000026211 R11: 0000000000000246 R12:
0000000000000005
[2583445.936057] R13: 0000000000000004 R14: ffffffff818e0400 R15:
ffffffff818e0400
[2583445.936057] FS: 000000c2080ca4f0(0000) GS:ffff8801feb00000(0000)
knlGS:0000000000000000
[2583445.936057] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[2583445.936057] CR2: ffffffffff600400 CR3: 00000001f2aa7000 CR4:
0000000000002660
[2583445.936057] Stack:
[2583445.936057] 0000000000026210 0000000000000004 ffffffff8137daf3
ffffffff818dff60
[2583445.936057] ffffffff81011713 0000000000000004 0000000000000001
ffffffff81852480
[2583445.936057] 0000000000000004 ffffffff81852480 ffffffff8104b700
ffff8801feb0d5e0
[2583445.936057] Call Trace:
[2583445.936057] <IRQ>
[2583445.936057] [<ffffffff8137daf3>] ? xen_send_IPI_one+0x43/0x60
[2583445.936057] [<ffffffff81011713>] ? __xen_send_IPI_mask+0x33/0x60
[2583445.936057] [<ffffffff8104b700>] ?
arch_trigger_all_cpu_backtrace+0x120/0x130
[2583445.936057] [<ffffffff810d0210>] ? rcu_check_callbacks+0x410/0x680
[2583445.936057] [<ffffffff810c7c9e>] ? irq_get_irq_data+0xe/0x20
[2583445.936057] [<ffffffff8107bd14>] ? update_process_times+0x44/0x80
[2583445.936057] [<ffffffff810db39f>] ? tick_sched_handle.isra.12+0x2f/0x70
[2583445.936057] [<ffffffff810db4ca>] ? tick_sched_timer+0x4a/0x80
[2583445.936057] [<ffffffff81093350>] ? __run_hrtimer+0x70/0x210
[2583445.936057] [<ffffffff810db480>] ? tick_nohz_handler+0xa0/0xa0
[2583445.936057] [<ffffffff81093bc1>] ? hrtimer_interrupt+0x101/0x260
[2583445.936057] [<ffffffff8100b2e8>] ? xen_timer_interrupt+0x28/0x150
[2583445.936057] [<ffffffff813b7b21>] ? add_interrupt_randomness+0x51/0x200
[2583445.936057] [<ffffffff810c4f54>] ? handle_irq_event_percpu+0x54/0x1e0
[2583445.936057] [<ffffffff810c891a>] ? handle_percpu_irq+0x4a/0x80
[2583445.936057] [<ffffffff810c473d>] ? generic_handle_irq+0x1d/0x30
[2583445.936057] [<ffffffff8137e51d>] ? evtchn_2l_handle_events+0x24d/0x260
[2583445.936057] [<ffffffff8137bdff>] ? __xen_evtchn_do_upcall+0x3f/0x70
[2583445.936057] [<ffffffff8137db3f>] ? xen_evtchn_do_upcall+0x2f/0x50
[2583445.936057] [<ffffffff8154b71e>] ? xen_do_hypervisor_callback+0x1e/0x30
[2583445.936057] <EOI>
[2583445.936057] [<ffffffff810b7043>] ? queue_write_lock_slowpath+0x83/0x90
[2583445.936057] [<ffffffff814582ab>] ? neigh_periodic_work+0xbb/0x1e0
[2583445.936057] [<ffffffff8108891c>] ? process_one_work+0x15c/0x450
[2583445.936057] [<ffffffff81089b72>] ? worker_thread+0x112/0x540
[2583445.936057] [<ffffffff81089a60>] ? create_and_start_worker+0x60/0x60
[2583445.936057] [<ffffffff81090541>] ? kthread+0xc1/0xe0
[2583445.936057] [<ffffffff81090480>] ? flush_kthread_worker+0xb0/0xb0
[2583445.936057] [<ffffffff815499bc>] ? ret_from_fork+0x7c/0xb0
[2583445.936057] [<ffffffff81090480>] ? flush_kthread_worker+0xb0/0xb0
[2583445.936057] Code: cc 51 41 53 50 b8 17 00 00 00 0f 05 5b 59 c3 cc cc cc
cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 18 00 00 00 0f 05
<41> 5b 59 c3 cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc
[2583445.940062] NMI backtrace for cpu 2
[2583445.940062] CPU: 2 PID: 464 Comm: uwsgi Not tainted 3.16.0-0.bpo.4-amd64
#1 Debian 3.16.7-ckt4-3~bpo70+1
[2583445.940062] task: ffff8800be90c010 ti: ffff880100118000 task.ti:
ffff880100118000
[2583445.940062] RIP: e033:[<00007f9734f193c1>] [<00007f9734f193c1>]
0x7f9734f193c1
[2583445.940062] RSP: e02b:00007f972f8029a0 EFLAGS: 00000207
[2583445.940062] RAX: 00007f972f807660 RBX: 00000000043921b0 RCX:
00000000302e302e
[2583445.940062] RDX: 000000002e302e31 RSI: 0000000004292329 RDI:
00000000043921d9
[2583445.940062] RBP: 0000000004165038 R08: 0000000000000000 R09:
00007f9734935060
[2583445.940062] R10: 0000000004292300 R11: 00007f9734966fb0 R12:
0000000000000005
[2583445.940062] R13: 00007f972f807660 R14: 00000000043921b0 R15:
0000000000000000
[2583445.940062] FS: 00007f972f807700(0000) GS:ffff8801fea80000(0000)
knlGS:0000000000000000
[2583445.940062] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[2583445.940062] CR2: 00007f9736adb000 CR3: 00000001f42b7000 CR4:
0000000000002660
[2583445.940062]
[2583446.138415] NMI backtrace for cpu 5
[2583446.138437] CPU: 5 PID: 0 Comm: swapper/5 Not tainted
3.16.0-0.bpo.4-amd64 #1 Debian 3.16.7-ckt4-3~bpo70+1
[2583446.138452] task: ffff8801f51ea110 ti: ffff8801f51fc000 task.ti:
ffff8801f51fc000
[2583446.138464] RIP: e030:[<ffffffff810013aa>] [<ffffffff810013aa>]
xen_hypercall_sched_op+0xa/0x20
[2583446.138487] RSP: e02b:ffff8801f51ffe80 EFLAGS: 00000246
[2583446.138497] RAX: 0000000000000000 RBX: ffffffff818e03c0 RCX:
ffffffff810013aa
[2583446.138509] RDX: ffff8801feb40000 RSI: 0000000000000000 RDI:
0000000000000001
[2583446.138521] RBP: 0000000000000000 R08: 0000000000000000 R09:
0000000000000000
[2583446.138534] R10: 0000000000000001 R11: 0000000000000246 R12:
0000000000000005
[2583446.138547] R13: ffff8801f51fc000 R14: 0000000000000000 R15:
ffff8801f51fc000
[2583446.138565] FS: 00007f5fbd006700(0000) GS:ffff8801feb40000(0000)
knlGS:0000000000000000
[2583446.138576] CS: e033 DS: 002b ES: 002b CR0: 000000008005003b
[2583446.138586] CR2: ffffffffff600400 CR3: 0000000003b52000 CR4:
0000000000002660
[2583446.138597] Stack:
[2583446.138603] 00000001267deba7 ffffffff81853f20 ffffffff8100b0ec
ffffffff8101f642
[2583446.138621] 0000000000000000 ffffffff818e03c0 0000000000000000
00000000ffffffed
[2583446.138639] ffff8801f51fc000 ffffffff810b1818 000000000000000a
ffffffff8100b139
[2583446.138655] Call Trace:
[2583446.138668] [<ffffffff8100b0ec>] ? xen_safe_halt+0xc/0x20
[2583446.138683] [<ffffffff8101f642>] ? default_idle+0x22/0xf0
[2583446.138697] [<ffffffff810b1818>] ? cpu_startup_entry+0x2e8/0x4b0
[2583446.138711] [<ffffffff8100b139>] ? xen_force_evtchn_callback+0x9/0x10
[2583446.138724] [<ffffffff8100ba12>] ? check_events+0x12/0x20
[2583446.138733] Code: cc 51 41 53 b8 1c 00 00 00 0f 05 41 5b 59 c3 cc cc cc
cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 1d 00 00 00 0f 05
<41> 5b 59 c3 cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc
[2583446.138839] NMI backtrace for cpu 6
[2583446.138852] CPU: 6 PID: 467 Comm: uwsgi Not tainted 3.16.0-0.bpo.4-amd64
#1 Debian 3.16.7-ckt4-3~bpo70+1
[2583446.138864] task: ffff8800955c8090 ti: ffff880100124000 task.ti:
ffff880100124000
[2583446.138874] RIP: e033:[<00007f9734eec925>] [<00007f9734eec925>]
0x7f9734eec925
[2583446.138894] RSP: e02b:00007f972f803a18 EFLAGS: 00000246
[2583446.138903] RAX: 0000000003487aa0 RBX: 0000000001e98c70 RCX:
0000000000000000
[2583446.138913] RDX: fae06ce8df5c70a5 RSI: 00007f97339949e0 RDI:
0000000001e98c70
[2583446.138923] RBP: 00007f97339949e0 R08: 7fffffffffffffff R09:
00007f9734f67960
[2583446.138933] R10: 0000000003977870 R11: 00007f9734f67bc4 R12:
fae06ce8df5c70a5
[2583446.138944] R13: 00007f97352914a0 R14: 00007f9733928a28 R15:
0000000000000000
[2583446.138965] FS: 00007f972f807700(0000) GS:ffff8801feb80000(0000)
knlGS:0000000000000000
[2583446.138976] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[2583446.138985] CR2: 00007f9736adb000 CR3: 00000001f2a26000 CR4:
0000000000002660
[2583446.139003]
[2583446.139010] NMI backtrace for cpu 7
[2583446.139024] CPU: 7 PID: 0 Comm: swapper/7 Not tainted
3.16.0-0.bpo.4-amd64 #1 Debian 3.16.7-ckt4-3~bpo70+1
[2583446.139040] task: ffff8801f5200aa0 ti: ffff8801f5208000 task.ti:
ffff8801f5208000
[2583446.139051] RIP: e030:[<ffffffff810013aa>] [<ffffffff810013aa>]
xen_hypercall_sched_op+0xa/0x20
[2583446.139069] RSP: e02b:ffff8801f520be80 EFLAGS: 00000246
[2583446.139078] RAX: 0000000000000000 RBX: ffffffff818e03c0 RCX:
ffffffff810013aa
[2583446.139088] RDX: ffff8801febc0000 RSI: 0000000000000000 RDI:
0000000000000001
[2583446.139099] RBP: 0000000000000000 R08: 0000000000000000 R09:
0000000000000000
[2583446.139110] R10: 0000000000000001 R11: 0000000000000246 R12:
0000000000000007
[2583446.139121] R13: ffff8801f5208000 R14: 0000000000000000 R15:
ffff8801f5208000
[2583446.139137] FS: 00007f5fbc004700(0000) GS:ffff8801febc0000(0000)
knlGS:0000000000000000
[2583446.139148] CS: e033 DS: 002b ES: 002b CR0: 000000008005003b
[2583446.139156] CR2: ffffffffff600400 CR3: 0000000003b52000 CR4:
0000000000002660
[2583446.139166] Stack:
[2583446.139171] 00000001267deb95 ffffffff81853f20 ffffffff8100b0ec
ffffffff8101f642
[2583446.139187] 0000000000000000 ffffffff818e03c0 0000000000000000
00000000ffffffed
[2583446.139203] ffff8801f5208000 ffffffff810b1818 000000000000000a
ffffffff8100b139
[2583446.139218] Call Trace:
[2583446.139227] [<ffffffff8100b0ec>] ? xen_safe_halt+0xc/0x20
[2583446.139240] [<ffffffff8101f642>] ? default_idle+0x22/0xf0
[2583446.139251] [<ffffffff810b1818>] ? cpu_startup_entry+0x2e8/0x4b0
[2583446.139264] [<ffffffff8100b139>] ? xen_force_evtchn_callback+0x9/0x10
[2583446.139275] [<ffffffff8100ba12>] ? check_events+0x12/0x20
[2583446.139284] Code: cc 51 41 53 b8 1c 00 00 00 0f 05 41 5b 59 c3 cc cc cc
cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 1d 00 00 00 0f 05
<41> 5b 59 c3 cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc
[2583472.076051] BUG: soft lockup - CPU#0 stuck for 22s! [serf:27713]
[2583472.076051] Modules linked in: xt_multiport ip6table_filter ip6_tables
xt_tcpudp nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack iptable_filter
ip_tables x_tables nf_conntrack x86_pkg_temp_thermal thermal_sys coretemp
crct10dif_pclmul crct10dif_common crc32_pclmul ghash_clmulni_intel aesni_intel
aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd evdev pcspkr ext4 crc16
mbcache jbd2 xen_blkfront xen_netfront crc32c_intel
[2583472.076051] CPU: 0 PID: 27713 Comm: serf Not tainted 3.16.0-0.bpo.4-amd64
#1 Debian 3.16.7-ckt4-3~bpo70+1
[2583472.076051] task: ffff8800edbf2b60 ti: ffff8800f4db8000 task.ti:
ffff8800f4db8000
[2583472.076051] RIP: e030:[<ffffffff810b7002>] [<ffffffff810b7002>]
queue_write_lock_slowpath+0x42/0x90
[2583472.076051] RSP: e02b:ffff8800f4dbbb00 EFLAGS: 00000286
[2583472.076051] RAX: 00000000000000ff RBX: 0000000000000001 RCX:
0000000000000000
[2583472.076051] RDX: 00000000000000ff RSI: ffffffff818bdc1c RDI:
ffffffff818bdc1c
[2583472.076051] RBP: 00000001264c3d6c R08: 0000000000000020 R09:
0000000000000001
[2583472.076051] R10: 000000000a6b3c82 R11: ffff8800f4dbba88 R12:
ffffffff818bda40
[2583472.076051] R13: ffff8801f26a4e00 R14: ffff8801f18f0000 R15:
0000000000000059
[2583472.076051] FS: 000000c208049270(0000) GS:ffff8801fea00000(0000)
knlGS:0000000000000000
[2583472.076051] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[2583472.076051] CR2: 00007f9736adb000 CR3: 00000001f2aa7000 CR4:
0000000000002660
[2583472.076051] Stack:
[2583472.076051] ffffffff8145998b ffff880004156a00 ffff880004156a00
ffffffff000000b6
[2583472.076051] 0000000000000004 ffff8800f4dbbba4 ffffffff818bdc1c
00ff8801f18f0000
[2583472.076051] ffffffff8147f66f ffffffff8148afe0 ffffffff80000000
ffffffff818e6cc0
[2583472.076051] Call Trace:
[2583472.076051] [<ffffffff8145998b>] ? __neigh_create+0x1eb/0x5d0
[2583472.076051] [<ffffffff8147f66f>] ? nf_hook_slow+0x7f/0x160
[2583472.076051] [<ffffffff8148afe0>] ? ip_fragment+0x870/0x870
[2583472.076051] [<ffffffff8148b747>] ? ip_finish_output+0x767/0x8d0
[2583472.076051] [<ffffffff8148cd42>] ? ip_send_skb+0x12/0x40
[2583472.076051] [<ffffffff814b2e9f>] ? udp_send_skb+0x10f/0x280
[2583472.076051] [<ffffffff81489770>] ? ip_setup_cork+0x130/0x130
[2583472.076051] [<ffffffff814b3a98>] ? udp_sendmsg+0x308/0x8a0
[2583472.076051] [<ffffffff814331ca>] ? sock_sendmsg+0xda/0xf0
[2583472.076051] [<ffffffff814b44d2>] ? udp_poll+0x22/0xb0
[2583472.076051] [<ffffffff811feb90>] ? ep_poll_readyevents_proc+0x30/0x30
[2583472.076051] [<ffffffff81433861>] ? SYSC_sendto+0x121/0x190
[2583472.076051] [<ffffffff810e0150>] ? SyS_futex+0x150/0x1c0
[2583472.076051] [<ffffffff8100b430>] ? xen_clocksource_read+0x20/0x30
[2583472.076051] [<ffffffff810d1c84>] ? __getnstimeofday+0x34/0xb0
[2583472.076051] [<ffffffff810d22ee>] ? getnstimeofday+0xe/0x30
[2583472.076051] [<ffffffff81549a6d>] ?
system_call_fast_compare_end+0x10/0x15
[2583472.076051] Code: 75 5b 8b 07 85 c0 75 23 ba ff 00 00 00 f0 0f b1 17 85
c0 75 16 0f 1f 40 00 66 83 47 04 01 c3 66 2e 0f 1f 84 00 00 00 00 00 f3 90
<8b> 17 84 d2 75 f8 89 d1 89 d0 83 c9 01 f0 0f b1 0f 39 d0 75 e9
[2583472.132052] BUG: soft lockup - CPU#3 stuck for 22s! [serf:27690]
[2583472.132056] BUG: soft lockup - CPU#4 stuck for 22s! [kworker/4:1:59]
[2583472.132056] Modules linked in: xt_multiport ip6table_filter ip6_tables
xt_tcpudp nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack iptable_filter
ip_tables x_tables nf_conntrack x86_pkg_temp_thermal thermal_sys coretemp
crct10dif_pclmul crct10dif_common crc32_pclmul ghash_clmulni_intel aesni_intel
aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd evdev pcspkr
ext4[2583472.132052] Modules linked in: xt_multiport ip6table_filter
ip6_tables xt_tcpudp nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack
iptable_filter ip_tables x_tables nf_conntrack x86_pkg_temp_thermal
thermal_sys coretemp crct10dif_pclmul crct10dif_common crc32_pclmul
ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper
ablk_helper cryptd evdev pcspkr ext4 crc16 mbcache jbd2 xen_blkfront
xen_netfront crc32c_intel
[2583472.132052] CPU: 3 PID: 27690 Comm: serf Not tainted 3.16.0-0.bpo.4-amd64
#1 Debian 3.16.7-ckt4-3~bpo70+1
[2583472.132052] task: ffff8801f4517670 ti: ffff88013a134000 task.ti:
ffff88013a134000
[2583472.132052] RIP: e030:[<ffffffff810b7043>] [<ffffffff810b7043>]
queue_write_lock_slowpath+0x83/0x90
[2583472.132052] RSP: e02b:ffff88013a137bb0 EFLAGS: 00000202
[2583472.132052] RAX: 0000000000000007 RBX: 0000000000000001 RCX:
0000000000000000
[2583472.132052] RDX: 0000000000000009 RSI: ffffffff818bdc1c RDI:
ffffffff818bdc1c
[2583472.132052] RBP: 00000001264e5a85 R08: 0000000000000020 R09:
0000000000000001
[2583472.132052] R10: 000000000a6b3ceb R11: ffff88013a137b38 R12:
ffffffff818bda40
[2583472.132052] R13: ffff8800e8a2be00 R14: ffff8801f18f0000 R15:
ffff8801f3257200
[2583472.132052] FS: 000000c208019b70(0000) GS:ffff8801feac0000(0000)
knlGS:0000000000000000
[2583472.132052] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[2583472.132052] CR2: ffffffffff600400 CR3: 00000001f2aa7000 CR4:
0000000000002660
[2583472.132052] Stack:
[2583472.132052] ffffffff8145998b ffff8801f32572e8 ffff8801f32572e8
ffffffff000000b8
[2583472.132052] 0000000000000004 ffff88013a137c54 ffffffff818bdc1c
00ff8801f18f0000
[2583472.132052] ffffffff8147f66f ffffffff8148afe0 ffffffff80000000
ffffffff818e6cc0
[2583472.132052] Call Trace:
[2583472.132052] [<ffffffff8145998b>] ? __neigh_create+0x1eb/0x5d0
[2583472.132052] [<ffffffff8147f66f>] ? nf_hook_slow+0x7f/0x160
[2583472.132052] [<ffffffff8148afe0>] ? ip_fragment+0x870/0x870
[2583472.132052] [<ffffffff8148b747>] ? ip_finish_output+0x767/0x8d0
[2583472.132052] [<ffffffff8148baba>] ? ip_queue_xmit+0x12a/0x3b0
[2583472.132052] [<ffffffff814a278e>] ? tcp_transmit_skb+0x41e/0x900
[2583472.132052] [<ffffffff814a3522>] ? tcp_connect+0x7e2/0x930
[2583472.132052] [<ffffffff810d22ee>] ? getnstimeofday+0xe/0x30
[2583472.132052] [<ffffffff810d2321>] ? ktime_get_real+0x11/0x50
[2583472.132052] [<ffffffff814a81ce>] ? tcp_v4_connect+0x2ee/0x410
[2583472.132052] [<ffffffff814bf6d6>] ? __inet_stream_connect+0x1f6/0x350
[2583472.132052] [<ffffffff81549536>] ? _raw_spin_lock_irqsave+0x16/0x50
[2583472.132052] [<ffffffff814bfb95>] ? inet_stream_connect+0x45/0x70
[2583472.132052] [<ffffffff814339b8>] ? SYSC_connect+0xe8/0x100
[2583472.132052] [<ffffffff8100b430>] ? xen_clocksource_read+0x20/0x30
[2583472.132052] [<ffffffff8100b430>] ? xen_clocksource_read+0x20/0x30
[2583472.132052] [<ffffffff810d20a2>] ? ktime_get_ts+0x42/0xd0
[2583472.132052] [<ffffffff8108e841>] ? posix_ktime_get_ts+0x11/0x20
[2583472.132052] [<ffffffff8108fc10>] ? SyS_clock_gettime+0x40/0x70
[2583472.132052] [<ffffffff81549a6d>] ?
system_call_fast_compare_end+0x10/0x15
[2583472.132052] Code: ff 00 00 00 eb 04 66 90 f3 90 8b 07 83 f8 01 75 f7 f0
0f b1 17 83 f8 01 75 ee eb bc 0f b7 47 04 66 39 d0 74 9c f3 90 0f b7 47 04
<66> 39 c2 75 f5 eb 8f 66 0f 1f 44 00 00 0f 1f 44 00 00 65 8b 04
[2583472.132056] crc16 mbcache jbd2 xen_blkfront xen_netfront crc32c_intel
[2583472.132056] CPU: 4 PID: 59 Comm: kworker/4:1 Not tainted
3.16.0-0.bpo.4-amd64 #1 Debian 3.16.7-ckt4-3~bpo70+1
[2583472.132056] Workqueue: events_power_efficient neigh_periodic_work
[2583472.132056] task: ffff8801f4da6ae0 ti: ffff8801f4e58000 task.ti:
ffff8801f4e58000
[2583472.132056] RIP: e030:[<ffffffff810b7043>] [<ffffffff810b7043>]
queue_write_lock_slowpath+0x83/0x90
[2583472.132056] RSP: e02b:ffff8801f4e5bdc0 EFLAGS: 00000a93
[2583472.132056] RAX: 000000000000c11c RBX: ffffffff818bdc1c RCX:
0000000000000008
[2583472.132056] RDX: 0000000000007ec0 RSI: 0000000000000200 RDI:
ffff8801f2783828
[2583472.132056] RBP: 00000000000000a4 R08: ffff8800fd2ed800 R09:
0000000000000000
[2583472.132056] R10: 0000000000000000 R11: 0000000000000000 R12:
ffff8801f2783800
[2583472.132056] R13: ffffffff818bdb30 R14: 0000000000000001 R15:
ffff8800fd2edd20
[2583472.132056] FS: 000000c2080ca4f0(0000) GS:ffff8801feb00000(0000)
knlGS:0000000000000000
[2583472.132056] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[2583472.132056] CR2: ffffffffff600400 CR3: 00000001f2aa7000 CR4:
0000000000002660
[2583472.132056] Stack:
[2583472.132056] ffffffff814582ab ffff88009558b480 ffff8801f4e23ac0
ffff8801feb12a00
[2583472.132056] ffff8801feb16800 0000000000000000 0000000000000000
ffffffff818bdb30
[2583472.132056] ffffffff8108891c 0000000000013200 ffff8801f4e5bfd8
0000000000013200
[2583472.132056] Call Trace:
[2583472.132056] [<ffffffff814582ab>] ? neigh_periodic_work+0xbb/0x1e0
[2583472.132056] [<ffffffff8108891c>] ? process_one_work+0x15c/0x450
[2583472.132056] [<ffffffff81089b72>] ? worker_thread+0x112/0x540
[2583472.132056] [<ffffffff81089a60>] ? create_and_start_worker+0x60/0x60
[2583472.132056] [<ffffffff81090541>] ? kthread+0xc1/0xe0
[2583472.132056] [<ffffffff81090480>] ? flush_kthread_worker+0xb0/0xb0
[2583472.132056] [<ffffffff815499bc>] ? ret_from_fork+0x7c/0xb0
[2583472.132056] [<ffffffff81090480>] ? flush_kthread_worker+0xb0/0xb0
[2583472.132056] Code: ff 00 00 00 eb 04 66 90 f3 90 8b 07 83 f8 01 75 f7 f0
0f b1 17 83 f8 01 75 ee eb bc 0f b7 47 04 66 39 d0 74 9c f3 90 0f b7 47 04
<66> 39 c2 75 f5 eb 8f 66 0f 1f 44 00 00 0f 1f 44 00 00 65 8b 04
[2583500.076054] BUG: soft lockup - CPU#0 stuck for 22s! [serf:27713]
[2583500.076054] Modules linked in: xt_multiport ip6table_filter ip6_tables
xt_tcpudp nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack iptable_filter
ip_tables x_tables nf_conntrack x86_pkg_temp_thermal thermal_sys coretemp
crct10dif_pclmul crct10dif_common crc32_pclmul ghash_clmulni_intel aesni_intel
aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd evdev pcspkr ext4 crc16
mbcache jbd2 xen_blkfront xen_netfront crc32c_intel
[2583500.076054] CPU: 0 PID: 27713 Comm: serf Not tainted 3.16.0-0.bpo.4-amd64
#1 Debian 3.16.7-ckt4-3~bpo70+1
[2583500.076054] task: ffff8800edbf2b60 ti: ffff8800f4db8000 task.ti:
ffff8800f4db8000
[2583500.076054] RIP: e030:[<ffffffff810b7002>] [<ffffffff810b7002>]
queue_write_lock_slowpath+0x42/0x90
[2583500.076054] RSP: e02b:ffff8800f4dbbb00 EFLAGS: 00000286
[2583500.076054] RAX: 00000000000000ff RBX: 0000000000000001 RCX:
0000000000000000
[2583500.076054] RDX: 00000000000000ff RSI: ffffffff818bdc1c RDI:
ffffffff818bdc1c
[2583500.076054] RBP: 00000001264c3d6c R08: 0000000000000020 R09:
0000000000000001
[2583500.076054] R10: 000000000a6b3c82 R11: ffff8800f4dbba88 R12:
ffffffff818bda40
[2583500.076054] R13: ffff8801f26a4e00 R14: ffff8801f18f0000 R15:
0000000000000059
[2583500.076054] FS: 000000c208049270(0000) GS:ffff8801fea00000(0000)
knlGS:0000000000000000
[2583500.076054] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[2583500.076054] CR2: 00007f9736adb000 CR3: 00000001f2aa7000 CR4:
0000000000002660
[2583500.076054] Stack:
[2583500.076054] ffffffff8145998b ffff880004156a00 ffff880004156a00
ffffffff000000b6
[2583500.076054] 0000000000000004 ffff8800f4dbbba4 ffffffff818bdc1c
00ff8801f18f0000
[2583500.076054] ffffffff8147f66f ffffffff8148afe0 ffffffff80000000
ffffffff818e6cc0
[2583500.076054] Call Trace:
[2583500.076054] [<ffffffff8145998b>] ? __neigh_create+0x1eb/0x5d0
[2583500.076054] [<ffffffff8147f66f>] ? nf_hook_slow+0x7f/0x160
[2583500.076054] [<ffffffff8148afe0>] ? ip_fragment+0x870/0x870
[2583500.076054] [<ffffffff8148b747>] ? ip_finish_output+0x767/0x8d0
[2583500.076054] [<ffffffff8148cd42>] ? ip_send_skb+0x12/0x40
[2583500.076054] [<ffffffff814b2e9f>] ? udp_send_skb+0x10f/0x280
[2583500.076054] [<ffffffff81489770>] ? ip_setup_cork+0x130/0x130
[2583500.076054] [<ffffffff814b3a98>] ? udp_sendmsg+0x308/0x8a0
[2583500.076054] [<ffffffff814331ca>] ? sock_sendmsg+0xda/0xf0
[2583500.076054] [<ffffffff814b44d2>] ? udp_poll+0x22/0xb0
[2583500.076054] [<ffffffff811feb90>] ? ep_poll_readyevents_proc+0x30/0x30
[2583500.076054] [<ffffffff81433861>] ? SYSC_sendto+0x121/0x190
[2583500.076054] [<ffffffff810e0150>] ? SyS_futex+0x150/0x1c0
[2583500.076054] [<ffffffff8100b430>] ? xen_clocksource_read+0x20/0x30
[2583500.076054] [<ffffffff810d1c84>] ? __getnstimeofday+0x34/0xb0
[2583500.076054] [<ffffffff810d22ee>] ? getnstimeofday+0xe/0x30
[2583500.076054] [<ffffffff81549a6d>] ?
system_call_fast_compare_end+0x10/0x15
[2583500.076054] Code: 75 5b 8b 07 85 c0 75 23 ba ff 00 00 00 f0 0f b1 17 85
c0 75 16 0f 1f 40 00 66 83 47 04 01 c3 66 2e 0f 1f 84 00 00 00 00 00 f3 90
<8b> 17 84 d2 75 f8 89 d1 89 d0 83 c9 01 f0 0f b1 0f 39 d0 75 e9
[2583500.132056] BUG: soft lockup - CPU#3 stuck for 22s! [serf:27690]
[2583500.132054] BUG: soft lockup - CPU#4 stuck for 22s! [kworker/4:1:59]
[2583500.132054] Modules linked in: xt_multiport ip6table_filter ip6_tables
xt_tcpudp nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack iptable_filter
ip_tables x_tables nf_conntrack x86_pkg_temp_thermal thermal_sys coretemp
crct10dif_pclmul crct10dif_common crc32_pclmul ghash_clmulni_intel aesni_intel
aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd evdev[2583500.132056]
Modules linked in: xt_multiport ip6table_filter ip6_tables xt_tcpudp
nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack iptable_filter ip_tables
x_tables nf_conntrack x86_pkg_temp_thermal thermal_sys coretemp
crct10dif_pclmul crct10dif_common crc32_pclmul ghash_clmulni_intel aesni_intel
aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd evdev pcspkr ext4 crc16
mbcache jbd2 xen_blkfront xen_netfront crc32c_intel
[2583500.132056] CPU: 3 PID: 27690 Comm: serf Not tainted 3.16.0-0.bpo.4-amd64
#1 Debian 3.16.7-ckt4-3~bpo70+1
[2583500.132056] task: ffff8801f4517670 ti: ffff88013a134000 task.ti:
ffff88013a134000
[2583500.132056] RIP: e030:[<ffffffff810b7043>] [<ffffffff810b7043>]
queue_write_lock_slowpath+0x83/0x90
[2583500.132056] RSP: e02b:ffff88013a137bb0 EFLAGS: 00000202
[2583500.132056] RAX: 0000000000000007 RBX: 0000000000000001 RCX:
0000000000000000
[2583500.132056] RDX: 0000000000000009 RSI: ffffffff818bdc1c RDI:
ffffffff818bdc1c
[2583500.132056] RBP: 00000001264e5a85 R08: 0000000000000020 R09:
0000000000000001
[2583500.132056] R10: 000000000a6b3ceb R11: ffff88013a137b38 R12:
ffffffff818bda40
[2583500.132056] R13: ffff8800e8a2be00 R14: ffff8801f18f0000 R15:
ffff8801f3257200
[2583500.132056] FS: 000000c208019b70(0000) GS:ffff8801feac0000(0000)
knlGS:0000000000000000
[2583500.132056] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[2583500.132056] CR2: ffffffffff600400 CR3: 00000001f2aa7000 CR4:
0000000000002660
[2583500.132056] Stack:
[2583500.132056] ffffffff8145998b ffff8801f32572e8 ffff8801f32572e8
ffffffff000000b8
[2583500.132056] 0000000000000004 ffff88013a137c54 ffffffff818bdc1c
00ff8801f18f0000
[2583500.132056] ffffffff8147f66f ffffffff8148afe0 ffffffff80000000
ffffffff818e6cc0
[2583500.132056] Call Trace:
[2583500.132056] [<ffffffff8145998b>] ? __neigh_create+0x1eb/0x5d0
[2583500.132056] [<ffffffff8147f66f>] ? nf_hook_slow+0x7f/0x160
[2583500.132056] [<ffffffff8148afe0>] ? ip_fragment+0x870/0x870
[2583500.132056] [<ffffffff8148b747>] ? ip_finish_output+0x767/0x8d0
[2583500.132056] [<ffffffff8148baba>] ? ip_queue_xmit+0x12a/0x3b0
[2583500.132056] [<ffffffff814a278e>] ? tcp_transmit_skb+0x41e/0x900
[2583500.132056] [<ffffffff814a3522>] ? tcp_connect+0x7e2/0x930
[2583500.132056] [<ffffffff810d22ee>] ? getnstimeofday+0xe/0x30
[2583500.132056] [<ffffffff810d2321>] ? ktime_get_real+0x11/0x50
[2583500.132056] [<ffffffff814a81ce>] ? tcp_v4_connect+0x2ee/0x410
[2583500.132056] [<ffffffff814bf6d6>] ? __inet_stream_connect+0x1f6/0x350
[2583500.132056] [<ffffffff81549536>] ? _raw_spin_lock_irqsave+0x16/0x50
[2583500.132056] [<ffffffff814bfb95>] ? inet_stream_connect+0x45/0x70
[2583500.132056] [<ffffffff814339b8>] ? SYSC_connect+0xe8/0x100
[2583500.132056] [<ffffffff8100b430>] ? xen_clocksource_read+0x20/0x30
[2583500.132056] [<ffffffff8100b430>] ? xen_clocksource_read+0x20/0x30
[2583500.132056] [<ffffffff810d20a2>] ? ktime_get_ts+0x42/0xd0
[2583500.132056] [<ffffffff8108e841>] ? posix_ktime_get_ts+0x11/0x20
[2583500.132056] [<ffffffff8108fc10>] ? SyS_clock_gettime+0x40/0x70
[2583500.132056] [<ffffffff81549a6d>] ?
system_call_fast_compare_end+0x10/0x15
[2583500.132056] Code: ff 00 00 00 eb 04 66 90 f3 90 8b 07 83 f8 01 75 f7 f0
0f b1 17 83 f8 01 75 ee eb bc 0f b7 47 04 66 39 d0 74 9c f3 90 0f b7 47 04
<66> 39 c2 75 f5 eb 8f 66 0f 1f 44 00 00 0f 1f 44 00 00 65 8b 04
[2583500.132054] pcspkr ext4 crc16 mbcache jbd2 xen_blkfront xen_netfront
crc32c_intel
[2583500.132054] CPU: 4 PID: 59 Comm: kworker/4:1 Not tainted
3.16.0-0.bpo.4-amd64 #1 Debian 3.16.7-ckt4-3~bpo70+1
[2583500.132054] Workqueue: events_power_efficient neigh_periodic_work
[2583500.132054] task: ffff8801f4da6ae0 ti: ffff8801f4e58000 task.ti:
ffff8801f4e58000
[2583500.132054] RIP: e030:[<ffffffff810b7043>] [<ffffffff810b7043>]
queue_write_lock_slowpath+0x83/0x90
[2583500.132054] RSP: e02b:ffff8801f4e5bdc0 EFLAGS: 00000a93
[2583500.132054] RAX: 000000000000c11c RBX: ffffffff818bdc1c RCX:
0000000000000008
[2583500.132054] RDX: 0000000000007ec0 RSI: 0000000000000200 RDI:
ffff8801f2783828
[2583500.132054] RBP: 00000000000000a4 R08: ffff8800fd2ed800 R09:
0000000000000000
[2583500.132054] R10: 0000000000000000 R11: 0000000000000000 R12:
ffff8801f2783800
[2583500.132054] R13: ffffffff818bdb30 R14: 0000000000000001 R15:
ffff8800fd2edd20
[2583500.132054] FS: 000000c2080ca4f0(0000) GS:ffff8801feb00000(0000)
knlGS:0000000000000000
[2583500.132054] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[2583500.132054] CR2: ffffffffff600400 CR3: 00000001f2aa7000 CR4:
0000000000002660
[2583500.132054] Stack:
[2583500.132054] ffffffff814582ab ffff88009558b480 ffff8801f4e23ac0
ffff8801feb12a00
[2583500.132054] ffff8801feb16800 0000000000000000 0000000000000000
ffffffff818bdb30
[2583500.132054] ffffffff8108891c 0000000000013200 ffff8801f4e5bfd8
0000000000013200
[2583500.132054] Call Trace:
[2583500.132054] [<ffffffff814582ab>] ? neigh_periodic_work+0xbb/0x1e0
[2583500.132054] [<ffffffff8108891c>] ? process_one_work+0x15c/0x450
[2583500.132054] [<ffffffff81089b72>] ? worker_thread+0x112/0x540
[2583500.132054] [<ffffffff81089a60>] ? create_and_start_worker+0x60/0x60
[2583500.132054] [<ffffffff81090541>] ? kthread+0xc1/0xe0
[2583500.132054] [<ffffffff81090480>] ? flush_kthread_worker+0xb0/0xb0
[2583500.132054] [<ffffffff815499bc>] ? ret_from_fork+0x7c/0xb0
[2583500.132054] [<ffffffff81090480>] ? flush_kthread_worker+0xb0/0xb0
[2583500.132054] Code: ff 00 00 00 eb 04 66 90 f3 90 8b 07 83 f8 01 75 f7 f0
0f b1 17 83 f8 01 75 ee eb bc 0f b7 47 04 66 39 d0 74 9c f3 90 0f b7 47 04
<66> 39 c2 75 f5 eb 8f 66 0f 1f 44 00 00 0f 1f 44 00 00 65 8b 04
[2583508.956054] INFO: rcu_sched self-detected stall on CPU { 4} (t=3271621
jiffies g=258996215 c=258996214 q=4436357)
[2583508.956054] sending NMI to all CPUs:
[2583508.956054] NMI backtrace for cpu 4
[2583508.956054] CPU: 4 PID: 59 Comm: kworker/4:1 Not tainted
3.16.0-0.bpo.4-amd64 #1 Debian 3.16.7-ckt4-3~bpo70+1
[2583508.956054] Workqueue: events_power_efficient neigh_periodic_work
[2583508.956054] task: ffff8801f4da6ae0 ti: ffff8801f4e58000 task.ti:
ffff8801f4e58000
[2583508.956054] RIP: e030:[<ffffffff8100130a>] [<ffffffff8100130a>]
xen_hypercall_vcpu_op+0xa/0x20
[2583508.956054] RSP: e02b:ffff8801feb03c30 EFLAGS: 00000046
[2583508.956054] RAX: 0000000000000000 RBX: ffffffff818e03c0 RCX:
ffffffff8100130a
[2583508.956054] RDX: 0000000000000000 RSI: 0000000000000004 RDI:
000000000000000b
[2583508.956054] RBP: ffffffff818dff60 R08: ffffffff818dff60 R09:
0000000000000000
[2583508.956054] R10: 00000000000264fa R11: 0000000000000246 R12:
0000000000000005
[2583508.956054] R13: 0000000000000004 R14: ffffffff818e0400 R15:
ffffffff818e0400
[2583508.956054] FS: 000000c2080ca4f0(0000) GS:ffff8801feb00000(0000)
knlGS:0000000000000000
[2583508.956054] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[2583508.956054] CR2: ffffffffff600400 CR3: 00000001f2aa7000 CR4:
0000000000002660
[2583508.956054] Stack:
[2583508.956054] 00000000000264f9 0000000000000004 ffffffff8137daf3
ffffffff818dff60
[2583508.956054] ffffffff81011713 0000000000000004 0000000000000001
ffffffff81852480
[2583508.956054] 0000000000000004 ffffffff81852480 ffffffff8104b700
ffff8801feb0d5e0
[2583508.956054] Call Trace:
[2583508.956054] <IRQ>
[2583508.956054] [<ffffffff8137daf3>] ? xen_send_IPI_one+0x43/0x60
[2583508.956054] [<ffffffff81011713>] ? __xen_send_IPI_mask+0x33/0x60
[2583508.956054] [<ffffffff8104b700>] ?
arch_trigger_all_cpu_backtrace+0x120/0x130
[2583508.956054] [<ffffffff810d0210>] ? rcu_check_callbacks+0x410/0x680
[2583508.956054] [<ffffffff810ac382>] ? trigger_load_balance+0x52/0x210
[2583508.956054] [<ffffffff8107bd14>] ? update_process_times+0x44/0x80
[2583508.956054] [<ffffffff810db39f>] ? tick_sched_handle.isra.12+0x2f/0x70
[2583508.956054] [<ffffffff810db4ca>] ? tick_sched_timer+0x4a/0x80
[2583508.956054] [<ffffffff81093350>] ? __run_hrtimer+0x70/0x210
[2583508.956054] [<ffffffff810db480>] ? tick_nohz_handler+0xa0/0xa0
[2583508.956054] [<ffffffff81093bc1>] ? hrtimer_interrupt+0x101/0x260
[2583508.956054] [<ffffffff8100b2e8>] ? xen_timer_interrupt+0x28/0x150
[2583508.956054] [<ffffffff813b7b21>] ? add_interrupt_randomness+0x51/0x200
[2583508.956054] [<ffffffff810c4f54>] ? handle_irq_event_percpu+0x54/0x1e0
[2583508.956054] [<ffffffff810c891a>] ? handle_percpu_irq+0x4a/0x80
[2583508.956054] [<ffffffff810c473d>] ? generic_handle_irq+0x1d/0x30
[2583508.956054] [<ffffffff8137e51d>] ? evtchn_2l_handle_events+0x24d/0x260
[2583508.956054] [<ffffffff8137bdff>] ? __xen_evtchn_do_upcall+0x3f/0x70
[2583508.956054] [<ffffffff8137db3f>] ? xen_evtchn_do_upcall+0x2f/0x50
[2583508.956054] [<ffffffff8154b71e>] ? xen_do_hypervisor_callback+0x1e/0x30
[2583508.956054] <EOI>
[2583508.956054] [<ffffffff810b703f>] ? queue_write_lock_slowpath+0x7f/0x90
[2583508.956054] [<ffffffff814582ab>] ? neigh_periodic_work+0xbb/0x1e0
[2583508.956054] [<ffffffff8108891c>] ? process_one_work+0x15c/0x450
[2583508.956054] [<ffffffff81089b72>] ? worker_thread+0x112/0x540
[2583508.956054] [<ffffffff81089a60>] ? create_and_start_worker+0x60/0x60
[2583508.956054] [<ffffffff81090541>] ? kthread+0xc1/0xe0
[2583508.956054] [<ffffffff81090480>] ? flush_kthread_worker+0xb0/0xb0
[2583508.956054] [<ffffffff815499bc>] ? ret_from_fork+0x7c/0xb0
[2583508.956054] [<ffffffff81090480>] ? flush_kthread_worker+0xb0/0xb0
[2583508.956054] Code: cc 51 41 53 50 b8 17 00 00 00 0f 05 5b 59 c3 cc cc cc
cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 18 00 00 00 0f 05
<41> 5b 59 c3 cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc
[2583508.956338] NMI backtrace for cpu 0
[2583508.956346] CPU: 0 PID: 27713 Comm: serf Not tainted 3.16.0-0.bpo.4-amd64
#1 Debian 3.16.7-ckt4-3~bpo70+1
[2583508.956351] task: ffff8800edbf2b60 ti: ffff8800f4db8000 task.ti:
ffff8800f4db8000
[2583508.956356] RIP: e030:[<ffffffff810b7004>] [<ffffffff810b7004>]
queue_write_lock_slowpath+0x44/0x90
[2583508.956365] RSP: e02b:ffff8800f4dbbb00 EFLAGS: 00000286
[2583508.956367] RAX: 00000000000000ff RBX: 0000000000000001 RCX:
0000000000000000
[2583508.956371] RDX: 00000000000000ff RSI: ffffffff818bdc1c RDI:
ffffffff818bdc1c
[2583508.956374] RBP: 00000001264c3d6c R08: 0000000000000020 R09:
0000000000000001
[2583508.956377] R10: 000000000a6b3c82 R11: ffff8800f4dbba88 R12:
ffffffff818bda40
[2583508.956381] R13: ffff8801f26a4e00 R14: ffff8801f18f0000 R15:
0000000000000059
[2583508.956387] FS: 000000c208049270(0000) GS:ffff8801fea00000(0000)
knlGS:0000000000000000
[2583508.956391] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[2583508.956394] CR2: 00007f9736adb000 CR3: 00000001f2aa7000 CR4:
0000000000002660
[2583508.956398] Stack:
[2583508.956399] ffffffff8145998b ffff880004156a00 ffff880004156a00
ffffffff000000b6
[2583508.956404] 0000000000000004 ffff8800f4dbbba4 ffffffff818bdc1c
00ff8801f18f0000
[2583508.956409] ffffffff8147f66f ffffffff8148afe0 ffffffff80000000
ffffffff818e6cc0
[2583508.956414] Call Trace:
[2583508.956418] [<ffffffff8145998b>] ? __neigh_create+0x1eb/0x5d0
[2583508.956424] [<ffffffff8147f66f>] ? nf_hook_slow+0x7f/0x160
[2583508.956428] [<ffffffff8148afe0>] ? ip_fragment+0x870/0x870
[2583508.956432] [<ffffffff8148b747>] ? ip_finish_output+0x767/0x8d0
[2583508.956436] [<ffffffff8148cd42>] ? ip_send_skb+0x12/0x40
[2583508.956441] [<ffffffff814b2e9f>] ? udp_send_skb+0x10f/0x280
[2583508.956445] [<ffffffff81489770>] ? ip_setup_cork+0x130/0x130
[2583508.956449] [<ffffffff814b3a98>] ? udp_sendmsg+0x308/0x8a0
[2583508.956454] [<ffffffff814331ca>] ? sock_sendmsg+0xda/0xf0
[2583508.956458] [<ffffffff814b44d2>] ? udp_poll+0x22/0xb0
[2583508.956463] [<ffffffff811feb90>] ? ep_poll_readyevents_proc+0x30/0x30
[2583508.956469] [<ffffffff81433861>] ? SYSC_sendto+0x121/0x190
[2583508.956477] [<ffffffff810e0150>] ? SyS_futex+0x150/0x1c0
[2583508.956483] [<ffffffff8100b430>] ? xen_clocksource_read+0x20/0x30
[2583508.956489] [<ffffffff810d1c84>] ? __getnstimeofday+0x34/0xb0
[2583508.956494] [<ffffffff810d22ee>] ? getnstimeofday+0xe/0x30
[2583508.956498] [<ffffffff81549a6d>] ?
system_call_fast_compare_end+0x10/0x15
[2583508.956501] Code: 8b 07 85 c0 75 23 ba ff 00 00 00 f0 0f b1 17 85 c0 75
16 0f 1f 40 00 66 83 47 04 01 c3 66 2e 0f 1f 84 00 00 00 00 00 f3 90 8b 17
<84> d2 75 f8 89 d1 89 d0 83 c9 01 f0 0f b1 0f 39 d0 75 e9 ba ff
[2583508.956539] NMI backtrace for cpu 1
[2583508.956550] CPU: 1 PID: 0 Comm: swapper/1 Not tainted
3.16.0-0.bpo.4-amd64 #1 Debian 3.16.7-ckt4-3~bpo70+1
[2583508.956557] task: ffff8801f51c0a20 ti: ffff8801f51c8000 task.ti:
ffff8801f51c8000
[2583508.956564] RIP: e030:[<ffffffff810b7043>] [<ffffffff810b7043>]
queue_write_lock_slowpath+0x83/0x90
[2583508.956575] RSP: e02b:ffff8801fea43c00 EFLAGS: 00000202
[2583508.956579] RAX: 0000000000000007 RBX: 0000000000000001 RCX:
0000000000000000
[2583508.956584] RDX: 0000000000000008 RSI: ffffffff818bdc1c RDI:
ffffffff818bdc1c
[2583508.956590] RBP: 00000001264c55e3 R08: 000000000a6b3ca4 R09:
ffff8801fea43b88
[2583508.956597] R10: 000000000a6b3ca4 R11: ffff8801fea43b88 R12:
ffffffff818bda40
[2583508.956603] R13: ffff8800edb6d200 R14: ffff8801f4d98000 R15:
ffffffff818b7bc0
[2583508.956612] FS: 00007f9730008700(0000) GS:ffff8801fea40000(0000)
knlGS:0000000000000000
[2583508.956617] CS: e033 DS: 002b ES: 002b CR0: 000000008005003b
[2583508.956622] CR2: ffffffffff600400 CR3: 000000014478d000 CR4:
0000000000002660
[2583508.956627] Stack:
[2583508.956630] ffffffff8145998b ffff8800034a0700 ffff8800034a0700
ffffffff000000b7
[2583508.956638] 0000000000000004 ffff8801fea43ca4 ffffffff818bdc1c
00ff8801f4d98000
[2583508.956645] ffffffff8147f66f ffffffff8148afe0 ffffffff80000000
ffffffff818e6cc0
[2583508.956653] Call Trace:
[2583508.956656] <IRQ>
[2583508.956658] [<ffffffff8145998b>] ? __neigh_create+0x1eb/0x5d0
[2583508.956669] [<ffffffff8147f66f>] ? nf_hook_slow+0x7f/0x160
[2583508.956674] [<ffffffff8148afe0>] ? ip_fragment+0x870/0x870
[2583508.956681] [<ffffffff8148b747>] ? ip_finish_output+0x767/0x8d0
[2583508.956687] [<ffffffff8148cd42>] ? ip_send_skb+0x12/0x40
[2583508.956692] [<ffffffff814ba525>] ? icmp_send+0x445/0x520
[2583508.956699] [<ffffffff81093c0b>] ? hrtimer_interrupt+0x14b/0x260
[2583508.956705] [<ffffffff814583d0>] ? neigh_periodic_work+0x1e0/0x1e0
[2583508.956712] [<ffffffff81480efa>] ? ipv4_link_failure+0x1a/0x60
[2583508.956718] [<ffffffff814b716a>] ? arp_error_report+0x2a/0x40
[2583508.956724] [<ffffffff81457f4e>] ? neigh_invalidate+0x7e/0xf0
[2583508.956730] [<ffffffff81458562>] ? neigh_timer_handler+0x192/0x290
[2583508.956737] [<ffffffff814583d0>] ? neigh_periodic_work+0x1e0/0x1e0
[2583508.956743] [<ffffffff8107985c>] ? call_timer_fn+0x4c/0x150
[2583508.956749] [<ffffffff814583d0>] ? neigh_periodic_work+0x1e0/0x1e0
[2583508.956756] [<ffffffff8107b2c7>] ? run_timer_softirq+0x297/0x2e0
[2583508.956762] [<ffffffff81072c0e>] ? __do_softirq+0xde/0x2e0
[2583508.956768] [<ffffffff81073066>] ? irq_exit+0x86/0xb0
[2583508.956775] [<ffffffff8137db45>] ? xen_evtchn_do_upcall+0x35/0x50
[2583508.956781] [<ffffffff8154b71e>] ? xen_do_hypervisor_callback+0x1e/0x30
[2583508.956786] <EOI>
[2583508.956789] [<ffffffff810013aa>] ? xen_hypercall_sched_op+0xa/0x20
[2583508.956797] [<ffffffff810013aa>] ? xen_hypercall_sched_op+0xa/0x20
[2583508.956803] [<ffffffff8100b0ec>] ? xen_safe_halt+0xc/0x20
[2583508.956810] [<ffffffff8101f642>] ? default_idle+0x22/0xf0
[2583508.956817] [<ffffffff810b1818>] ? cpu_startup_entry+0x2e8/0x4b0
[2583508.956822] [<ffffffff8100b139>] ? xen_force_evtchn_callback+0x9/0x10
[2583508.956829] [<ffffffff8100ba12>] ? check_events+0x12/0x20
[2583508.956834] Code: ff 00 00 00 eb 04 66 90 f3 90 8b 07 83 f8 01 75 f7 f0
0f b1 17 83 f8 01 75 ee eb bc 0f b7 47 04 66 39 d0 74 9c f3 90 0f b7 47 04
<66> 39 c2 75 f5 eb 8f 66 0f 1f 44 00 00 0f 1f 44 00 00 65 8b 04
[2583508.956887] NMI backtrace for cpu 2
[2583508.956897] CPU: 2 PID: 0 Comm: swapper/2 Not tainted
3.16.0-0.bpo.4-amd64 #1 Debian 3.16.7-ckt4-3~bpo70+1
[2583508.956904] task: ffff8801f51c00d0 ti: ffff8801f51ec000 task.ti:
ffff8801f51ec000
[2583508.956909] RIP: e030:[<ffffffff810013aa>] [<ffffffff810013aa>]
xen_hypercall_sched_op+0xa/0x20
[2583508.956918] RSP: e02b:ffff8801f51efe80 EFLAGS: 00000246
[2583508.956923] RAX: 0000000000000000 RBX: ffffffff818e03c0 RCX:
ffffffff810013aa
[2583508.956928] RDX: ffff8801fea80000 RSI: 0000000000000000 RDI:
0000000000000001
[2583508.956933] RBP: 0000000000000000 R08: 0000000000000000 R09:
0000000000000000
[2583508.956939] R10: 0000000000000001 R11: 0000000000000246 R12:
0000000000000002
[2583508.956944] R13: ffff8801f51ec000 R14: 0000000000000000 R15:
ffff8801f51ec000
[2583508.956952] FS: 00007f9730008700(0000) GS:ffff8801fea80000(0000)
knlGS:0000000000000000
[2583508.956958] CS: e033 DS: 002b ES: 002b CR0: 000000008005003b
[2583508.956963] CR2: ffffffffff600400 CR3: 000000014478d000 CR4:
0000000000002660
[2583508.956968] Stack:
[2583508.956971] 00000001267e28e0 ffffffff81853f20 ffffffff8100b0ec
ffffffff8101f642
[2583508.956978] 0000000000000000 ffffffff818e03c0 0000000000000000
00000000ffffffed
[2583508.956985] ffff8801f51ec000 ffffffff810b1818 000000000000000a
ffffffff8100b139
[2583508.956993] Call Trace:
[2583508.956999] [<ffffffff8100b0ec>] ? xen_safe_halt+0xc/0x20
[2583508.957005] [<ffffffff8101f642>] ? default_idle+0x22/0xf0
[2583508.957010] [<ffffffff810b1818>] ? cpu_startup_entry+0x2e8/0x4b0
[2583508.957016] [<ffffffff8100b139>] ? xen_force_evtchn_callback+0x9/0x10
[2583508.957021] [<ffffffff8100ba12>] ? check_events+0x12/0x20
[2583508.957025] Code: cc 51 41 53 b8 1c 00 00 00 0f 05 41 5b 59 c3 cc cc cc
cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 1d 00 00 00 0f 05
<41> 5b 59 c3 cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc
[2583508.957077] NMI backtrace for cpu 3
[2583508.957084] CPU: 3 PID: 27690 Comm: serf Not tainted 3.16.0-0.bpo.4-amd64
#1 Debian 3.16.7-ckt4-3~bpo70+1
[2583508.957090] task: ffff8801f4517670 ti: ffff88013a134000 task.ti:
ffff88013a134000
[2583508.957094] RIP: e030:[<ffffffff810b7043>] [<ffffffff810b7043>]
queue_write_lock_slowpath+0x83/0x90
[2583508.957102] RSP: e02b:ffff88013a137bb0 EFLAGS: 00000202
[2583508.957104] RAX: 0000000000000007 RBX: 0000000000000001 RCX:
0000000000000000
[2583508.957107] RDX: 0000000000000009 RSI: ffffffff818bdc1c RDI:
ffffffff818bdc1c
[2583508.957110] RBP: 00000001264e5a85 R08: 0000000000000020 R09:
0000000000000001
[2583508.957114] R10: 000000000a6b3ceb R11: ffff88013a137b38 R12:
ffffffff818bda40
[2583508.957117] R13: ffff8800e8a2be00 R14: ffff8801f18f0000 R15:
ffff8801f3257200
[2583508.957122] FS: 000000c208019b70(0000) GS:ffff8801feac0000(0000)
knlGS:0000000000000000
[2583508.957126] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[2583508.957129] CR2: ffffffffff600400 CR3: 00000001f2aa7000 CR4:
0000000000002660
[2583508.957132] Stack:
[2583508.957134] ffffffff8145998b ffff8801f32572e8 ffff8801f32572e8
ffffffff000000b8
[2583508.957139] 0000000000000004 ffff88013a137c54 ffffffff818bdc1c
00ff8801f18f0000
[2583508.957143] ffffffff8147f66f ffffffff8148afe0 ffffffff80000000
ffffffff818e6cc0
[2583508.957148] Call Trace:
[2583508.957152] [<ffffffff8145998b>] ? __neigh_create+0x1eb/0x5d0
[2583508.957157] [<ffffffff8147f66f>] ? nf_hook_slow+0x7f/0x160
[2583508.957160] [<ffffffff8148afe0>] ? ip_fragment+0x870/0x870
[2583508.957164] [<ffffffff8148b747>] ? ip_finish_output+0x767/0x8d0
[2583508.957167] [<ffffffff8148baba>] ? ip_queue_xmit+0x12a/0x3b0
[2583508.957172] [<ffffffff814a278e>] ? tcp_transmit_skb+0x41e/0x900
[2583508.957176] [<ffffffff814a3522>] ? tcp_connect+0x7e2/0x930
[2583508.957180] [<ffffffff810d22ee>] ? getnstimeofday+0xe/0x30
[2583508.957184] [<ffffffff810d2321>] ? ktime_get_real+0x11/0x50
[2583508.957188] [<ffffffff814a81ce>] ? tcp_v4_connect+0x2ee/0x410
[2583508.957193] [<ffffffff814bf6d6>] ? __inet_stream_connect+0x1f6/0x350
[2583508.957197] [<ffffffff81549536>] ? _raw_spin_lock_irqsave+0x16/0x50
[2583508.957201] [<ffffffff814bfb95>] ? inet_stream_connect+0x45/0x70
[2583508.957204] [<ffffffff814339b8>] ? SYSC_connect+0xe8/0x100
[2583508.957208] [<ffffffff8100b430>] ? xen_clocksource_read+0x20/0x30
[2583508.957213] [<ffffffff8100b430>] ? xen_clocksource_read+0x20/0x30
[2583508.957217] [<ffffffff810d20a2>] ? ktime_get_ts+0x42/0xd0
[2583508.957222] [<ffffffff8108e841>] ? posix_ktime_get_ts+0x11/0x20
[2583508.957225] [<ffffffff8108fc10>] ? SyS_clock_gettime+0x40/0x70
[2583508.957229] [<ffffffff81549a6d>] ?
system_call_fast_compare_end+0x10/0x15
[2583508.957232] Code: ff 00 00 00 eb 04 66 90 f3 90 8b 07 83 f8 01 75 f7 f0
0f b1 17 83 f8 01 75 ee eb bc 0f b7 47 04 66 39 d0 74 9c f3 90 0f b7 47 04
<66> 39 c2 75 f5 eb 8f 66 0f 1f 44 00 00 0f 1f 44 00 00 65 8b 04
[2583508.957265] NMI backtrace for cpu 6
[2583508.957272] CPU: 6 PID: 0 Comm: swapper/6 Not tainted
3.16.0-0.bpo.4-amd64 #1 Debian 3.16.7-ckt4-3~bpo70+1
[2583508.957278] task: ffff8801f52013f0 ti: ffff8801f5204000 task.ti:
ffff8801f5204000
[2583508.957283] RIP: e030:[<ffffffff810013aa>] [<ffffffff810013aa>]
xen_hypercall_sched_op+0xa/0x20
[2583508.957292] RSP: e02b:ffff8801f5207e80 EFLAGS: 00000246
[2583508.957297] RAX: 0000000000000000 RBX: ffffffff818e03c0 RCX:
ffffffff810013aa
[2583508.957303] RDX: ffff8801feb80000 RSI: 0000000000000000 RDI:
0000000000000001
[2583508.957308] RBP: 0000000000000000 R08: 0000000000000000 R09:
0000000000000000
[2583508.957313] R10: 0000000000000001 R11: 0000000000000246 R12:
0000000000000006
[2583508.957319] R13: ffff8801f5204000 R14: 0000000000000000 R15:
ffff8801f5204000
[2583508.957327] FS: 00007f9730008700(0000) GS:ffff8801feb80000(0000)
knlGS:0000000000000000
[2583508.957333] CS: e033 DS: 002b ES: 002b CR0: 000000008005003b
[2583508.957338] CR2: ffffffffff600400 CR3: 00000000d9441000 CR4:
0000000000002660
[2583508.957344] Stack:
[2583508.957346] 00000001267e2901 ffffffff81853f20 ffffffff8100b0ec
ffffffff8101f642
[2583508.957353] 0000000000000000 ffffffff818e03c0 0000000000000000
00000000ffffffed
[2583508.957361] ffff8801f5204000 ffffffff810b1818 000000000000000a
ffffffff8100b139
[2583508.957368] Call Trace:
[2583508.957373] [<ffffffff8100b0ec>] ? xen_safe_halt+0xc/0x20
[2583508.957378] [<ffffffff8101f642>] ? default_idle+0x22/0xf0
[2583508.957383] [<ffffffff810b1818>] ? cpu_startup_entry+0x2e8/0x4b0
[2583508.957389] [<ffffffff8100b139>] ? xen_force_evtchn_callback+0x9/0x10
[2583508.957395] [<ffffffff8100ba12>] ? check_events+0x12/0x20
[2583508.957399] Code: cc 51 41 53 b8 1c 00 00 00 0f 05 41 5b 59 c3 cc cc cc
cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 1d 00 00 00 0f 05
<41> 5b 59 c3 cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc
[2583508.957446] NMI backtrace for cpu 5
[2583508.957455] CPU: 5 PID: 0 Comm: swapper/5 Not tainted
3.16.0-0.bpo.4-amd64 #1 Debian 3.16.7-ckt4-3~bpo70+1
[2583508.957462] task: ffff8801f51ea110 ti: ffff8801f51fc000 task.ti:
ffff8801f51fc000
[2583508.957467] RIP: e030:[<ffffffff810013aa>] [<ffffffff810013aa>]
xen_hypercall_sched_op+0xa/0x20
[2583508.957476] RSP: e02b:ffff8801f51ffe80 EFLAGS: 00000246
[2583508.968052] INFO: rcu_sched detected stalls on CPUs/tasks: { 4} (detected
by 3, t=3271623 jiffies, g=258996215, c=258996214, q=4436357)
[2583508.960057] RAX: 0000000000000000 RBX: ffffffff818e03c0 RCX:
ffffffff810013aa
[2583508.960057] RDX: ffff8801feb40000 RSI: 0000000000000000 RDI:
0000000000000001
[2583508.960057] RBP: 0000000000000000 R08: 0000000000000000 R09:
0000000000000000
[2583508.960057] R10: 0000000000000001 R11: 0000000000000246 R12:
0000000000000005
[2583508.960057] R13: ffff8801f51fc000 R14: 0000000000000000 R15:
ffff8801f51fc000
[2583508.960057] FS: 00007fb65f2f3700(0000) GS:ffff8801feb40000(0000)
knlGS:0000000000000000
[2583508.960057] CS: e033 DS: 002b ES: 002b CR0: 000000008005003b
[2583508.960057] CR2: ffffffffff600400 CR3: 00000001f16a7000 CR4:
0000000000002660
[2583508.960057] Stack:
[2583508.960057] 00000001267e2901 ffffffff81853f20 ffffffff8100b0ec
ffffffff8101f642
[2583508.960057] 0000000000000000 ffffffff818e03c0 0000000000000000
00000000ffffffed
[2583508.960057] ffff8801f51fc000 ffffffff810b1818 000000000000000a
ffffffff8100b139
[2583508.960057] Call Trace:
[2583508.960057] [<ffffffff8100b0ec>] ? xen_safe_halt+0xc/0x20
[2583508.960057] [<ffffffff8101f642>] ? default_idle+0x22/0xf0
[2583508.960057] [<ffffffff810b1818>] ? cpu_startup_entry+0x2e8/0x4b0
[2583508.960057] [<ffffffff8100b139>] ? xen_force_evtchn_callback+0x9/0x10
[2583508.960057] [<ffffffff8100ba12>] ? check_events+0x12/0x20
[2583508.960057] Code: cc 51 41 53 b8 1c 00 00 00 0f 05 41 5b 59 c3 cc cc cc
cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 1d 00 00 00 0f 05
<41> 5b 59 c3 cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc
[2583509.051196] NMI backtrace for cpu 7
[2583509.051196] CPU: 7 PID: 0 Comm: swapper/7 Not tainted
3.16.0-0.bpo.4-amd64 #1 Debian 3.16.7-ckt4-3~bpo70+1
[2583509.051196] task: ffff8801f5200aa0 ti: ffff8801f5208000 task.ti:
ffff8801f5208000
[2583509.051196] RIP: e030:[<ffffffff810013aa>] [<ffffffff810013aa>]
xen_hypercall_sched_op+0xa/0x20
[2583509.051196] RSP: e02b:ffff8801f520be80 EFLAGS: 00000246
[2583509.051196] RAX: 0000000000000000 RBX: ffffffff818e03c0 RCX:
ffffffff810013aa
[2583509.051196] RDX: ffff8801febc0000 RSI: 0000000000000000 RDI:
0000000000000001
[2583509.051196] RBP: 0000000000000000 R08: 0000000000000000 R09:
0000000000000001
[2583509.051196] R10: 0000000000000001 R11: 0000000000000246 R12:
0000000000000007
[2583509.051196] R13: ffff8801f5208000 R14: 0000000000000000 R15:
ffff8801f5208000
[2583509.051196] FS: 00007f9730008700(0000) GS:ffff8801febc0000(0000)
knlGS:0000000000000000
[2583509.051196] CS: e033 DS: 002b ES: 002b CR0: 000000008005003b
[2583509.051196] CR2: ffffffffff600400 CR3: 000000000351d000 CR4:
0000000000002660
[2583509.051196] Stack:
[2583509.051196] 00000001267e28f9 ffffffff81853f20 ffffffff8100b0ec
ffffffff8101f642
[2583509.051196] 0000000000000000 ffffffff818e03c0 0000000000000000
00000000ffffffed
[2583509.051196] ffff8801f5208000 ffffffff810b1818 000000000000000a
ffffffff8100b139
[2583509.051196] Call Trace:
[2583509.051196] [<ffffffff8100b0ec>] ? xen_safe_halt+0xc/0x20
[2583509.051196] [<ffffffff8101f642>] ? default_idle+0x22/0xf0
[2583509.051196] [<ffffffff810b1818>] ? cpu_startup_entry+0x2e8/0x4b0
[2583509.051196] [<ffffffff8100b139>] ? xen_force_evtchn_callback+0x9/0x10
[2583509.051196] [<ffffffff8100ba12>] ? check_events+0x12/0x20
[2583509.051196] Code: cc 51 41 53 b8 1c 00 00 00 0f 05 41 5b 59 c3 cc cc cc
cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 1d 00 00 00 0f 05
<41> 5b 59 c3 cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc
[2583536.076055] BUG: soft lockup - CPU#0 stuck for 22s! [serf:27713]
[2583536.076055] Modules linked in: xt_multiport ip6table_filter ip6_tables
xt_tcpudp nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack iptable_filter
ip_tables x_tables nf_conntrack x86_pkg_temp_thermal thermal_sys coretemp
crct10dif_pclmul crct10dif_common crc32_pclmul ghash_clmulni_intel aesni_intel
aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd evdev pcspkr ext4 crc16
mbcache jbd2 xen_blkfront xen_netfront crc32c_intel
[2583536.076055] CPU: 0 PID: 27713 Comm: serf Not tainted 3.16.0-0.bpo.4-amd64
#1 Debian 3.16.7-ckt4-3~bpo70+1
[2583536.076055] task: ffff8800edbf2b60 ti: ffff8800f4db8000 task.ti:
ffff8800f4db8000
[2583536.076055] RIP: e030:[<ffffffff810b7002>] [<ffffffff810b7002>]
queue_write_lock_slowpath+0x42/0x90
[2583536.076055] RSP: e02b:ffff8800f4dbbb00 EFLAGS: 00000286
[2583536.076055] RAX: 00000000000000ff RBX: 0000000000000001 RCX:
0000000000000000
[2583536.076055] RDX: 00000000000000ff RSI: ffffffff818bdc1c RDI:
ffffffff818bdc1c
[2583536.076055] RBP: 00000001264c3d6c R08: 0000000000000020 R09:
0000000000000001
[2583536.076055] R10: 000000000a6b3c82 R11: ffff8800f4dbba88 R12:
ffffffff818bda40
[2583536.076055] R13: ffff8801f26a4e00 R14: ffff8801f18f0000 R15:
0000000000000059
[2583536.076055] FS: 000000c208049270(0000) GS:ffff8801fea00000(0000)
knlGS:0000000000000000
[2583536.076055] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[2583536.076055] CR2: 00007f9736adb000 CR3: 00000001f2aa7000 CR4:
0000000000002660
[2583536.076055] Stack:
[2583536.076055] ffffffff8145998b ffff880004156a00 ffff880004156a00
ffffffff000000b6
[2583536.076055] 0000000000000004 ffff8800f4dbbba4 ffffffff818bdc1c
00ff8801f18f0000
[2583536.076055] ffffffff8147f66f ffffffff8148afe0 ffffffff80000000
ffffffff818e6cc0
[2583536.076055] Call Trace:
[2583536.076055] [<ffffffff8145998b>] ? __neigh_create+0x1eb/0x5d0
[2583536.076055] [<ffffffff8147f66f>] ? nf_hook_slow+0x7f/0x160
[2583536.076055] [<ffffffff8148afe0>] ? ip_fragment+0x870/0x870
[2583536.076055] [<ffffffff8148b747>] ? ip_finish_output+0x767/0x8d0
[2583536.076055] [<ffffffff8148cd42>] ? ip_send_skb+0x12/0x40
[2583536.076055] [<ffffffff814b2e9f>] ? udp_send_skb+0x10f/0x280
[2583536.076055] [<ffffffff81489770>] ? ip_setup_cork+0x130/0x130
[2583536.076055] [<ffffffff814b3a98>] ? udp_sendmsg+0x308/0x8a0
[2583536.076055] [<ffffffff814331ca>] ? sock_sendmsg+0xda/0xf0
[2583536.076055] [<ffffffff814b44d2>] ? udp_poll+0x22/0xb0
[2583536.076055] [<ffffffff811feb90>] ? ep_poll_readyevents_proc+0x30/0x30
[2583536.076055] [<ffffffff81433861>] ? SYSC_sendto+0x121/0x190
[2583536.076055] [<ffffffff810e0150>] ? SyS_futex+0x150/0x1c0
[2583536.076055] [<ffffffff8100b430>] ? xen_clocksource_read+0x20/0x30
[2583536.076055] [<ffffffff810d1c84>] ? __getnstimeofday+0x34/0xb0
[2583536.076055] [<ffffffff810d22ee>] ? getnstimeofday+0xe/0x30
[2583536.076055] [<ffffffff81549a6d>] ?
system_call_fast_compare_end+0x10/0x15
[2583536.076055] Code: 75 5b 8b 07 85 c0 75 23 ba ff 00 00 00 f0 0f b1 17 85
c0 75 16 0f 1f 40 00 66 83 47 04 01 c3 66 2e 0f 1f 84 00 00 00 00 00 f3 90
<8b> 17 84 d2 75 f8 89 d1 89 d0 83 c9 01 f0 0f b1 0f 39 d0 75 e9
[2583536.132054] BUG: soft lockup - CPU#4 stuck for 22s! [kworker/4:1:59]
[2583536.132053] BUG: soft lockup - CPU#3 stuck for 22s! [serf:27690]
[2583536.132053] Modules linked in: xt_multiport ip6table_filter ip6_tables
xt_tcpudp nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack iptable_filter
ip_tables x_tables nf_conntrack x86_pkg_temp_thermal thermal_sys coretemp
crct10dif_pclmul crct10dif_common crc32_pclmul ghash_clmulni_intel aesni_intel
aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd evdev
pcspkr[2583536.132054] Modules linked in: xt_multiport ip6table_filter
ip6_tables xt_tcpudp nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack
iptable_filter ip_tables x_tables nf_conntrack x86_pkg_temp_thermal
thermal_sys coretemp crct10dif_pclmul crct10dif_common crc32_pclmul
ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper
ablk_helper cryptd evdev pcspkr ext4 crc16 mbcache jbd2 xen_blkfront
xen_netfront crc32c_intel
[2583536.132054] CPU: 4 PID: 59 Comm: kworker/4:1 Not tainted
3.16.0-0.bpo.4-amd64 #1 Debian 3.16.7-ckt4-3~bpo70+1
[2583536.132054] Workqueue: events_power_efficient neigh_periodic_work
[2583536.132054] task: ffff8801f4da6ae0 ti: ffff8801f4e58000 task.ti:
ffff8801f4e58000
[2583536.132054] RIP: e030:[<ffffffff810b7043>] [<ffffffff810b7043>]
queue_write_lock_slowpath+0x83/0x90
[2583536.132054] RSP: e02b:ffff8801f4e5bdc0 EFLAGS: 00000a93
[2583536.132054] RAX: 000000000000c11c RBX: ffffffff818bdc1c RCX:
0000000000000008
[2583536.132054] RDX: 0000000000007ec0 RSI: 0000000000000200 RDI:
ffff8801f2783828
[2583536.132054] RBP: 00000000000000a4 R08: ffff8800fd2ed800 R09:
0000000000000000
[2583536.132054] R10: 0000000000000000 R11: 0000000000000000 R12:
ffff8801f2783800
[2583536.132054] R13: ffffffff818bdb30 R14: 0000000000000001 R15:
ffff8800fd2edd20
[2583536.132054] FS: 000000c2080ca4f0(0000) GS:ffff8801feb00000(0000)
knlGS:0000000000000000
[2583536.132054] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[2583536.132054] CR2: ffffffffff600400 CR3: 00000001f2aa7000 CR4:
0000000000002660
[2583536.132054] Stack:
[2583536.132054] ffffffff814582ab ffff88009558b480 ffff8801f4e23ac0
ffff8801feb12a00
[2583536.132054] ffff8801feb16800 0000000000000000 0000000000000000
ffffffff818bdb30
[2583536.132054] ffffffff8108891c 0000000000013200 ffff8801f4e5bfd8
0000000000013200
[2583536.132054] Call Trace:
[2583536.132054] [<ffffffff814582ab>] ? neigh_periodic_work+0xbb/0x1e0
[2583536.132054] [<ffffffff8108891c>] ? process_one_work+0x15c/0x450
[2583536.132054] [<ffffffff81089b72>] ? worker_thread+0x112/0x540
[2583536.132054] [<ffffffff81089a60>] ? create_and_start_worker+0x60/0x60
[2583536.132054] [<ffffffff81090541>] ? kthread+0xc1/0xe0
[2583536.132054] [<ffffffff81090480>] ? flush_kthread_worker+0xb0/0xb0
[2583536.132054] [<ffffffff815499bc>] ? ret_from_fork+0x7c/0xb0
[2583536.132054] [<ffffffff81090480>] ? flush_kthread_worker+0xb0/0xb0
[2583536.132054] Code: ff 00 00 00 eb 04 66 90 f3 90 8b 07 83 f8 01 75 f7 f0
0f b1 17 83 f8 01 75 ee eb bc 0f b7 47 04 66 39 d0 74 9c f3 90 0f b7 47 04
<66> 39 c2 75 f5 eb 8f 66 0f 1f 44 00 00 0f 1f 44 00 00 65 8b 04
[2583536.132053] ext4 crc16 mbcache jbd2 xen_blkfront xen_netfront
crc32c_intel
[2583536.132053] CPU: 3 PID: 27690 Comm: serf Not tainted 3.16.0-0.bpo.4-amd64
#1 Debian 3.16.7-ckt4-3~bpo70+1
[2583536.132053] task: ffff8801f4517670 ti: ffff88013a134000 task.ti:
ffff88013a134000
[2583536.132053] RIP: e030:[<ffffffff810b703f>] [<ffffffff810b703f>]
queue_write_lock_slowpath+0x7f/0x90
[2583536.132053] RSP: e02b:ffff88013a137bb0 EFLAGS: 00000202
[2583536.132053] RAX: 0000000000000007 RBX: 0000000000000001 RCX:
0000000000000000
[2583536.132053] RDX: 0000000000000009 RSI: ffffffff818bdc1c RDI:
ffffffff818bdc1c
[2583536.132053] RBP: 00000001264e5a85 R08: 0000000000000020 R09:
0000000000000001
[2583536.132053] R10: 000000000a6b3ceb R11: ffff88013a137b38 R12:
ffffffff818bda40
[2583536.132053] R13: ffff8800e8a2be00 R14: ffff8801f18f0000 R15:
ffff8801f3257200
[2583536.132053] FS: 000000c208019b70(0000) GS:ffff8801feac0000(0000)
knlGS:0000000000000000
[2583536.132053] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[2583536.132053] CR2: ffffffffff600400 CR3: 00000001f2aa7000 CR4:
0000000000002660
[2583536.132053] Stack:
[2583536.132053] ffffffff8145998b ffff8801f32572e8 ffff8801f32572e8
ffffffff000000b8
[2583536.132053] 0000000000000004 ffff88013a137c54 ffffffff818bdc1c
00ff8801f18f0000
[2583536.132053] ffffffff8147f66f ffffffff8148afe0 ffffffff80000000
ffffffff818e6cc0
[2583536.132053] Call Trace:
[2583536.132053] [<ffffffff8145998b>] ? __neigh_create+0x1eb/0x5d0
[2583536.132053] [<ffffffff8147f66f>] ? nf_hook_slow+0x7f/0x160
[2583536.132053] [<ffffffff8148afe0>] ? ip_fragment+0x870/0x870
[2583536.132053] [<ffffffff8148b747>] ? ip_finish_output+0x767/0x8d0
[2583536.132053] [<ffffffff8148baba>] ? ip_queue_xmit+0x12a/0x3b0
[2583536.132053] [<ffffffff814a278e>] ? tcp_transmit_skb+0x41e/0x900
[2583536.132053] [<ffffffff814a3522>] ? tcp_connect+0x7e2/0x930
[2583536.132053] [<ffffffff810d22ee>] ? getnstimeofday+0xe/0x30
[2583536.132053] [<ffffffff810d2321>] ? ktime_get_real+0x11/0x50
[2583536.132053] [<ffffffff814a81ce>] ? tcp_v4_connect+0x2ee/0x410
[2583536.132053] [<ffffffff814bf6d6>] ? __inet_stream_connect+0x1f6/0x350
[2583536.132053] [<ffffffff81549536>] ? _raw_spin_lock_irqsave+0x16/0x50
[2583536.132053] [<ffffffff814bfb95>] ? inet_stream_connect+0x45/0x70
[2583536.132053] [<ffffffff814339b8>] ? SYSC_connect+0xe8/0x100
[2583536.132053] [<ffffffff8100b430>] ? xen_clocksource_read+0x20/0x30
[2583536.132053] [<ffffffff8100b430>] ? xen_clocksource_read+0x20/0x30
[2583536.132053] [<ffffffff810d20a2>] ? ktime_get_ts+0x42/0xd0
[2583536.132053] [<ffffffff8108e841>] ? posix_ktime_get_ts+0x11/0x20
[2583536.132053] [<ffffffff8108fc10>] ? SyS_clock_gettime+0x40/0x70
[2583536.132053] [<ffffffff81549a6d>] ?
system_call_fast_compare_end+0x10/0x15
[2583536.132053] Code: d0 75 e9 ba ff 00 00 00 eb 04 66 90 f3 90 8b 07 83 f8
01 75 f7 f0 0f b1 17 83 f8 01 75 ee eb bc 0f b7 47 04 66 39 d0 74 9c f3 90
<0f> b7 47 04 66 39 c2 75 f5 eb 8f 66 0f 1f 44 00 00 0f 1f 44 00
[2583564.076053] BUG: soft lockup - CPU#0 stuck for 22s! [serf:27713]
[2583564.076053] Modules linked in: xt_multiport ip6table_filter ip6_tables
xt_tcpudp nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack iptable_filter
ip_tables x_tables nf_conntrack x86_pkg_temp_thermal thermal_sys coretemp
crct10dif_pclmul crct10dif_common crc32_pclmul ghash_clmulni_intel aesni_intel
aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd evdev pcspkr ext4 crc16
mbcache jbd2 xen_blkfront xen_netfront crc32c_intel
[2583564.076053] CPU: 0 PID: 27713 Comm: serf Not tainted 3.16.0-0.bpo.4-amd64
#1 Debian 3.16.7-ckt4-3~bpo70+1
[2583564.076053] task: ffff8800edbf2b60 ti: ffff8800f4db8000 task.ti:
ffff8800f4db8000
[2583564.076053] RIP: e030:[<ffffffff810b7004>] [<ffffffff810b7004>]
queue_write_lock_slowpath+0x44/0x90
[2583564.076053] RSP: e02b:ffff8800f4dbbb00 EFLAGS: 00000286
[2583564.076053] RAX: 00000000000000ff RBX: 0000000000000001 RCX:
0000000000000000
[2583564.076053] RDX: 00000000000000ff RSI: ffffffff818bdc1c RDI:
ffffffff818bdc1c
[2583564.076053] RBP: 00000001264c3d6c R08: 0000000000000020 R09:
0000000000000001
[2583564.076053] R10: 000000000a6b3c82 R11: ffff8800f4dbba88 R12:
ffffffff818bda40
[2583564.076053] R13: ffff8801f26a4e00 R14: ffff8801f18f0000 R15:
0000000000000059
[2583564.076053] FS: 000000c208049270(0000) GS:ffff8801fea00000(0000)
knlGS:0000000000000000
[2583564.076053] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[2583564.076053] CR2: 00007f9736adb000 CR3: 00000001f2aa7000 CR4:
0000000000002660
[2583564.076053] Stack:
[2583564.076053] ffffffff8145998b ffff880004156a00 ffff880004156a00
ffffffff000000b6
[2583564.076053] 0000000000000004 ffff8800f4dbbba4 ffffffff818bdc1c
00ff8801f18f0000
[2583564.076053] ffffffff8147f66f ffffffff8148afe0 ffffffff80000000
ffffffff818e6cc0
[2583564.076053] Call Trace:
[2583564.076053] [<ffffffff8145998b>] ? __neigh_create+0x1eb/0x5d0
[2583564.076053] [<ffffffff8147f66f>] ? nf_hook_slow+0x7f/0x160
[2583564.076053] [<ffffffff8148afe0>] ? ip_fragment+0x870/0x870
[2583564.076053] [<ffffffff8148b747>] ? ip_finish_output+0x767/0x8d0
[2583564.076053] [<ffffffff8148cd42>] ? ip_send_skb+0x12/0x40
[2583564.076053] [<ffffffff814b2e9f>] ? udp_send_skb+0x10f/0x280
[2583564.076053] [<ffffffff81489770>] ? ip_setup_cork+0x130/0x130
[2583564.076053] [<ffffffff814b3a98>] ? udp_sendmsg+0x308/0x8a0
[2583564.076053] [<ffffffff814331ca>] ? sock_sendmsg+0xda/0xf0
[2583564.076053] [<ffffffff814b44d2>] ? udp_poll+0x22/0xb0
[2583564.076053] [<ffffffff811feb90>] ? ep_poll_readyevents_proc+0x30/0x30
[2583564.076053] [<ffffffff81433861>] ? SYSC_sendto+0x121/0x190
[2583564.076053] [<ffffffff810e0150>] ? SyS_futex+0x150/0x1c0
[2583564.076053] [<ffffffff8100b430>] ? xen_clocksource_read+0x20/0x30
[2583564.076053] [<ffffffff810d1c84>] ? __getnstimeofday+0x34/0xb0
[2583564.076053] [<ffffffff810d22ee>] ? getnstimeofday+0xe/0x30
[2583564.076053] [<ffffffff81549a6d>] ?
system_call_fast_compare_end+0x10/0x15
[2583564.076053] Code: 8b 07 85 c0 75 23 ba ff 00 00 00 f0 0f b1 17 85 c0 75
16 0f 1f 40 00 66 83 47 04 01 c3 66 2e 0f 1f 84 00 00 00 00 00 f3 90 8b 17
<84> d2 75 f8 89 d1 89 d0 83 c9 01 f0 0f b1 0f 39 d0 75 e9 ba ff
[2583564.132051] BUG: soft lockup - CPU#3 stuck for 22s! [serf:27690]
[2583564.132056] BUG: soft lockup - CPU#4 stuck for 22s! [kworker/4:1:59]
[2583564.132056] Modules linked in: xt_multiport ip6table_filter ip6_tables
xt_tcpudp nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack iptable_filter
ip_tables x_tables nf_conntrack x86_pkg_temp_thermal thermal_sys coretemp
crct10dif_pclmul crct10dif_common crc32_pclmul ghash_clmulni_intel aesni_intel
aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd evdev pcspkr
ext4[2583564.132051] Modules linked in: xt_multiport ip6table_filter
ip6_tables xt_tcpudp nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack
iptable_filter ip_tables x_tables nf_conntrack x86_pkg_temp_thermal
thermal_sys coretemp crct10dif_pclmul crct10dif_common crc32_pclmul
ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper
ablk_helper cryptd evdev pcspkr ext4 crc16 mbcache jbd2 xen_blkfront
xen_netfront crc32c_intel
[2583564.132051] CPU: 3 PID: 27690 Comm: serf Not tainted 3.16.0-0.bpo.4-amd64
#1 Debian 3.16.7-ckt4-3~bpo70+1
[2583564.132051] task: ffff8801f4517670 ti: ffff88013a134000 task.ti:
ffff88013a134000
[2583564.132051] RIP: e030:[<ffffffff810b703f>] [<ffffffff810b703f>]
queue_write_lock_slowpath+0x7f/0x90
[2583564.132051] RSP: e02b:ffff88013a137bb0 EFLAGS: 00000202
[2583564.132051] RAX: 0000000000000007 RBX: 0000000000000001 RCX:
0000000000000000
[2583564.132051] RDX: 0000000000000009 RSI: ffffffff818bdc1c RDI:
ffffffff818bdc1c
[2583564.132051] RBP: 00000001264e5a85 R08: 0000000000000020 R09:
0000000000000001
[2583564.132051] R10: 000000000a6b3ceb R11: ffff88013a137b38 R12:
ffffffff818bda40
[2583564.132051] R13: ffff8800e8a2be00 R14: ffff8801f18f0000 R15:
ffff8801f3257200
[2583564.132051] FS: 000000c208019b70(0000) GS:ffff8801feac0000(0000)
knlGS:0000000000000000
[2583564.132051] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[2583564.132051] CR2: ffffffffff600400 CR3: 00000001f2aa7000 CR4:
0000000000002660
[2583564.132051] Stack:
[2583564.132051] ffffffff8145998b ffff8801f32572e8 ffff8801f32572e8
ffffffff000000b8
[2583564.132051] 0000000000000004 ffff88013a137c54 ffffffff818bdc1c
00ff8801f18f0000
[2583564.132051] ffffffff8147f66f ffffffff8148afe0 ffffffff80000000
ffffffff818e6cc0
[2583564.132051] Call Trace:
[2583564.132051] [<ffffffff8145998b>] ? __neigh_create+0x1eb/0x5d0
[2583564.132051] [<ffffffff8147f66f>] ? nf_hook_slow+0x7f/0x160
[2583564.132051] [<ffffffff8148afe0>] ? ip_fragment+0x870/0x870
[2583564.132051] [<ffffffff8148b747>] ? ip_finish_output+0x767/0x8d0
[2583564.132051] [<ffffffff8148baba>] ? ip_queue_xmit+0x12a/0x3b0
[2583564.132051] [<ffffffff814a278e>] ? tcp_transmit_skb+0x41e/0x900
[2583564.132051] [<ffffffff814a3522>] ? tcp_connect+0x7e2/0x930
[2583564.132051] [<ffffffff810d22ee>] ? getnstimeofday+0xe/0x30
[2583564.132051] [<ffffffff810d2321>] ? ktime_get_real+0x11/0x50
[2583564.132051] [<ffffffff814a81ce>] ? tcp_v4_connect+0x2ee/0x410
[2583564.132051] [<ffffffff814bf6d6>] ? __inet_stream_connect+0x1f6/0x350
[2583564.132051] [<ffffffff81549536>] ? _raw_spin_lock_irqsave+0x16/0x50
[2583564.132051] [<ffffffff814bfb95>] ? inet_stream_connect+0x45/0x70
[2583564.132051] [<ffffffff814339b8>] ? SYSC_connect+0xe8/0x100
[2583564.132051] [<ffffffff8100b430>] ? xen_clocksource_read+0x20/0x30
[2583564.132051] [<ffffffff8100b430>] ? xen_clocksource_read+0x20/0x30
[2583564.132051] [<ffffffff810d20a2>] ? ktime_get_ts+0x42/0xd0
[2583564.132051] [<ffffffff8108e841>] ? posix_ktime_get_ts+0x11/0x20
[2583564.132051] [<ffffffff8108fc10>] ? SyS_clock_gettime+0x40/0x70
[2583564.132051] [<ffffffff81549a6d>] ?
system_call_fast_compare_end+0x10/0x15
[2583564.132051] Code: d0 75 e9 ba ff 00 00 00 eb 04 66 90 f3 90 8b 07 83 f8
01 75 f7 f0 0f b1 17 83 f8 01 75 ee eb bc 0f b7 47 04 66 39 d0 74 9c f3 90
<0f> b7 47 04 66 39 c2 75 f5 eb 8f 66 0f 1f 44 00 00 0f 1f 44 00
[2583564.132056] crc16 mbcache jbd2 xen_blkfront xen_netfront crc32c_intel
[2583564.132056] CPU: 4 PID: 59 Comm: kworker/4:1 Not tainted
3.16.0-0.bpo.4-amd64 #1 Debian 3.16.7-ckt4-3~bpo70+1
[2583564.132056] Workqueue: events_power_efficient neigh_periodic_work
[2583564.132056] task: ffff8801f4da6ae0 ti: ffff8801f4e58000 task.ti:
ffff8801f4e58000
[2583564.132056] RIP: e030:[<ffffffff810b7043>] [<ffffffff810b7043>]
queue_write_lock_slowpath+0x83/0x90
[2583564.132056] RSP: e02b:ffff8801f4e5bdc0 EFLAGS: 00000a93
[2583564.132056] RAX: 000000000000c11c RBX: ffffffff818bdc1c RCX:
0000000000000008
[2583564.132056] RDX: 0000000000007ec0 RSI: 0000000000000200 RDI:
ffff8801f2783828
[2583564.132056] RBP: 00000000000000a4 R08: ffff8800fd2ed800 R09:
0000000000000000
[2583564.132056] R10: 0000000000000000 R11: 0000000000000000 R12:
ffff8801f2783800
[2583564.132056] R13: ffffffff818bdb30 R14: 0000000000000001 R15:
ffff8800fd2edd20
[2583564.132056] FS: 000000c2080ca4f0(0000) GS:ffff8801feb00000(0000)
knlGS:0000000000000000
[2583564.132056] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[2583564.132056] CR2: ffffffffff600400 CR3: 00000001f2aa7000 CR4:
0000000000002660
[2583564.132056] Stack:
[2583564.132056] ffffffff814582ab ffff88009558b480 ffff8801f4e23ac0
ffff8801feb12a00
[2583564.132056] ffff8801feb16800 0000000000000000 0000000000000000
ffffffff818bdb30
[2583564.132056] ffffffff8108891c 0000000000013200 ffff8801f4e5bfd8
0000000000013200
[2583564.132056] Call Trace:
[2583564.132056] [<ffffffff814582ab>] ? neigh_periodic_work+0xbb/0x1e0
[2583564.132056] [<ffffffff8108891c>] ? process_one_work+0x15c/0x450
[2583564.132056] [<ffffffff81089b72>] ? worker_thread+0x112/0x540
[2583564.132056] [<ffffffff81089a60>] ? create_and_start_worker+0x60/0x60
[2583564.132056] [<ffffffff81090541>] ? kthread+0xc1/0xe0
[2583564.132056] [<ffffffff81090480>] ? flush_kthread_worker+0xb0/0xb0
[2583564.132056] [<ffffffff815499bc>] ? ret_from_fork+0x7c/0xb0
[2583564.132056] [<ffffffff81090480>] ? flush_kthread_worker+0xb0/0xb0
[2583564.132056] Code: ff 00 00 00 eb 04 66 90 f3 90 8b 07 83 f8 01 75 f7 f0
0f b1 17 83 f8 01 75 ee eb bc 0f b7 47 04 66 39 d0 74 9c f3 90 0f b7 47 04
<66> 39 c2 75 f5 eb 8f 66 0f 1f 44 00 00 0f 1f 44 00 00 65 8b 04
[2583571.976065] INFO: rcu_sched self-detected stall on CPU { 4} (t=3287376
jiffies g=258996215 c=258996214 q=4436445)
[2583571.976065] sending NMI to all CPUs:
[2583571.976065] NMI backtrace for cpu 4
[2583571.976065] CPU: 4 PID: 59 Comm: kworker/4:1 Not tainted
3.16.0-0.bpo.4-amd64 #1 Debian 3.16.7-ckt4-3~bpo70+1
[2583571.976065] Workqueue: events_power_efficient neigh_periodic_work
[2583571.976065] task: ffff8801f4da6ae0 ti: ffff8801f4e58000 task.ti:
ffff8801f4e58000
[2583571.976065] RIP: e030:[<ffffffff8100130a>] [<ffffffff8100130a>]
xen_hypercall_vcpu_op+0xa/0x20
[2583571.976065] RSP: e02b:ffff8801feb03c30 EFLAGS: 00000046
[2583571.976065] RAX: 0000000000000000 RBX: ffffffff818e03c0 RCX:
ffffffff8100130a
[2583571.976065] RDX: 0000000000000000 RSI: 0000000000000004 RDI:
000000000000000b
[2583571.976065] RBP: ffffffff818dff60 R08: ffffffff818dff60 R09:
0000000000000000
[2583571.976065] R10: 00000000000267e6 R11: 0000000000000246 R12:
0000000000000005
[2583571.976065] R13: 0000000000000004 R14: ffffffff818e0400 R15:
ffffffff818e0400
[2583571.976065] FS: 000000c2080ca4f0(0000) GS:ffff8801feb00000(0000)
knlGS:0000000000000000
[2583571.976065] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[2583571.976065] CR2: ffffffffff600400 CR3: 00000001f2aa7000 CR4:
0000000000002660
[2583571.976065] Stack:
[2583571.976065] 00000000000267e5 0000000000000004 ffffffff8137daf3
ffffffff818dff60
[2583571.976065] ffffffff81011713 0000000000000004 0000000000000001
ffffffff81852480
[2583571.976065] 0000000000000004 ffffffff81852480 ffffffff8104b700
ffff8801feb0d5e0
[2583571.976065] Call Trace:
[2583571.976065] <IRQ>
[2583571.976065] [<ffffffff8137daf3>] ? xen_send_IPI_one+0x43/0x60
[2583571.976065] [<ffffffff81011713>] ? __xen_send_IPI_mask+0x33/0x60
[2583571.976065] [<ffffffff8104b700>] ?
arch_trigger_all_cpu_backtrace+0x120/0x130
[2583571.976065] [<ffffffff810d0210>] ? rcu_check_callbacks+0x410/0x680
[2583571.976065] [<ffffffff810c7c9e>] ? irq_get_irq_data+0xe/0x20
[2583571.976065] [<ffffffff8107bd14>] ? update_process_times+0x44/0x80
[2583571.976065] [<ffffffff810db39f>] ? tick_sched_handle.isra.12+0x2f/0x70
[2583571.976065] [<ffffffff810db4ca>] ? tick_sched_timer+0x4a/0x80
[2583571.976065] [<ffffffff81093350>] ? __run_hrtimer+0x70/0x210
[2583571.976065] [<ffffffff810db480>] ? tick_nohz_handler+0xa0/0xa0
[2583571.976065] [<ffffffff81093bc1>] ? hrtimer_interrupt+0x101/0x260
[2583571.976065] [<ffffffff8100b2e8>] ? xen_timer_interrupt+0x28/0x150
[2583571.976065] [<ffffffff813b7b21>] ? add_interrupt_randomness+0x51/0x200
[2583571.976065] [<ffffffff810c4f54>] ? handle_irq_event_percpu+0x54/0x1e0
[2583571.976065] [<ffffffff810c891a>] ? handle_percpu_irq+0x4a/0x80
[2583571.976065] [<ffffffff810c473d>] ? generic_handle_irq+0x1d/0x30
[2583571.976065] [<ffffffff8137e51d>] ? evtchn_2l_handle_events+0x24d/0x260
[2583571.976065] [<ffffffff8137bdff>] ? __xen_evtchn_do_upcall+0x3f/0x70
[2583571.976065] [<ffffffff8137db3f>] ? xen_evtchn_do_upcall+0x2f/0x50
[2583571.976065] [<ffffffff8154b71e>] ? xen_do_hypervisor_callback+0x1e/0x30
[2583571.976065] <EOI>
[2583571.976065] [<ffffffff810b703f>] ? queue_write_lock_slowpath+0x7f/0x90
[2583571.976065] [<ffffffff814582ab>] ? neigh_periodic_work+0xbb/0x1e0
[2583571.976065] [<ffffffff8108891c>] ? process_one_work+0x15c/0x450
[2583571.976065] [<ffffffff81089b72>] ? worker_thread+0x112/0x540
[2583571.976065] [<ffffffff81089a60>] ? create_and_start_worker+0x60/0x60
[2583571.976065] [<ffffffff81090541>] ? kthread+0xc1/0xe0
[2583571.976065] [<ffffffff81090480>] ? flush_kthread_worker+0xb0/0xb0
[2583571.976065] [<ffffffff815499bc>] ? ret_from_fork+0x7c/0xb0
[2583571.976065] [<ffffffff81090480>] ? flush_kthread_worker+0xb0/0xb0
[2583571.976065] Code: cc 51 41 53 50 b8 17 00 00 00 0f 05 5b 59 c3 cc cc cc
cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 18 00 00 00 0f 05
<41> 5b 59 c3 cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc
[2583571.977101] NMI backtrace for cpu 3
[2583571.977119] CPU: 3 PID: 27690 Comm: serf Not tainted 3.16.0-0.bpo.4-amd64
#1 Debian 3.16.7-ckt4-3~bpo70+1
[2583571.977130] task: ffff8801f4517670 ti: ffff88013a134000 task.ti:
ffff88013a134000
[2583571.977139] RIP: e030:[<ffffffff810b7043>] [<ffffffff810b7043>]
queue_write_lock_slowpath+0x83/0x90
[2583571.977156] RSP: e02b:ffff88013a137bb0 EFLAGS: 00000202
[2583571.977162] RAX: 0000000000000007 RBX: 0000000000000001 RCX:
0000000000000000
[2583571.977169] RDX: 0000000000000009 RSI: ffffffff818bdc1c RDI:
ffffffff818bdc1c
[2583571.977177] RBP: 00000001264e5a85 R08: 0000000000000020 R09:
0000000000000001
[2583571.977185] R10: 000000000a6b3ceb R11: ffff88013a137b38 R12:
ffffffff818bda40
[2583571.977192] R13: ffff8800e8a2be00 R14: ffff8801f18f0000 R15:
ffff8801f3257200
[2583571.977204] FS: 000000c208019b70(0000) GS:ffff8801feac0000(0000)
knlGS:0000000000000000
[2583571.977213] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[2583571.977219] CR2: ffffffffff600400 CR3: 00000001f2aa7000 CR4:
0000000000002660
[2583571.977227] Stack:
[2583571.977230] ffffffff8145998b ffff8801f32572e8 ffff8801f32572e8
ffffffff000000b8
[2583571.977242] 0000000000000004 ffff88013a137c54 ffffffff818bdc1c
00ff8801f18f0000
[2583571.977253] ffffffff8147f66f ffffffff8148afe0 ffffffff80000000
ffffffff818e6cc0
[2583571.977264] Call Trace:
[2583571.977274] [<ffffffff8145998b>] ? __neigh_create+0x1eb/0x5d0
[2583571.977287] [<ffffffff8147f66f>] ? nf_hook_slow+0x7f/0x160
[2583571.977296] [<ffffffff8148afe0>] ? ip_fragment+0x870/0x870
[2583571.977304] [<ffffffff8148b747>] ? ip_finish_output+0x767/0x8d0
[2583571.977312] [<ffffffff8148baba>] ? ip_queue_xmit+0x12a/0x3b0
[2583571.980060] [<ffffffff814a278e>] ? tcp_transmit_skb+0x41e/0x900
[2583571.980060] [<ffffffff814a3522>] ? tcp_connect+0x7e2/0x930
[2583571.980060] [<ffffffff810d22ee>] ? getnstimeofday+0xe/0x30
[2583571.980060] [<ffffffff810d2321>] ? ktime_get_real+0x11/0x50
[2583571.980060] [<ffffffff814a81ce>] ? tcp_v4_connect+0x2ee/0x410
[2583571.980060] [<ffffffff814bf6d6>] ? __inet_stream_connect+0x1f6/0x350
[2583571.980060] [<ffffffff81549536>] ? _raw_spin_lock_irqsave+0x16/0x50
[2583571.980060] [<ffffffff814bfb95>] ? inet_stream_connect+0x45/0x70
[2583571.980060] [<ffffffff814339b8>] ? SYSC_connect+0xe8/0x100
[2583571.980060] [<ffffffff8100b430>] ? xen_clocksource_read+0x20/0x30
[2583571.980060] [<ffffffff8100b430>] ? xen_clocksource_read+0x20/0x30
[2583571.980060] [<ffffffff810d20a2>] ? ktime_get_ts+0x42/0xd0
[2583571.980060] [<ffffffff8108e841>] ? posix_ktime_get_ts+0x11/0x20
[2583571.980060] [<ffffffff8108fc10>] ? SyS_clock_gettime+0x40/0x70
[2583571.980060] [<ffffffff81549a6d>] ?
system_call_fast_compare_end+0x10/0x15
[2583571.980060] Code: ff 00 00 00 eb 04 66 90 f3 90 8b 07 83 f8 01 75 f7 f0
0f b1 17 83 f8 01 75 ee eb bc 0f b7 47 04 66 39 d0 74 9c f3 90 0f b7 47 04
<66> 39 c2 75 f5 eb 8f 66 0f 1f 44 00 00 0f 1f 44 00 00 65 8b 04
[2583571.980073] NMI backtrace for cpu 2
[2583571.980073] CPU: 2 PID: 0 Comm: swapper/2 Not tainted
3.16.0-0.bpo.4-amd64 #1 Debian 3.16.7-ckt4-3~bpo70+1
[2583571.980073] task: ffff8801f51c00d0 ti: ffff8801f51ec000 task.ti:
ffff8801f51ec000
[2583571.980073] RIP: e030:[<ffffffff810013aa>] [<ffffffff810013aa>]
xen_hypercall_sched_op+0xa/0x20
[2583571.980073] RSP: e02b:ffff8801f51efe80 EFLAGS: 00000246
[2583571.980073] RAX: 0000000000000000 RBX: ffffffff818e03c0 RCX:
ffffffff810013aa
[2583571.980073] RDX: ffff8801fea80000 RSI: 0000000000000000 RDI:
0000000000000001
[2583571.980073] RBP: 0000000000000000 R08: 0000000000000000 R09:
0000000000000000
[2583571.980073] R10: 0000000000000001 R11: 0000000000000246 R12:
0000000000000002
[2583571.980073] R13: ffff8801f51ec000 R14: 0000000000000000 R15:
ffff8801f51ec000
[2583571.980073] FS: 00007f9730008700(0000) GS:ffff8801fea80000(0000)
knlGS:0000000000000000
[2583571.980073] CS: e033 DS: 002b ES: 002b CR0: 000000008005003b
[2583571.980073] CR2: ffffffffff600400 CR3: 00000000cbcc0000 CR4:
0000000000002660
[2583571.980073] Stack:
[2583571.980073] 00000001267e665d ffffffff81853f20 ffffffff8100b0ec
ffffffff8101f642
[2583571.980073] 0000000000000000 ffffffff818e03c0 0000000000000000
00000000ffffffed
[2583571.980073] ffff8801f51ec000 ffffffff810b1818 000000000000000a
ffffffff8100b139
[2583571.980073] Call Trace:
[2583571.980073] [<ffffffff8100b0ec>] ? xen_safe_halt+0xc/0x20
[2583571.980073] [<ffffffff8101f642>] ? default_idle+0x22/0xf0
[2583571.980073] [<ffffffff810b1818>] ? cpu_startup_entry+0x2e8/0x4b0
[2583571.980073] [<ffffffff8100b139>] ? xen_force_evtchn_callback+0x9/0x10
[2583571.980073] [<ffffffff8100ba12>] ? check_events+0x12/0x20
[2583571.980073] Code: cc 51 41 53 b8 1c 00 00 00 0f 05 41 5b 59 c3 cc cc cc
cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 1d 00 00 00 0f 05
<41> 5b 59 c3 cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc
[2583571.980057] NMI backtrace for cpu 1
[2583571.980057] CPU: 1 PID: 0 Comm: swapper/1 Not tainted
3.16.0-0.bpo.4-amd64 #1 Debian 3.16.7-ckt4-3~bpo70+1
[2583571.980057] task: ffff8801f51c0a20 ti: ffff8801f51c8000 task.ti:
ffff8801f51c8000
[2583572.177109] INFO: rcu_sched detected stalls on CPUs/tasks: {
4[2583571.980057] RIP: e030:[<ffffffff810b7043>] [<ffffffff810b7043>]
queue_write_lock_slowpath+0x83/0x90
[2583571.980057] RSP: e02b:ffff8801fea43c00 EFLAGS: 00000202
[2583571.980057] RAX: 0000000000000007 RBX: 0000000000000001 RCX:
0000000000000000
[2583571.980057] RDX: 0000000000000008 RSI: ffffffff818bdc1c RDI:
ffffffff818bdc1c
[2583571.980057] RBP: 00000001264c55e3 R08: 000000000a6b3ca4 R09:
ffff8801fea43b88
[2583571.980057] R10: 000000000a6b3ca4 R11: ffff8801fea43b88 R12:
ffffffff818bda40
[2583571.980057] R13: ffff8800edb6d200 R14: ffff8801f4d98000 R15:
ffffffff818b7bc0
[2583571.980057] FS: 00007f9730008700(0000) GS:ffff8801fea40000(0000)
knlGS:0000000000000000
[2583571.980057] CS: e033 DS: 002b ES: 002b CR0: 000000008005003b
[2583571.980057] CR2: ffffffffff600400 CR3: 000000014478d000 CR4:
0000000000002660
[2583571.980057] Stack:
[2583571.980057] ffffffff8145998b ffff8800034a0700 ffff8800034a0700
ffffffff000000b7
[2583571.980057] 0000000000000004 ffff8801fea43ca4 ffffffff818bdc1c
00ff8801f4d98000
[2583571.980057] ffffffff8147f66f ffffffff8148afe0 ffffffff80000000
ffffffff818e6cc0
[2583571.980057] Call Trace:
[2583571.980057] <IRQ> [<ffffffff8145998b>] ? __neigh_create+0x1eb/0x5d0
[2583571.980057] [<ffffffff8147f66f>] ? nf_hook_slow+0x7f/0x160
[2583571.980057] [<ffffffff8148afe0>] ? ip_fragment+0x870/0x870
[2583571.980057] [<ffffffff8148b747>] ? ip_finish_output+0x767/0x8d0
[2583571.980057] [<ffffffff8148cd42>] ? ip_send_skb+0x12/0x40
[2583571.980057] [<ffffffff814ba525>] ? icmp_send+0x445/0x520
[2583571.980057] [<ffffffff81093c0b>] ? hrtimer_interrupt+0x14b/0x260
[2583571.980057] [<ffffffff814583d0>] ? neigh_periodic_work+0x1e0/0x1e0
[2583571.980057] [<ffffffff81480efa>] ? ipv4_link_failure+0x1a/0x60
[2583571.980057] [<ffffffff814b716a>] ? arp_error_report+0x2a/0x40
[2583571.980057] [<ffffffff81457f4e>] ? neigh_invalidate+0x7e/0xf0
[2583571.980057] [<ffffffff81458562>] ? neigh_timer_handler+0x192/0x290
[2583571.980057] [<ffffffff814583d0>] ? neigh_periodic_work+0x1e0/0x1e0
[2583571.980057] [<ffffffff8107985c>] ? call_timer_fn+0x4c/0x150
[2583571.980057] [<ffffffff814583d0>] ? neigh_periodic_work+0x1e0/0x1e0
[2583571.980057] [<ffffffff8107b2c7>] ? run_timer_softirq+0x297/0x2e0
[2583571.980057] [<ffffffff81072c0e>] ? __do_softirq+0xde/0x2e0
[2583571.980057] [<ffffffff81073066>] ? irq_exit+0x86/0xb0
[2583571.980057] [<ffffffff8137db45>] ? xen_evtchn_do_upcall+0x35/0x50
[2583571.980057] [<ffffffff8154b71e>] ? xen_do_hypervisor_callback+0x1e/0x30
[2583571.980057] <EOI> [<ffffffff810013aa>] ?
xen_hypercall_sched_op+0xa/0x20
[2583571.980057] [<ffffffff810013aa>] ? xen_hypercall_sched_op+0xa/0x20
[2583571.980057] [<ffffffff8100b0ec>] ? xen_safe_halt+0xc/0x20
[2583571.980057] [<ffffffff8101f642>] ? default_idle+0x22/0xf0
[2583571.980057] [<ffffffff810b1818>] ? cpu_startup_entry+0x2e8/0x4b0
[2583571.980057] [<ffffffff8100b139>] ? xen_force_evtchn_callback+0x9/0x10
[2583571.980057] [<ffffffff8100ba12>] ? check_events+0x12/0x20
[2583571.980057] Code: ff 00 00 00 eb 04 66 90 f3 90 8b 07 83 f8 01 75 f7 f0
0f b1 17 83 f8 01 75 ee eb bc 0f b7 47 04 66 39 d0 74 9c f3 90 0f b7 47 04
<66> 39 c2 75 f5 eb 8f 66 0f 1f 44 00 00 0f 1f 44 00 00 65 8b 04
[2583571.980057] NMI backtrace for cpu 0
[2583571.980057] CPU: 0 PID: 27713 Comm: serf Not tainted 3.16.0-0.bpo.4-amd64
#1 Debian 3.16.7-ckt4-3~bpo70+1
[2583571.980057] task: ffff8800edbf2b60 ti: ffff8800f4db8000 task.ti:
ffff8800f4db8000
[2583571.980057] RIP: e030:[<ffffffff810b7002>] [<ffffffff810b7002>]
queue_write_lock_slowpath+0x42/0x90
[2583571.980057] RSP: e02b:ffff8800f4dbbb00 EFLAGS: 00000286
[2583571.980057] RAX: 00000000000000ff RBX: 0000000000000001 RCX:
0000000000000000
[2583571.980057] RDX: 00000000000000ff RSI: ffffffff818bdc1c RDI:
ffffffff818bdc1c
[2583571.980057] RBP: 00000001264c3d6c R08: 0000000000000020 R09:
0000000000000001
[2583571.980057] R10: 000000000a6b3c82 R11: ffff8800f4dbba88 R12:
ffffffff818bda40
[2583571.980057] R13: ffff8801f26a4e00 R14: ffff8801f18f0000 R15:
0000000000000059
[2583571.980057] FS: 000000c208049270(0000) GS:ffff8801fea00000(0000)
knlGS:0000000000000000
[2583571.980057] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
[2583571.980057] CR2: 00007f9736adb000 CR3: 00000001f2aa7000 CR4:
0000000000002660
[2583571.980057] Stack:
[2583571.980057] ffffffff8145998b ffff880004156a00 ffff880004156a00
ffffffff000000b6
[2583571.980057] 0000000000000004 ffff8800f4dbbba4 ffffffff818bdc1c
00ff8801f18f0000
[2583571.980057] ffffffff8147f66f ffffffff8148afe0 ffffffff80000000
ffffffff818e6cc0
[2583571.980057] Call Trace:
[2583571.980057] [<ffffffff8145998b>] ? __neigh_create+0x1eb/0x5d0
[2583571.980057] [<ffffffff8147f66f>] ? nf_hook_slow+0x7f/0x160
[2583571.980057] [<ffffffff8148afe0>] ? ip_fragment+0x870/0x870
[2583571.980057] [<ffffffff8148b747>] ? ip_finish_output+0x767/0x8d0
[2583571.980057] [<ffffffff8148cd42>] ? ip_send_skb+0x12/0x40
[2583571.980057] [<ffffffff814b2e9f>] ? udp_send_skb+0x10f/0x280
[2583571.980057] [<ffffffff81489770>] ? ip_setup_cork+0x130/0x130
[2583571.980057] [<ffffffff814b3a98>] ? udp_sendmsg+0x308/0x8a0
[2583571.980057] [<ffffffff814331ca>] ? sock_sendmsg+0xda/0xf0
[2583571.980057] [<ffffffff814b44d2>] ? udp_poll+0x22/0xb0
[2583571.980057] [<ffffffff811feb90>] ? ep_poll_readyevents_proc+0x30/0x30
[2583571.980057] [<ffffffff81433861>] ? SYSC_sendto+0x121/0x190
[2583571.980057] [<ffffffff810e0150>] ? SyS_futex+0x150/0x1c0
[2583571.980057] [<ffffffff8100b430>] ? xen_clocksource_read+0x20/0x30
[2583571.980057] [<ffffffff810d1c84>] ? __getnstimeofday+0x34/0xb0
[2583571.980057] [<ffffffff810d22ee>] ? getnstimeofday+0xe/0x30
[2583571.980057] [<ffffffff81549a6d>] ?
system_call_fast_compare_end+0x10/0x15
[2583571.980057] Code: 75 5b 8b 07 85 c0 75 23 ba ff 00 00 00 f0 0f b1 17 85
c0 75 16 0f 1f 40 00 66 83 47 04 01 c3 66 2e 0f 1f 84 00 00 00 00 00 f3 90
<8b> 17 84 d2 75 f8 89 d1 89 d0 83 c9 01 f0 0f b1 0f 39 d0 75 e9
[2583572.177096] NMI backtrace for cpu 5
[2583572.177096] CPU: 5 PID: 0 Comm: swapper/5 Not tainted
3.16.0-0.bpo.4-amd64 #1 Debian 3.16.7-ckt4-3~bpo70+1
[2583572.177096] task: ffff8801f51ea110 ti: ffff8801f51fc000 task.ti:
ffff8801f51fc000
[2583572.177096] RIP: e030:[<ffffffff810013aa>] [<ffffffff810013aa>]
xen_hypercall_sched_op+0xa/0x20
[2583572.177096] RSP: e02b:ffff8801f51ffe80 EFLAGS: 00000246
[2583572.177096] RAX: 0000000000000000 RBX: ffffffff818e03c0 RCX:
ffffffff810013aa
[2583572.177096] RDX: ffff8801feb40000 RSI: 0000000000000000 RDI:
0000000000000001
[2583572.177096] RBP: 0000000000000000 R08: 0000000000000000 R09:
0000000000000000
[2583572.177096] R10: 0000000000000001 R11: 0000000000000246 R12:
0000000000000005
[2583572.177096] R13: ffff8801f51fc000 R14: 0000000000000000 R15:
ffff8801f51fc000
[2583572.177096] FS: 00007f9730008700(0000) GS:ffff8801feb40000(0000)
knlGS:0000000000000000
[2583572.177096] CS: e033 DS: 002b ES: 002b CR0: 000000008005003b
[2583572.177096] CR2: ffffffffff600400 CR3: 000000000351d000 CR4:
0000000000002660
[2583572.177096] Stack:
[2583572.177096] 00000001267e6679 ffffffff81853f20 ffffffff8100b0ec
ffffffff8101f642
[2583572.177096] 0000000000000000 ffffffff818e03c0 0000000000000000
00000000ffffffed
[2583572.177096] ffff8801f51fc000 ffffffff810b1818 000000000000000a
ffffffff8100b139
[2583572.177096] Call Trace:
[2583572.177096] [<ffffffff8100b0ec>] ? xen_safe_halt+0xc/0x20
[2583572.177096] [<ffffffff8101f642>] ? default_idle+0x22/0xf0
[2583572.177096] [<ffffffff810b1818>] ? cpu_startup_entry+0x2e8/0x4b0
[2583572.177096] [<ffffffff8100b139>] ? xen_force_evtchn_callback+0x9/0x10
[2583572.177096] [<ffffffff8100ba12>] ? check_events+0x12/0x20
[2583572.177096] Code: cc 51 41 53 b8 1c 00 00 00 0f 05 41 5b 59 c3 cc cc cc
cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 1d 00 00 00 0f 05
<41> 5b 59 c3 cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc
[2583571.980063] NMI backtrace for cpu 7
[2583571.980063] CPU: 7 PID: 0 Comm: swapper/7 Not tainted
3.16.0-0.bpo.4-amd64 #1 Debian 3.16.7-ckt4-3~bpo70+1
[2583571.980063] task: ffff8801f5200aa0 ti: ffff8801f5208000 task.ti:
ffff8801f5208000
[2583571.980063] RIP: e030:[<ffffffff810013aa>] [<ffffffff810013aa>]
xen_hypercall_sched_op+0xa/0x20
[2583571.980063] RSP: e02b:ffff8801f520be80 EFLAGS: 00000246
[2583571.980063] RAX: 0000000000000000 RBX: ffffffff818e03c0 RCX:
ffffffff810013aa
[2583571.980063] RDX: ffff8801febc0000 RSI: 0000000000000000 RDI:
0000000000000001
[2583571.980063] RBP: 0000000000000000 R08: 0000000000000000 R09:
0000000000000000
[2583571.980063] R10: 0000000000000001 R11: 0000000000000246 R12:
0000000000000007
[2583571.980063] R13: ffff8801f5208000 R14: 0000000000000000 R15:
ffff8801f5208000
[2583571.980063] FS: 00007f9730008700(0000) GS:ffff8801febc0000(0000)
knlGS:0000000000000000
[2583571.980063] CS: e033 DS: 002b ES: 002b CR0: 000000008005003b
[2583571.980063] CR2: ffffffffff600400 CR3: 0000000144605000 CR4:
0000000000002660
[2583571.980063] Stack:
[2583571.980063] 00000001267e668c ffffffff81853f20 ffffffff8100b0ec
ffffffff8101f642
[2583571.980063] 0000000000000000 ffffffff818e03c0 0000000000000000
00000000ffffffed
[2583571.980063] ffff8801f5208000 ffffffff810b1818 000000000000000a
ffffffff8100b139
[2583571.980063] Call Trace:
[2583571.980063] [<ffffffff8100b0ec>] ? xen_safe_halt+0xc/0x20
[2583571.980063] [<ffffffff8101f642>] ? default_idle+0x22/0xf0
[2583571.980063] [<ffffffff810b1818>] ? cpu_startup_entry+0x2e8/0x4b0
[2583571.980063] [<ffffffff8100b139>] ? xen_force_evtchn_callback+0x9/0x10
[2583571.980063] [<ffffffff8100ba12>] ? check_events+0x12/0x20
[2583571.980063] Code: cc 51 41 53 b8 1c 00 00 00 0f 05 41 5b 59 c3 cc cc cc
cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 1d 00 00 00 0f 05
<41> 5b 59 c3 cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc
[2583572.177101] NMI backtrace for cpu 6
[2583572.177101] CPU: 6 PID: 0 Comm: swapper/6 Not tainted
3.16.0-0.bpo.4-amd64 #1 Debian 3.16.7-ckt4-3~bpo70+1
[2583572.177101] task: ffff8801f52013f0 ti: ffff8801f5204000 task.ti:
ffff8801f5204000
[2583572.177101] RIP: e030:[<ffffffff810013aa>] [<ffffffff810013aa>]
xen_hypercall_sched_op+0xa/0x20
[2583572.177101] RSP: e02b:ffff8801f5207e80 EFLAGS: 00000246
[2583572.177101] RAX: 0000000000000000 RBX: ffffffff818e03c0 RCX:
ffffffff810013aa
[2583572.177101] RDX: ffff8801feb80000 RSI: 0000000000000000 RDI:
0000000000000001
[2583572.177101] RBP: 0000000000000000 R08: 0000000000000000 R09:
0000000000000001
[2583572.177101] R10: 0000000000000001 R11: 0000000000000246 R12:
0000000000000006
[2583572.177101] R13: ffff8801f5204000 R14: 0000000000000000 R15:
ffff8801f5204000
[2583572.177101] FS: 00007f9730008700(0000) GS:ffff8801feb80000(0000)
knlGS:0000000000000000
[2583572.177101] CS: e033 DS: 002b ES: 002b CR0: 000000008005003b
[2583572.177101] CR2: ffffffffff600400 CR3: 0000000095447000 CR4:
0000000000002660
[2583572.177101] Stack:
[2583572.177101] 00000001267e6681 ffffffff81853f20 ffffffff8100b0ec
ffffffff8101f642
[2583572.177101] 0000000000000000 ffffffff818e03c0 0000000000000000
00000000ffffffed
[2583572.177101] ffff8801f5204000 ffffffff810b1818 000000000000000a
ffffffff8100b139
[2583572.177101] Call Trace:
[2583572.177101] [<ffffffff8100b0ec>] ? xen_safe_halt+0xc/0x20
[2583572.177101] [<ffffffff8101f642>] ? default_idle+0x22/0xf0
[2583572.177101] [<ffffffff810b1818>] ? cpu_startup_entry+0x2e8/0x4b0
[2583572.177101] [<ffffffff8100b139>] ? xen_force_evtchn_callback+0x9/0x10
[2583572.177101] [<ffffffff8100ba12>] ? check_events+0x12/0x20
[2583572.177101] Code: cc 51 41 53 b8 1c 00 00 00 0f 05 41 5b 59 c3 cc cc cc
cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 1d 00 00 00 0f 05
<41> 5b 59 c3 cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc
[2583572.181073] } (detected by 2, t=3287576 jiffies, g=258996215,
c=258996214, q=4436445)
[2583572.181073] sending NMI to all CPUs:
[2583572.181073] NMI backtrace for cpu 2
[2583572.181073] CPU: 2 PID: 0 Comm: swapper/2 Not tainted
3.16.0-0.bpo.4-amd64 #1 Debian 3.16.7-ckt4-3~bpo70+1
[2583572.181073] task: ffff8801f51c00d0 ti: ffff8801f51ec000 task.ti:
ffff8801f51ec000
[2583572.181073] RIP: e030:[<ffffffff8100130a>] [<ffffffff8100130a>]
xen_hypercall_vcpu_op+0xa/0x20
[2583572.181073] RSP: e02b:ffff8801fea83c30 EFLAGS: 00000046
[2583572.181073] RAX: 0000000000000000 RBX: ffffffff818e03c0 RCX:
ffffffff8100130a
[2583572.181073] RDX: 0000000000000000 RSI: 0000000000000002 RDI:
000000000000000b
[2583572.181073] RBP: ffffffff818dff60 R08: ffffffff818dff60 R09:
0000000000000000
[2583572.181073] R10: 0000000000026abb R11: 0000000000000246 R12:
0000000000000005
[2583572.181073] R13: 0000000000000002 R14: ffffffff818e0400 R15:
ffffffff818e0400
[2583572.181073] FS: 00007f9730008700(0000) GS:ffff8801fea80000(0000)
knlGS:0000000000000000
[2583572.181073] CS: e033 DS: 002b ES: 002b CR0: 000000008005003b
[2583572.181073] CR2: ffffffffff600400 CR3: 00000000cbcc0000 CR4:
0000000000002660
[2583572.181073] Stack:
[2583572.181073] 0000000000026aba 0000000000000002 ffffffff8137daf3
ffffffff818dff60
[2583572.181073] ffffffff81011713 0000000000000002 0000000000000001
ffffffff81852480
[2583572.181073] 0000000000000002 ffffffff81852480 ffffffff8104b700
ffff8801fea8d5e0
[2583572.181073] Call Trace:
[2583572.181073] <IRQ>
[2583572.181073] [<ffffffff8137daf3>] ? xen_send_IPI_one+0x43/0x60
[2583572.181073] [<ffffffff81011713>] ? __xen_send_IPI_mask+0x33/0x60
[2583572.181073] [<ffffffff8104b700>] ?
arch_trigger_all_cpu_backtrace+0x120/0x130
[2583572.181073] [<ffffffff810d0458>] ? rcu_check_callbacks+0x658/0x680
[2583572.181073] [<ffffffff8107bd14>] ? update_process_times+0x44/0x80
[2583572.181073] [<ffffffff810db39f>] ? tick_sched_handle.isra.12+0x2f/0x70
[2583572.181073] [<ffffffff810db4ca>] ? tick_sched_timer+0x4a/0x80
[2583572.181073] [<ffffffff81093350>] ? __run_hrtimer+0x70/0x210
[2583572.181073] [<ffffffff810db480>] ? tick_nohz_handler+0xa0/0xa0
[2583572.181073] [<ffffffff81093bc1>] ? hrtimer_interrupt+0x101/0x260
[2583572.181073] [<ffffffff8100b2e8>] ? xen_timer_interrupt+0x28/0x150
[2583572.181073] [<ffffffff810abf98>] ? rebalance_domains+0x168/0x250
[2583572.181073] [<ffffffff8100b430>] ? xen_clocksource_read+0x20/0x30
[2583572.181073] [<ffffffff810c4f54>] ? handle_irq_event_percpu+0x54/0x1e0
[2583572.181073] [<ffffffff810c891a>] ? handle_percpu_irq+0x4a/0x80
[2583572.181073] [<ffffffff8101e6d5>] ? sched_clock+0x5/0x10
[2583572.181073] [<ffffffff810c473d>] ? generic_handle_irq+0x1d/0x30
[2583572.181073] [<ffffffff8137e51d>] ? evtchn_2l_handle_events+0x24d/0x260
[2583572.181073] [<ffffffff8100b430>] ? xen_clocksource_read+0x20/0x30
[2583572.181073] [<ffffffff8137bdff>] ? __xen_evtchn_do_upcall+0x3f/0x70
[2583572.181073] [<ffffffff8137db3f>] ? xen_evtchn_do_upcall+0x2f/0x50
[2583572.181073] [<ffffffff8154b71e>] ? xen_do_hypervisor_callback+0x1e/0x30
[2583572.181073] <EOI>
[2583572.181073] [<ffffffff810013aa>] ? xen_hypercall_sched_op+0xa/0x20
[2583572.181073] [<ffffffff810013aa>] ? xen_hypercall_sched_op+0xa/0x20
[2583572.181073] [<ffffffff8100b0ec>] ? xen_safe_halt+0xc/0x20
[2583572.181073] [<ffffffff8101f642>] ? default_idle+0x22/0xf0
[2583572.181073] [<ffffffff810b1818>] ? cpu_startup_entry+0x2e8/0x4b0
[2583572.181073] [<ffffffff8100b139>] ? xen_force_evtchn_callback+0x9/0x10
[2583572.181073] [<ffffffff8100ba12>] ? check_events+0x12/0x20
[2583572.181073] Code: cc 51 41 53 50 b8 17 00 00 00 0f 05 5b 59 c3 cc cc cc
cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 18 00 00 00 0f 05
<41> 5b 59 c3 cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc
[2583572.778853] NMI backtrace for cpu 1}
[0] https://patchwork.ozlabs.org/patch/402108/
-- System Information:
Debian Release: 8.0
APT prefers testing
APT policy: (990, 'testing'), (500, 'unstable')
Architecture: amd64 (x86_64)
Foreign Architectures: i386
Kernel: Linux 3.16.0-4-amd64 (SMP w/8 CPU cores)
Locale: LANG=en_GB.utf-8, LC_CTYPE=en_GB.utf-8 (charmap=UTF-8)
Shell: /bin/sh linked to /bin/dash
Init: systemd (via /run/systemd/system)
Reply to: