Bug#513537: linux-image-2.6.26-1-openvz-amd64 hanging

To: Vitaliy Gusev <vgusev@openvz.org>, 513537@bugs.debian.org
Subject: Bug#513537: linux-image-2.6.26-1-openvz-amd64 hanging
From: Tom Rathborne <tomr@tinyplanet.ca>
Date: Fri, 6 Mar 2009 16:13:14 -0500
Message-id: <[🔎] 20090306211314.GD16779@tinyplanet.ca>
Reply-to: tomr@tinyplanet.ca, 513537@bugs.debian.org
In-reply-to: <[🔎] 200903062204.13135.vgusev@openvz.org>
References: <20090206214432.GA6820@tinyplanet.ca> <20090224140204.GB13370@tinyplanet.ca> <[🔎] 20090304212238.GA5377@tinyplanet.ca> <[🔎] 200903062204.13135.vgusev@openvz.org>

Hi Vitaliy,

On Fri, Mar 06, 2009 at 10:04:13PM +0300, Vitaliy Gusev wrote:
> Tom wrote:
> > Is there anything else I can do to help you debug this?
> 
> Warn message reffers to the shmem_free_blocks():
> 
>      static void shmem_free_blocks(struct inode *inode, long pages)
>      {
> 	struct shmem_sb_info *sbinfo = SHMEM_SB(inode->i_sb);
> 	if (sbinfo->max_blocks) {
> 		spin_lock(&sbinfo->stat_lock);
>                ^^^^
>               Here is a place where cpu1 is in a loop .
> 
> It seems like someone already held &sbinfo->stat_lock.

Ok, that makes sense.

> Can you do "sysrq-p" , "sysrq-t", "sysrq-w"  in the host ?

Done, attached!

I have not rebooted the machine yet, in case you need some other
kernel debug info. Let me know!

Thanks,

Tom

-- 
-- Tom Rathborne
<Bootsy> Tommer needs a revision that takes care of itself.

Show Regs
----------- IPI show regs -----------
CPU 3:
Modules linked in: vzethdev vznetdev simfs vzrst vzcpt tun vzmon xt_length ipt_ttl xt_tcpmss xt_TCPMSS iptable_mangle iptable_filter xt_multiport xt_limit xt_dscp ipt_REJECT iptable_nat nf_nat nf_conntrack_ipv4 nf_conntrack vzdquota vzdev xt_tcpudp ip_tables x_tables ipv6 loop snd_pcm snd_timer snd soundcore snd_page_alloc parport_pc parport psmouse serio_raw pcspkr k8temp amd_rng rng_core i2c_amd756 i2c_amd8111 i2c_core button shpchp pci_hotplug evdev ext3 jbd mbcache dm_mirror dm_log dm_snapshot dm_mod ide_cd_mod cdrom ide_pci_generic amd74xx ide_core sd_mod floppy ata_generic libata dock ohci_hcd tg3 aacraid scsi_mod thermal processor fan thermal_sys [last unloaded: simfs]
Pid: 0, comm: swapper Tainted: G        W 2.6.26-1-openvz-amd64 #1 036test001
native_safe_halt+0x2/0x3
RSP: 0018:ffff81013f65ff38  EFLAGS: 00000246
RAX: ffff81013f65ffd8 RBX: ffffffff8020b152 RCX: 0000000000000000
RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffffffff804f20f0
RBP: 0000000000000000 R08: ffffffff8021eb54 R09: ffff810106d96090
R10: ffff81013dc59680 R11: ffff81013f6767d0 R12: 0000000000000000
R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
FS:  00007f0e7f7cb6e0(0000) GS:ffff81013f6573c0(0000) knlGS:0000000000000000
CS:  0010 DS: 0018 ES: 0018 CR0: 000000008005003b
CR2: 00007f4d7e39e000 CR3: 000000013dd1e000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400

Call Trace:
default_idle+0x2a/0x46
cpu_idle+0x89/0xb3

----------- IPI show regs -----------
CPU 0:
Modules linked in: vzethdev vznetdev simfs vzrst vzcpt tun vzmon xt_length ipt_ttl xt_tcpmss xt_TCPMSS iptable_mangle iptable_filter xt_multiport xt_limit xt_dscp ipt_REJECT iptable_nat nf_nat nf_conntrack_ipv4 nf_conntrack vzdquota vzdev xt_tcpudp ip_tables x_tables ipv6 loop snd_pcm snd_timer snd soundcore snd_page_alloc parport_pc parport psmouse serio_raw pcspkr k8temp amd_rng rng_core i2c_amd756 i2c_amd8111 i2c_core button shpchp pci_hotplug evdev ext3 jbd mbcache dm_mirror dm_log dm_snapshot dm_mod ide_cd_mod cdrom ide_pci_generic amd74xx ide_core sd_mod floppy ata_generic libata dock ohci_hcd tg3 aacraid scsi_mod thermal processor fan thermal_sys [last unloaded: simfs]
Pid: 0, comm: swapper Tainted: G        W 2.6.26-1-openvz-amd64 #1 036test001
native_safe_halt+0x2/0x3
RSP: 0018:ffffffff8056df38  EFLAGS: 00000246
RAX: ffffffff8056dfd8 RBX: ffffffff8020b152 RCX: 0000000000000000
RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffffffff804f20f0
RBP: 0000000000000000 R08: ffffffff8021eb54 R09: 0000000000000000
R10: 0000000000000000 R11: ffffffff8021aa33 R12: ffffffffffffffff
R13: ffffffff8059ca80 R14: ffffffff8059d640 R15: 0000000000000000
FS:  00007f509e3d2750(0000) GS:ffffffff80534000(0000) knlGS:0000000000000000
CS:  0010 DS: 0018 ES: 0018 CR0: 000000008005003b
CR2: 00007f003a2ee000 CR3: 0000000021bfa000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400

Call Trace:
default_idle+0x2a/0x46
cpu_idle+0x89/0xb3

----------- IPI show regs -----------
CPU 1:
Modules linked in: vzethdev vznetdev simfs vzrst vzcpt tun vzmon xt_length ipt_ttl xt_tcpmss xt_TCPMSS iptable_mangle iptable_filter xt_multiport xt_limit xt_dscp ipt_REJECT iptable_nat nf_nat nf_conntrack_ipv4 nf_conntrack vzdquota vzdev xt_tcpudp ip_tables x_tables ipv6 loop snd_pcm snd_timer snd soundcore snd_page_alloc parport_pc parport psmouse serio_raw pcspkr k8temp amd_rng rng_core i2c_amd756 i2c_amd8111 i2c_core button shpchp pci_hotplug evdev ext3 jbd mbcache dm_mirror dm_log dm_snapshot dm_mod ide_cd_mod cdrom ide_pci_generic amd74xx ide_core sd_mod floppy ata_generic libata dock ohci_hcd tg3 aacraid scsi_mod thermal processor fan thermal_sys [last unloaded: simfs]
Pid: 0, comm: swapper Tainted: G        W 2.6.26-1-openvz-amd64 #1 036test001
acpi_pm_read+0x8/0x10
RSP: 0018:ffff81013f593eb0  EFLAGS: 00000046
RAX: 0000000000182c7d RBX: ffff81013f593ef8 RCX: 0000000000000000
RDX: 0000000000005008 RSI: 0000000000000002 RDI: ffff81013f593ef8
RBP: 0000000021aabc60 R08: ffffffff8021eb54 R09: 0000000000000000
R10: 8101010101010100 R11: ffffffff8021aa33 R12: 0000000000000000
R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
FS:  00007fba89ea76e0(0000) GS:ffff81007f5a6a40(0000) knlGS:0000000000000000
CS:  0010 DS: 0018 ES: 0018 CR0: 000000008005003b
CR2: 00007f4d7a514098 CR3: 000000013d838000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400

Call Trace:
? getnstimeofday+0x39/0x98
? lapic_next_event+0x0/0x13
? ktime_get_ts+0x22/0x4b
? ktime_get+0xc/0x41
? native_safe_halt+0x2/0x3
? tick_nohz_stop_idle+0x25/0x49
? tick_nohz_restart_sched_tick+0x31/0x13f
? default_idle+0x0/0x46
? cpu_idle+0xa9/0xb3

Show State
  task                  taskaddr stack   pid father
init          S ffff81013f57c050     0     1      0
 ffff81007f5899f8 0000000000000086 0000000000000000 0000000000000282
 ffff81013f57c050 ffffffff804ef480 ffff81013f57c2d8 000000007f589a08
 ffff81013dc82980 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
vsnprintf+0x568/0x5b1
free_pages_bulk+0xc7/0x1f6
__d_lookup+0xd6/0x11e
do_lookup+0x85/0x1dd
:simfs:sim_systemcall+0x4e/0x272
__link_path_walk+0xd4f/0xddd
core_sys_select+0x1c5/0x27e
vfs_getattr+0x35/0x74
mntput_no_expire+0x20/0x10e
cp_new_stat+0xe7/0xff
sys_select+0x15a/0x183
system_call_after_swapgs+0x8a/0x8f

kthreadd      S ffff81007f5807d0     0     2      0
 ffff81007f58bf00 0000000000000046 0000000000000000 0000000000000000
 ffff81007f5807d0 ffffffff804ef480 ffff81007f580a58 00000000379adda8
 ffff8100379addb0 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
kthreadd+0x7e/0x175
child_rip+0xa/0x12
kthreadd+0x0/0x175
child_rip+0x0/0x12

migration/0   S ffff81007f580050     0     3      2
 ffff81007f58fee0 0000000000000046 0000000000000000 0000000000000000
 ffff81007f580050 ffffffff804ef480 ffff81007f5802d8 000000003afc9e78
 ffff81003afc9e80 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
migration_thread+0x16f/0x207
migration_thread+0x0/0x207
kthread+0x47/0x74
schedule_tail+0x27/0x5b
child_rip+0xa/0x12
kthread+0x0/0x74
child_rip+0x0/0x12

ksoftirqd/0   S ffff81007f582810     0     4      2
 ffff81007f591f10 0000000000000046 0000000000000000 00000000804224eb
 ffff81007f582810 ffffffff804ef480 ffff81007f582a98 0000000001017870
 ffff81000338dcc8 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
ksoftirqd+0x0/0x9b
ksoftirqd+0x17/0x9b
kthread+0x47/0x74
schedule_tail+0x27/0x5b
child_rip+0xa/0x12
kthread+0x0/0x74
child_rip+0x0/0x12

watchdog/0    S ffff81007f582090     0     5      2
 ffff81007f593ee0 0000000000000046 0000000000000000 ffffffff8024be6e
 ffff81007f582090 ffff81007f582810 ffff81007f582318 0000000000000286
 0000000000000282 ffffffff805d1660 ffff810080a43000 000000000014d86f
Call Trace:
sched_clock_cpu+0x10a/0x115
watchdog+0x40/0x1e5
watchdog+0x0/0x1e5
kthread+0x47/0x74
schedule_tail+0x27/0x5b
child_rip+0xa/0x12
kthread+0x0/0x74
child_rip+0x0/0x12

migration/1   S ffff81007f5847d0     0     6      2
 ffff81007f597ee0 0000000000000046 0000000000000000 0000000000000000
 ffff81007f5847d0 ffff81007f5a9090 ffff81007f584a58 0000000100d35e78
 ffff810000d35e80 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
migration_thread+0x16f/0x207
migration_thread+0x0/0x207
kthread+0x47/0x74
schedule_tail+0x27/0x5b
child_rip+0xa/0x12
kthread+0x0/0x74
child_rip+0x0/0x12

ksoftirqd/1   S ffff81007f584050     0     7      2
 ffff81007f5bdf10 0000000000000046 0000000000000000 00000001804224eb
 ffff81007f584050 ffff81007f5a9090 ffff81007f5842d8 000000017f5807d0
 ffff81007f5842d8 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
ksoftirqd+0x0/0x9b
ksoftirqd+0x17/0x9b
kthread+0x47/0x74
schedule_tail+0x27/0x5b
child_rip+0xa/0x12
kthread+0x0/0x74
child_rip+0x0/0x12

watchdog/1    S ffff81007f5a9810     0     8      2
 ffff81007f5bfee0 0000000000000046 0000000000000000 ffffffff8024be6e
 ffff81007f5a9810 ffff81007e7227d0 ffff81007f5a9a98 0000000100000286
 ffff81007f5a9d28 ffffffff805d1660 ffff810080a4d000 ffffffff8059ca80
Call Trace:
sched_clock_cpu+0x10a/0x115
watchdog+0x0/0x1e5
watchdog+0x0/0x1e5
watchdog+0x40/0x1e5
watchdog+0x0/0x1e5
kthread+0x47/0x74
schedule_tail+0x27/0x5b
child_rip+0xa/0x12
kthread+0x0/0x74
child_rip+0x0/0x12

migration/2   S ffff81007f5ab7d0     0     9      2
 ffff81007f5e7ee0 0000000000000046 0000000000000000 0000000000000000
 ffff81007f5ab7d0 ffff81013f57c7d0 ffff81007f5aba58 0000000218debe78
 ffff810118debe80 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
migration_thread+0x16f/0x207
migration_thread+0x0/0x207
kthread+0x47/0x74
schedule_tail+0x27/0x5b
child_rip+0xa/0x12
kthread+0x0/0x74
child_rip+0x0/0x12

ksoftirqd/2   S ffff81007f5ab050     0    10      2
 ffff81007f5e9f10 0000000000000046 0000000000000000 0000000200000000
 ffff81007f5ab050 ffff81013f57c7d0 ffff81007f5ab2d8 000000027f5e9fd8
 ffff81007f5ae000 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
ksoftirqd+0x0/0x9b
ksoftirqd+0x17/0x9b
kthread+0x47/0x74
schedule_tail+0x27/0x5b
child_rip+0xa/0x12
kthread+0x0/0x74
child_rip+0x0/0x12

watchdog/2    S ffff81007f5ad810     0    11      2
 ffff81007f5edee0 0000000000000046 0000000000000000 ffffffff8024be6e
 ffff81007f5ad810 ffff81007f5ab050 ffff81007f5ada98 0000000200000286
 ffff81007f5add28 ffffffff805d1660 ffff810101c44000 ffffffff8059ca80
Call Trace:
sched_clock_cpu+0x10a/0x115
watchdog+0x0/0x1e5
watchdog+0x0/0x1e5
watchdog+0x40/0x1e5
watchdog+0x0/0x1e5
kthread+0x47/0x74
schedule_tail+0x27/0x5b
child_rip+0xa/0x12
kthread+0x0/0x74
child_rip+0x0/0x12

migration/3   S ffff81007f5ad090     0    12      2
 ffff81007f611ee0 0000000000000046 ffff810100143e80 0000000000000000
 ffff81007f5ad090 ffff810031adc810 ffff81007f5ad318 0000000300143e78
 ffff810100143e80 0000000000000286 ffffffff8043bac0 0000000000000003
Call Trace:
migration_thread+0x16f/0x207
migration_thread+0x0/0x207
kthread+0x47/0x74
schedule_tail+0x27/0x5b
child_rip+0xa/0x12
kthread+0x0/0x74
child_rip+0x0/0x12

ksoftirqd/3   S ffff81007f5b17d0     0    13      2
 ffff81007f613f10 0000000000000046 0000000000000000 0000000300000000
 ffff81007f5b17d0 ffff81007f5b2810 ffff81007f5b1a58 000000037f5b17d0
 0000000000000001 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
ksoftirqd+0x0/0x9b
ksoftirqd+0x17/0x9b
kthread+0x47/0x74
schedule_tail+0x27/0x5b
child_rip+0xa/0x12
kthread+0x0/0x74
child_rip+0x0/0x12

watchdog/3    S ffff81007f5b1050     0    14      2
 ffff81007f617ee0 0000000000000046 0000000000000000 ffffffff8024be6e
 ffff81007f5b1050 ffff81007e722050 ffff81007f5b12d8 0000000300000286
 ffff81007f5b1568 ffffffff805d1660 ffff810101c4e000 ffffffff8059ca80
Call Trace:
sched_clock_cpu+0x10a/0x115
watchdog+0x0/0x1e5
watchdog+0x0/0x1e5
watchdog+0x40/0x1e5
watchdog+0x0/0x1e5
kthread+0x47/0x74
schedule_tail+0x27/0x5b
child_rip+0xa/0x12
kthread+0x0/0x74
child_rip+0x0/0x12

events/0      S ffff81007f5b2090     0    15      2
 ffff81007f63ded0 0000000000000046 0000000000000000 0000000000000282
 ffff81007f5b2090 ffffffff804ef480 ffff81007f5b2318 00000000ffffffff
 00000000000001f4 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
worker_thread+0xa1/0xe0
autoremove_wake_function+0x0/0x2e
worker_thread+0x0/0xe0
kthread+0x47/0x74
schedule_tail+0x27/0x5b
child_rip+0xa/0x12
kthread+0x0/0x74
child_rip+0x0/0x12

events/1      S ffff81007f5b77d0     0    16      2
 ffff81007f641ed0 0000000000000046 0000000000000000 0000000000000286
 ffff81007f5b77d0 ffff81007f5a9090 ffff81007f5b7a58 00000001ffffffff
 00000000000000fa 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
worker_thread+0xa1/0xe0
autoremove_wake_function+0x0/0x2e
worker_thread+0x0/0xe0
kthread+0x47/0x74
schedule_tail+0x27/0x5b
child_rip+0xa/0x12
kthread+0x0/0x74
child_rip+0x0/0x12

events/2      S ffff81007f5b7050     0    17      2
 ffff81007f643ed0 0000000000000046 0000000000000000 0000000000000286
 ffff81007f5b7050 ffff81013f57c7d0 ffff81007f5b72d8 00000002ffffffff
 00000000000000fa 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
worker_thread+0xa1/0xe0
autoremove_wake_function+0x0/0x2e
worker_thread+0x0/0xe0
kthread+0x47/0x74
schedule_tail+0x27/0x5b
child_rip+0xa/0x12
kthread+0x0/0x74
child_rip+0x0/0x12

events/3      S ffff81007f5b9810     0    18      2
 ffff81007f645ed0 0000000000000046 0000000000000000 0000000000000286
 ffff81007f5b9810 ffff81007f5b2810 ffff81007f5b9a98 00000003ffffffff
 00000000000000fa 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
worker_thread+0xa1/0xe0
autoremove_wake_function+0x0/0x2e
worker_thread+0x0/0xe0
kthread+0x47/0x74
schedule_tail+0x27/0x5b
child_rip+0xa/0x12
kthread+0x0/0x74
child_rip+0x0/0x12

khelper       S ffff81007f5b9090     0    19      2
 ffff81007f649ed0 0000000000000046 0000000000000000 ffff81011f026dc0
 ffff81007f5b9090 ffffffff804ef480 ffff81007f5b9318 0000000000000010
 0000000000000200 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
worker_thread+0xa1/0xe0
autoremove_wake_function+0x0/0x2e
worker_thread+0x0/0xe0
kthread+0x47/0x74
schedule_tail+0x27/0x5b
child_rip+0xa/0x12
kthread+0x0/0x74
child_rip+0x0/0x12

netns         S ffff81007f64d7d0     0    22      2
 ffff81007f66bed0 0000000000000046 0000000300000000 ffff8100451a1ec0
 ffff81007f64d7d0 ffff810108e46050 ffff81007f64da58 0000000300000000
 ffff81007f66beb0 ffffffff8022a818 ffff81007f589d10 ffff81007f5a6440
Call Trace:
complete+0x38/0x4b
worker_thread+0xa1/0xe0
autoremove_wake_function+0x0/0x2e
worker_thread+0x0/0xe0
kthread+0x47/0x74
schedule_tail+0x27/0x5b
child_rip+0xa/0x12
kthread+0x0/0x74
child_rip+0x0/0x12

kblockd/0     S ffff81007f64d050     0    57      2
 ffff81007f68bed0 0000000000000046 ffffffff8059ca80 ffffffff8059d640
 ffff81007f64d050 ffff8100a8d64050 ffff81007f64d2d8 0000000080301af5
 ffffffff8059ca80 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
worker_thread+0xa1/0xe0
autoremove_wake_function+0x0/0x2e
worker_thread+0x0/0xe0
kthread+0x47/0x74
schedule_tail+0x27/0x5b
child_rip+0xa/0x12
kthread+0x0/0x74
child_rip+0x0/0x12

kblockd/1     S ffff81007f66c810     0    58      2
 ffff81007f68fed0 0000000000000046 0000000000000000 ffffffff8059d640
 ffff81007f66c810 ffff81007f5a9090 ffff81007f66ca98 0000000180301af5
 ffffffff8059ca80 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
worker_thread+0xa1/0xe0
autoremove_wake_function+0x0/0x2e
worker_thread+0x0/0xe0
kthread+0x47/0x74
schedule_tail+0x27/0x5b
child_rip+0xa/0x12
kthread+0x0/0x74
child_rip+0x0/0x12

kblockd/2     S ffff81007f66c090     0    59      2
 ffff81007f691ed0 0000000000000046 ffff81007f5fe800 ffffffffa0023bc6
 ffff81007f66c090 ffff81013f020810 ffff81007f66c318 0000000200000286
 ffffffff8059ca80 ffffffff8059d640 0000000000000000 ffffffff8030a7f4
Call Trace:
:scsi_mod:scsi_request_fn+0x340/0x395
cfq_kick_queue+0x22/0x35
worker_thread+0xa1/0xe0
autoremove_wake_function+0x0/0x2e
worker_thread+0x0/0xe0
kthread+0x47/0x74
schedule_tail+0x27/0x5b
child_rip+0xa/0x12
kthread+0x0/0x74
child_rip+0x0/0x12

kblockd/3     S ffff81007f66d7d0     0    60      2
 ffff81007f693ed0 0000000000000046 0000000000000000 ffffffffa0023bc6
 ffff81007f66d7d0 ffff81007f5b2810 ffff81007f66da58 0000000380301af5
 ffffffff8059ca80 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
:scsi_mod:scsi_request_fn+0x340/0x395
worker_thread+0xa1/0xe0
autoremove_wake_function+0x0/0x2e
worker_thread+0x0/0xe0
kthread+0x47/0x74
schedule_tail+0x27/0x5b
child_rip+0xa/0x12
kthread+0x0/0x74
child_rip+0x0/0x12

kacpid        S ffff81007f66d050     0    62      2
 ffff81007f697ed0 0000000000000046 0000000000000000 0000000000000246
 ffff81007f66d050 ffff81007f5b2810 ffff81007f66d2d8 00000003804ef160
 0000000000000000 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
worker_thread+0xa1/0xe0
autoremove_wake_function+0x0/0x2e
worker_thread+0x0/0xe0
kthread+0x47/0x74
schedule_tail+0x27/0x5b
child_rip+0xa/0x12
kthread+0x0/0x74
child_rip+0x0/0x12

kacpi_notify  S ffff81007f670810     0    63      2
 ffff81007f699ed0 0000000000000046 0000000000000000 0000000000000246
 ffff81007f670810 ffff81007f5b2810 ffff81007f670a98 00000003804ef160
 0000000000000000 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
worker_thread+0xa1/0xe0
autoremove_wake_function+0x0/0x2e
worker_thread+0x0/0xe0
kthread+0x47/0x74
schedule_tail+0x27/0x5b
child_rip+0xa/0x12
kthread+0x0/0x74
child_rip+0x0/0x12

ksuspend_usbd S ffff81007f670090     0   142      2
 ffff81007f6c9ed0 0000000000000046 0000000000000000 ffff810037881000
 ffff81007f670090 ffff81007f5b2810 ffff81007f670318 000000038059d640
 0000000000000000 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
usb_autosuspend_work+0x0/0xe
worker_thread+0xa1/0xe0
autoremove_wake_function+0x0/0x2e
worker_thread+0x0/0xe0
kthread+0x47/0x74
schedule_tail+0x27/0x5b
child_rip+0xa/0x12
kthread+0x0/0x74
child_rip+0x0/0x12

khubd         S ffff81007f6b57d0     0   148      2
 ffff81007f6cde40 0000000000000046 ffff8100378815c0 ffffffff803869c9
 ffff81007f6b57d0 ffff81007e7bc090 ffff81007f6b5a58 00000003378af800
 ffff810037881000 00000000ffffffed 0000000000000000 ffff8100378815c0
Call Trace:
autosuspend_check+0xe9/0x103
hub_thread+0x0/0xcfd
hub_thread+0xc37/0xcfd
autoremove_wake_function+0x0/0x2e
hub_thread+0x0/0xcfd
kthread+0x47/0x74
schedule_tail+0x27/0x5b
child_rip+0xa/0x12
kthread+0x0/0x74
child_rip+0x0/0x12

kseriod       S ffff81007f6b5050     0   151      2
 ffff81007f6cfed0 0000000000000046 0000000000000000 0000000000000246
 ffff81007f6b5050 ffff81007e78e7d0 ffff81007f6b52d8 0000000380378d53
 0000000000000000 ffffffff80378fd9 ffff81007f66f2f8 0000000000000286
Call Trace:
bus_for_each_dev+0x62/0x6f
serio_thread+0x2db/0x35c
autoremove_wake_function+0x0/0x2e
serio_thread+0x0/0x35c
kthread+0x47/0x74
schedule_tail+0x27/0x5b
child_rip+0xa/0x12
kthread+0x0/0x74
child_rip+0x0/0x12

ubstatd       S ffff81013f6637d0     0   210      2
 ffff81007e741f10 0000000000000046 0000000000000000 0000000000000286
 ffff81013f6637d0 ffff81007f5a9090 ffff81013f663a58 0000000180645360
 0000000000000000 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
ubstatd+0x76/0x25f
schedule_tail+0x27/0x5b
child_rip+0xa/0x12
sysctl_default_lookup+0x0/0x30
ubstatd+0x0/0x25f
child_rip+0x0/0x12

kswapd0       S ffff81007e7227d0     0   214      2
 ffff81007e749e20 0000000000000046 0000000000000000 0000000000000212
 ffff81007e7227d0 ffff81007f5a9090 ffff81007e722a58 0000000180311b4b
 ffffffff804fe770 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
kswapd+0x107/0x4a3
isolate_pages_global+0x0/0x2f
thread_return+0xc6/0x107
autoremove_wake_function+0x0/0x2e
kswapd+0x0/0x4a3
kthread+0x47/0x74
schedule_tail+0x27/0x5b
child_rip+0xa/0x12
kthread+0x0/0x74
child_rip+0x0/0x12

kswapd1       S ffff81007e722050     0   215      2
 ffff81007e74be20 0000000000000046 0000000000000000 0000000000000212
 ffff81007e722050 ffff81013f57c7d0 ffff81007e7222d8 0000000280311b4b
 ffffffff804fe770 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
kswapd+0x107/0x4a3
isolate_pages_global+0x0/0x2f
thread_return+0xc6/0x107
autoremove_wake_function+0x0/0x2e
kswapd+0x0/0x4a3
kthread+0x47/0x74
schedule_tail+0x27/0x5b
child_rip+0xa/0x12
kthread+0x0/0x74
child_rip+0x0/0x12

aio/0         S ffff81007e724810     0   216      2
 ffff81007e751ed0 0000000000000046 0000000000000000 0000000000000246
 ffff81007e724810 ffffffff804ef480 ffff81007e724a98 00000000804ef160
 0000000000000000 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
worker_thread+0xa1/0xe0
autoremove_wake_function+0x0/0x2e
worker_thread+0x0/0xe0
kthread+0x47/0x74
schedule_tail+0x27/0x5b
child_rip+0xa/0x12
kthread+0x0/0x74
child_rip+0x0/0x12

aio/1         S ffff81007e724090     0   217      2
 ffff81007e753ed0 0000000000000046 0000000000000000 0000000000000246
 ffff81007e724090 ffff81007f5a9090 ffff81007e724318 00000001804ef160
 0000000000000000 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
worker_thread+0xa1/0xe0
autoremove_wake_function+0x0/0x2e
worker_thread+0x0/0xe0
kthread+0x47/0x74
schedule_tail+0x27/0x5b
child_rip+0xa/0x12
kthread+0x0/0x74
child_rip+0x0/0x12

aio/2         S ffff81007e7267d0     0   218      2
 ffff81007e755ed0 0000000000000046 0000000000000000 0000000000000246
 ffff81007e7267d0 ffff81013f57c7d0 ffff81007e726a58 00000002804ef160
 0000000000000000 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
worker_thread+0xa1/0xe0
autoremove_wake_function+0x0/0x2e
worker_thread+0x0/0xe0
kthread+0x47/0x74
schedule_tail+0x27/0x5b
child_rip+0xa/0x12
kthread+0x0/0x74
child_rip+0x0/0x12

aio/3         S ffff81007e726050     0   219      2
 ffff81007e759ed0 0000000000000046 0000000000000000 0000000000000246
 ffff81007e726050 ffff81007f5b2810 ffff81007e7262d8 00000003804ef160
 0000000000000000 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
worker_thread+0xa1/0xe0
autoremove_wake_function+0x0/0x2e
worker_thread+0x0/0xe0
kthread+0x47/0x74
schedule_tail+0x27/0x5b
child_rip+0xa/0x12
kthread+0x0/0x74
child_rip+0x0/0x12

scsi_eh_0     S ffff81013f0e07d0     0   722      2
 ffff81013d891e80 0000000000000046 ffff810001018020 ffff8100010144b8
 ffff81013f0e07d0 ffff810037845810 ffff81013f0e0a58 00000000ffffffff
 0000000000000286 00000000ffffffff ffff81013d891e90 ffff810001017800
Call Trace:
:scsi_mod:scsi_error_handler+0x59/0x4b7
thread_return+0xc6/0x107
:scsi_mod:scsi_error_handler+0x0/0x4b7
kthread+0x47/0x74
schedule_tail+0x27/0x5b
child_rip+0xa/0x12
flat_send_IPI_mask+0x0/0x71
kthread+0x0/0x74
child_rip+0x0/0x12

aacraid       S ffff81013f0d2090     0   764      2
 ffff81013d8e9dd0 0000000000000046 0000000000000000 0000000000000286
 ffff81013f0d2090 ffff81007f5b2810 ffff81013f0d2318 000000033d8e9de0
 ffff81003784c658 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
:aacraid:aac_command_thread+0x669/0x6c2
default_wake_function+0x0/0xe
:aacraid:aac_command_thread+0x0/0x6c2
kthread+0x47/0x74
schedule_tail+0x27/0x5b
child_rip+0xa/0x12
kthread+0x0/0x74
child_rip+0x0/0x12

ata/0         S ffff81013f6f8810     0   777      2
 ffff81013d977ed0 0000000000000046 000000005a43fed0 00000000ffffffff
 ffff81013f6f8810 ffff81013f0d4090 ffff81013f6f8a98 000000003d864200
 0000000000000000 0000000000000000 ffff81013d977f20 ffffffff804224eb
Call Trace:
thread_return+0xc6/0x107
worker_thread+0xa1/0xe0
autoremove_wake_function+0x0/0x2e
worker_thread+0x0/0xe0
kthread+0x47/0x74
schedule_tail+0x27/0x5b
child_rip+0xa/0x12
kthread+0x0/0x74
child_rip+0x0/0x12

ata/1         S ffff81013f0287d0     0   778      2
 ffff81013d951ed0 0000000000000046 000000005b2920a2 0000000000000000
 ffff81013f0287d0 ffff810037845810 ffff81013f028a58 00000001378417c0
 0000000000000000 ffffffff8059d640 ffff81013d951f20 ffffffff804224eb
Call Trace:
thread_return+0xc6/0x107
worker_thread+0xa1/0xe0
autoremove_wake_function+0x0/0x2e
worker_thread+0x0/0xe0
kthread+0x47/0x74
schedule_tail+0x27/0x5b
child_rip+0xa/0x12
kthread+0x0/0x74
child_rip+0x0/0x12

ata/2         S ffff81013e336090     0   779      2
 ffff81013ddd1ed0 0000000000000046 000000005a86da6c 00000000ffffffff
 ffff81013e336090 ffff81007f5807d0 ffff81013e336318 000000023d8ecc40
 0000000000000000 ffff81013dd3bc08 ffff81013ddd1f20 ffffffff804224eb
Call Trace:
thread_return+0xc6/0x107
worker_thread+0xa1/0xe0
autoremove_wake_function+0x0/0x2e
worker_thread+0x0/0xe0
kthread+0x47/0x74
Mar  6 16:09:43 magrathea kernel: [146690ad+0x47/0x74
schedule_tail+0x27/0x5b
child_rip+0xa/0x12
kthread+0x0/0x74
child_rip+0x0/0x12

kstriped      S ffff81013f026090     0   997      2
 ffff81013d8aded0 0000000000000046 00000000ecf09027 00000000ffffffff
 ffff81013f026090 ffff81013f6ea7d0 ffff81013f026318 000000013d865240
 0000000000000000 0000000000000000 ffff81013d8adf20 ffffffff804224eb
Call Trace:
thread_return+0xc6/0x107
worker_thread+0xa1/0xe0
autoremove_wake_function+0x0/0x2e
worker_thread+0x0/0xe0
kthread+0x47/0x74
schedule_tail+0x27/0x5b
child_rip+0xa/0x12
kthread+0x0/0x74
child_rip+0x0/0x12

ksnapd        S ffff81013f0e0050     0  1005      2
 ffff81013d92fed0 0000000000000046 0000000000000000 0000000000000246
 ffff81013f0e0050 ffffffff804ef480 ffff81013f0e02d8 000000003d975780
 0000000000000000 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
worker_thread+0xa1/0xe0
autoremove_wake_function+0x0/0x2e
worker_thread+0x0/0xe0
kthread+0x47/0x74
schedule_tail+0x27/0x5b
child_rip+0xa/0x12
kthread+0x0/0x74
child_rip+0x0/0x12

kdmflush      S ffff81013e33d050     0  1028      2
 ffff81013ddffed0 0000000000000046 0000000300000000 ffff810037b73c58
 ffff81013e33d050 ffff81013e33e090 ffff81013e33d2d8 0000000100000000
 ffff81013ddffeb0 ffffffff8022a818 ffffffffa010d35a ffff810037888740
Call Trace:
complete+0x38/0x4b
:dm_mod:dm_wq_work+0x0/0xa2
worker_thread+0xa1/0xe0
autoremove_wake_function+0x0/0x2e
worker_thread+0x0/0xe0
kthread+0x47/0x74
schedule_tail+0x27/0x5b
child_rip+0xa/0x12
lapic_next_event+0x0/0x13
kthread+0x0/0x74
child_rip+0x0/0x12

kdmflush      S ffff81013e3b37d0     0  1032      2
 ffff81013dc41ed0 0000000000000046 0000000300000000 ffff810037b73c58
 ffff81013e3b37d0 ffff81013f67c090 ffff81013e3b3a58 0000000100000000
 ffff81013dc41eb0 ffffffff8022a818 ffffffffa010d35a ffff810037888940
Call Trace:
complete+0x38/0x4b
:dm_mod:dm_wq_work+0x0/0xa2
worker_thread+0xa1/0xe0
autoremove_wake_function+0x0/0x2e
worker_thread+0x0/0xe0
kthread+0x47/0x74
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
default_wake_function+0x0/0xe
proc_alloc_inode+0x40/0x69
alloc_inode+0x115/0x185
vsnprintf+0x568/0x5b1
d_instantiate+0x52/0x5d
d_rehash+0x21/0x2c
proc_root_lookup+0x12/0x30
do_lookup+0x85/0x1dd
__link_path_walk+0xd4f/0xddd
__next_cpu+0x19/0x26
nr_context_switches+0x44/0x53
ub_slab_ptr+0x21/0x81
ub_slab_charge+0x53/0x6f
core_sys_select+0x1c5/0x27e
ub_slab_ptr+0x21/0x81
bit_waitqueue+0x10/0x97
do_uncharge_dcache+0x3d/0x51
sys_select+0x15a/0x183
do_gettimeofday+0x10/0x32
system_call_after_swapgs+0x8a/0x8f

ntpd          S ffff81012719a810     0 18244      1
 ffff8101215e59f8 0000000000000082 0000000000000000 ffffffff8042393f
 ffff81012719a810 ffff81013f57c7d0 ffff81012719aa98 000000023f08c800
 0000000000000000 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
_read_lock_bh+0x9/0x19
schedule_timeout+0x1e/0xad
datagram_poll+0x6b/0xf1
udp_poll+0x13/0x121
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
Mar  6 16:09:43 magrathea last message repeated 7 times
enqueue_hrtimer+0xd7/0xe4
hrtimer_start+0x112/0x134
ktime_get_ts+0x22/0x4b
core_sys_select+0x1c5/0x27e
recalc_sigpending+0xe/0x38
do_notify_resume+0x747/0x82b
sys_select+0xc1/0x183
system_call_after_swapgs+0x8a/0x8f

atd           S ffff81013255b810     0 18295      1
 ffff81011f11de98 0000000000000082 0000000000000000 ffffffff80249f2c
 ffff81013255b810 ffff81007f5b2810 ffff81013255ba98 000000038221f4b8
 0000000000000286 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
try_to_wake_up+0x118/0x129
do_wait+0x93e/0xa0c
vfs_ioctl+0x21/0x6b
default_wake_function+0x0/0xe
mntput_no_expire+0x20/0x10e
recalc_sigpending+0xe/0x38
sys_wait4+0x8a/0xa1
system_call_after_swapgs+0x8a/0x8f

lighttpd      S ffff81007bd2a7d0     0 12202      1
 ffff81007385bb18 0000000000000086 0000000000000000 0000000000000286
 ffff81007bd2a7d0 ffff81007f5a9090 ffff81007bd2aa58 000000017385bb28
 ffff81007385be64 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_sys_poll+0x255/0x323
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
default_wake_function+0x0/0xe
_spin_lock_bh+0x9/0x1f
release_sock+0x13/0x96
tcp_recvmsg+0xae5/0xbf7
__generic_file_aio_write_nolock+0x33f/0x3a9
enqueue_hrtimer+0xd7/0xe4
hrtimer_start+0x112/0x134
sysret_signal+0x2b/0x45
hrtick_set+0x9e/0xf7
do_notify_resume+0x819/0x82b
do_uncharge_dcache+0x3d/0x51
uncharge_dcache+0x19/0x2a
dput+0xc6/0x14f
sys_poll+0x35/0x81
system_call_after_swapgs+0x8a/0x8f

su            S ffff81013d856090     0 12680  25712
 ffff81013d8c7e88 0000000000000086 0000000000000000 ffff810102456090
 ffff81013d856090 ffff81007f5b2810 ffff81013d856318 0000000300000038
 ffff81001d8e0018 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
apic_wait_icr_idle+0xe/0x15
do_wait+0x93e/0xa0c
default_wake_function+0x0/0xe
sys_rt_sigaction+0x55/0x8c
recalc_sigpending+0xe/0x38
sys_wait4+0x8a/0xa1
system_call_after_swapgs+0x8a/0x8f

bash          R ffff810102456090     0 12684  12680
 ffff810102456090 ffff810100189e18 ffff810102456090 ffff810102456090
 ffff810101c44000 0000000000000096 ffffffff805ff740 00000000ffffff20
 0000000000000008 0000000000000000 000000000000318c 0000000000003188
Call Trace:
__kernel_text_address+0x1a/0x26
dump_trace+0x2c8/0x317
show_trace+0x40/0x57
_show_stack+0xe9/0xf8
show_state_filter+0x50/0xb1
__handle_sysrq+0x8f/0x129
write_sysrq_trigger+0x44/0x62
 [<f0x8f

init          S ffff810029834810     0  8393      1
 ffff81001d8eb9f8 0000000000000082 0000000000000000 0000000000000282
 ffff810029834810 ffffffff804ef480 ffff810029834a98 000000001d8eba08
 ffff810065c30bc0 000000000000000fff000ace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
try_to_wake_up+0x118/0x129
__alloc_skb+0x8d/0x153
__wake_up_common+0x41/0x74
__wake_up_sync+0x3a/0x56
sock_def_readable+0x32/0x5d
__d_lookup+0xd6/0x11e
__d_lookup+0xd6/0x11e
do_lookup+0x85/0x1dd
:simfs:sim_systemcall+0x4e/0x272
__link_path_walk+0xd4f/0xddd
core_sys_select+0x1c5/0x27e
vfs_getattr+0x35/0x74
mntput_no_expire+0x20/0x10e
cp_new_stat+0xe7/0xff
sys_select+0x15a/0x183
system_call_after_swapgs+0x8a/0x8f

init          S ffff8100ad5e3810     0  8594      1
 ffff81012f0659f8 0000000000000082 0000000000000000 0000000000000282
 ffff8100ad5e3810 ffffffff804ef480 ffff8100ad5e3a98 000000002f065a08
 ffff81007e8011c0 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
try_to_wake_up+0x118/0x129
__alloc_skb+0x8d/0x153
__wake_up_common+0x41/0x74
__wake_up_sync+0x3a/0x56
sock_def_readable+0x32/0x5d
__d_lookup+0xd6/0x11e
__d_lookup+0xd6/0x11e
do_lookup+0x85/0x1dd
:simfs:sim_systemcall+0x4e/0x272
__link_path_walk+0xd4f/0xddd
core_sys_select+0x1c5/0x27e
vfs_getattr+0x35/0x74
mntput_no_expire+0x20/0x10e
cp_new_stat+0xe7/0xff
sys_select+0x15a/0x183
system_call_after_swapgs+0x8a/0x8f

init          S ffff81008bcdb810     0  8616      1
 ffff810130d699f8 0000000000000082 0000000000000000 0000000000000286
 ffff81008bcdb810 ffff81013f676050 ffff81008bcdba98 0000000330d69a08
 ffff81013103f680 0000000114a9e796 0000000000000286 ffffffff8023e13b
Call fff804ef480 ffff81000de802d8 0000000078d0ba08
 ffff81007bd371c0 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
try_to_wake_up+0x118/0x129
__alloc_skb+0x8d/0x153
__wake_up_common+0x41/0x74
__wake_up_sync+0x3a/0x56
sock_def_readable+0x32/0x5d
__d_lookup+0xd6/0x11e
__d_lookup+0xd6/0x11e
do_lookup+0x85/0x1dd
:simfs:sim_systemcall+0x4e/0x272
__link_path_walk+0xd4f/0xddd
core_sys_select+0x1c5/0x27e
vfs_getattr+0x35/0x74
mntput_no_expire+0x20/0x10e
cp_new_stat+0xe7/0xff
sys_select+0x15a/0x183
system_call_after_swapgs+0x8a/0x8f

rsyslogd      S ffff810018d7e810     0  9560   8393
 ffff81002999f9f8 0000000000000086 0000000000000000 0000000000000286
 ffff810018d7e810 ffff81007f5a9090 ffff810018d7ea98 000000012999fa08
 0000000000000008 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
handle_mm_fault+0x421/0x9c5
__pollwait+0x0/0xe1
:jbd:journal_dirty_metadata+0xcc/0xe3
bit_waitqueue+0x10/0x97
do_page_fault+0x5c9/0x9ab
__up_read+0x13/0x8a
error_exit+0x0/0x60
getnstimeofday+0x39/0x98
zone_statistics+0x3a/0x8e
get_page_from_freelist+0x416/0x587
__rmqueue_smallest+0x88/0x104
__rmqueue+0x1c/0x1b2
getnstimeofday+0x39/0x98
rb_insert_color+0x61/0xda
enqueue_hrtimer+0xd7/0xe4
hrtimer_start+0x112/0x134
core_sys_select+0x1c5/0x27e
sysret_signal+0x2b/0x45
do_notify_resume+0x819/0x82b
signal_wake_up+0x21/0x30
send_signal+0x1bf/0x1db
group_send_sig_info+0x76/0x83
kill_pid_info+0x35/0x47
sys_select+0x15a/0x183
sysret_signal+0x2b/0x45
system_call_after_swapgs+0x8a/0x8f
handle_mm_fault+0x265/0x9c5
ub_slab_ptr+0x21/0x81
ub_slab_uncharge+0x36/0x41
sys_select+0xc1/0x183
__up_read+0x13/0x8a
system_call_after_swapgs+0x8a/0x8f

exim4         S ffff81008664e090     0 10635   8393
 ffff81012b2a99f8 0000000000000082 ffff81008ac87430 ffff8100b084f818
 ffff81008664e090 ffff81011cc7e050 ffff81008664e318 00000003a013388b
 00000000b698f880 ffff81010a51df00 ffff8100bf9a9c28 ffff81013fb05678
Call Trace:
schedule_timeout+0x1e/0xad
remove_wait_queue+0x12/0x45
add_wait_queue+0x15/0x46
tcp_poll+0x1b/0x1a2
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
vsnprintf+0x568/0x5b1
__alloc_pages_internal+0x3f6/0x41a
zone_statistics+0x3a/0x8e
getnstimeofday+0x39/0x98
update_curr+0x44/0x6f
ktime_get+0xc/0x41
ub_slab_ptr+0x21/0x81
snprintf+0x44/0x4c
core_sys_select+0x1c5/0x27e
ub_task_uncharge+0xbb/0x140
remove_wait_queue+0x12/0x45
do_wait+0x97c/0xa0c
sys_select+0xc1/0x183
system_call_after_swapgs+0x8a/0x8f

atd           S ffff81010fdca050     0 10825   8393
 ffff81011bc17e98 0000000000000082 0000000000000000 ffffffff80249f2c
 ffff81010fdca050 ffff810088598050 ffff81010fdca2d8 000000038221f4b8
 0000000000000286 ffffffff8024a6a2 ffffffff802acb7c ffffffffa014c709
Call Trace:
enqueue_hrtimer+0xd7/0xe4
hrtimer_start+0x112/0x134
filldir+0x0/0xb7
:ext3:__ext3_journal_stop+0x1f/0x3d
do_nanosleep+0x5c/0x9c
hrtimer_nanosleep+0x54/0xbd
hrtimer_wakeup+0x0/0x21
do_nanosleep+0x41/0x9c
sys_nanosleep+0x4c/0x62
system_call_after_swapgs+0x8a/0x8f

cron          S ffff8101214567d0     0 10962   8393
 ffff810127123e98 0000000000000086 0000000000000000 ffffffff80249f2c
 ffff8101214567d0 ffff81007f5b2810 ffff810121456a58 000000038221f4b8
 0000000000000286 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
enqueue_hrtimer+0xd7/0xe4
do_nanosleep+0x5c/0x9c
hrtimer_nanosleep+0x54/0xbd
hrtimer_wakeup+0x0/0x21
do_nanosleep+0x41/0x9c
sys_nanosleep000000000082 0000000000000000 0000000000000282
 ffff81012d0c2090 ffffffff804ef480 ffff81012d0c2318 0000000005ce5a08
 ffff81007f5d4980 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
try_to_wake_up+0x118/0x129
__alloc_skb+0x8d/0x153
__wake_up_common+0x41/0x74
__wake_up_sync+0x3a/0x56
sock_def_readable+0x32/0x5d
__d_lookup+0xd6/0x11e
__d_lookup+0xd6/0x11e
do_lookup+0x85/0x1dd
:simfs:sim_systemcall+0x4e/0x272
__link_path_walk+0xd4f/0xddd
core_sys_select+0x1c5/0x27e
vfs_getattr+0x35/0x74
mntput_no_expire+0x20/0x10e
cp_new_stat+0xe7/0xff
sys_select+0x15a/0x183
system_call_after_swapgs+0x8a/0x8f

apache2       S ffff810018d7e090     0 12247   8238
 ffff81007884b9f8 0000000000000082 0000000000000000 0000000000000282
 ffff810018d7e090 ffffffff804ef480 ffff810018d7e318 000000007884ba08
 0000000000000000 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
:jbd:journal_stop+0x181/0x18d
:ext3:__ext3_journal_stop+0x1f/0x3d
:ext3:ext3_ordered_write_end+0xfa/0x110
generic_file_buffered_write+0x206/0x61b
zone_statistics+0x3a/0x8e
__alloc_pages_internal+0x3f6/0x41a
inc_held_pages+0x4e/0x62
pb_add_ref+0x72/0x81
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x930/0x9c5
remove_wait_queue+0x12/0x45
do_wait+0x97c/0xa0c
sys_select+0x15a/0x183
system_call_after_swapgs+0x8a/0x8f

apache2       S ffff810057940050     0 12270  12247
 ffff81007b465d58 0000000000000086 ffff81006e598000 ffffffff8027594a
 ffff810057940050 ffff81011e91d050 ffff8100579402d8 0000000080277799
 ffff810076629ce0 0000000000014c45 ffff81007e1c4ac0 0000000000000286
Call Trace:
find_lock_page+0x1f/0x8a
schedule_timeout+0x1e/0xad
prepare_to_wait_exclusive+0x15/0x5e
 ffff81007095be28 0000000000000082 0000000000000000 00000000000675ad
 ffff81007c09f810 ffff810000d87050 ffff81007c09fa98 0000000180252e9c
 ffff810000000000 ffff810003c181d8 ffffe200012d6b40 ffff81000352d540
Call Trace:
do_syslog+0x15c/0x542
autoremove_wake_function+0x0/0x2e
kmsg_read+0x3a/0x44
proc_reg_read+0x73/0x8e
vfs_read+0xaa/0x152
recalc_sigpending+0xe/0x38
sys_read+0x49/0xc2
system_call_after_swapgs+0x8a/0x8f

rsyslogd      S ffff81003a6f6090     0 30997   8594
 ffff810069c43c98 0000000000000082 0000000000000000 ffffffff80249f2c
 ffff81003a6f6090 ffff81007f5b2810 ffff81003a6f6318 000000038221f4b8
 0000000000000286 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
enqueue_hrtimer+0xd7/0xe4
futex_wait+0x24c/0x394
hrtimer_wakeup+0x0/0x21
futex_wait+0x228/0x394
file_update_time+0x3b/0xf2
default_wake_function+0x0/0xe
do_futex+0x81/0x777
getnstimeofday+0x39/0x98
ktime_get_ts+0x22/0x4b
sys_futex+0xfe/0x11c
vfs_write+0x121/0x156
getnstimeofday+0x39/0x98
system_call_after_swapgs+0x8a/0x8f

rsyslogd      S ffff8101107a9810     0 12781   8616
 ffff810105d259f8 0000000000000082 0000000000000000 0000000000000286
 ffff8101107a9810 ffff81013f57c7d0 ffff8101107a9a98 0000000205d25a08
 0000000000000008 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
handle_mm_fault+0x421/0x9c5
__pollwait+0x0/0xe1
:jbd:journal_dirty_metadata+0xcc/0xe3
do_page_fault+0x5c9/0x9ab
__up_read+0x13/0x8a
error_exit+0x0/0x60
getnstimeofday+0x39/0x98
zone_statistics+0x3a/0x8e
ktime_get_ts+0x22/0x4b
ktime_get+0xc/0x41
hrtick_start_fair+0xfb/0x144
getnstimeofday+0x39/0x98
rb_insert_color+0x61/0xda
enqueue_hrtimer+0xd7/0xe4
hrtimer_start+0x112/0x134
core_sys_select+0x1c5/0x27e
sysret_signal+0x2b/0x45
do_notify_resume+0x819/0x82b
signal_wake_up+0x21/0x30
send_signal+0x1bf/0x1db
kmsg_read+0x3a/0x44
proc_reg_read+0x73/0x8e
vfs_read+0xaa/0x152
recalc_sigpending+0xe/0x38
sys_read+0x49/0xc2
system_call_after_swapgs+0x8a/0x8f

rsyslogd      S ffff81007bc99050     0 30736   8658
 ffff810003503c98 0000000000000082 00000000ffffffff ffffffff80249f2c
 ffff81007bc99050 ffff810058d5e050 ffff81007bc992d8 00000000010144b8
 0000000000000286 ffffffff8024a6a2 ffff810121814a70 ffffffff8027539a
Call Trace:
enqueue_hrtimer+0xd7/0xe4
hrtimer_start+0x112/0x134
remove_suid+0x18/0x4b
futex_wait+0x24c/0x394
hrtimer_wakeup+0x0/0x21
futex_wait+0x228/0x394
file_update_time+0x3b/0xf2
default_wake_function+0x0/0xe
do_futex+0x81/0x777
getnstimeofday+0x39/0x98
ktime_get_ts+0x22/0x4b
sys_futex+0xfe/0x11c
vfs_write+0x121/0x156
getnstimeofday+0x39/0x98
system_call_after_swapgs+0x8a/0x8f

sshd          S ffff81011cc7e7d0     0 13058   8658
 ffff81011e07b9f8 0000000000000086 ffff81008ac876d0 ffff8101013dd540
 ffff81011cc7e7d0 ffff8100579407d0 ffff81011cc7ea58 00000000a013388b
 0000000080281620 ffff810067b11948 000000007fc31ec0 000000010000000b
Call Trace:
schedule_timeout+0x1e/0xad
add_wait_queue+0x15/0x46
tcp_poll+0x1b/0x1a2
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
default_wake_function+0x0/0xe
generic_file_buffered_write+0x206/0x61b
:ext3:__ext3_journal_dirty_metadata+0x1e/0x46
current_fs_time+0x1e/0x24
remove_suid+0x18/0x4b
dec_held_pages+0x4e/0x62
find_lock_page+0x1f/0x8a
filemap_fault+0x1c2/0x33d
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x265/0x9c5
ub_slab_ptr+0x21/0x81
ub_slab_uncharge+0x36/0x41
sys_select+0xc1/0x183
__up_read+0x13/0x8a
system_call_after_swapgs+0x8a/0x8f

rsyslogd      S ffff81013484a810     0 13100   8743
 ffff810129cf79f8 0000000000000082 0000000000000000 0000000000000286
 ffff81013484a810 ffff81013f57c7d0 ffff81013484aa98 0000000229cf7a08
 0000000000000008 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
 [<ffffffff8023db_lookup+0xd6/0x11e
__d_lookup+0xd6/0x11e
do_lookup+0x85/0x1dd
:simfs:sim_systemcall+0x4e/0x272
__link_path_walk+0xd4f/0xddd
core_sys_select+0x1c5/0x27e
vfs_getattr+0x35/0x74
mntput_no_expire+0x20/0x10e
cp_new_stat+0xe7/0xff
sys_select+0x15a/0x183
system_call_after_swapgs+0x8a/0x8f

rsyslogd      S ffff810079d89050     0 13414   9082
 ffff81005a0f59f8 0000000000000082 0000000000000000 0000000000000286
 ffff810079d89050 ffff81007f5b2810 ffff810079d892d8 000000035a0f5a08
 0000000000000008 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
handle_mm_fault+0x421/0x9c5
__pollwait+0x0/0xe1
uncharge_beancounter+0x3b/0x50
ub_slab_uncharge+0x36/0x41
hrtick_set+0x88/0xf7
thread_return+0xc6/0x107
__up_read+0x13/0x8a
zone_statistics+0x3a/0x8e
update_curr+0x44/0x6f
enqueue_entity+0x68/0x8a
getnstimeofday+0x39/0x98
ktime_get_ts+0x22/0x4b
update_curr+0x44/0x6f
ktime_get+0xc/0x41
hrtick_start_fair+0xfb/0x144
apic_wait_icr_idle+0xe/0x15
__next_cpu+0x19/0x26
core_sys_select+0x1c5/0x27e
signal_wake_up+0x21/0x30
send_signal+0x1bf/0x1db
group_send_sig_info+0x76/0x83
kill_pid_info+0x35/0x47
sys_select+0x15a/0x183
system_call_after_swapgs+0x8a/0x8f

rsyslogd      S ffff810108e46050     0 13418   9082
 ffff81012f1ed9f8 0000000000000082 0000000000000000 ffff81012f1edaa8
 ffff810108e46050 ffff81007e078810 ffff810108e462d8 000000009e181d90
 ffff81012f1edb28 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x1e/0xad
add_wait_queue+0x15/0x46
unix_peer_get+0x10/0x28
unix_dgram_poll+0xd6/0x151
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
ub_slab_ptr+0x21/0x81
__skb_recv_datagram+0x1f2/0x219
ub_skb_uncharge+0x246/0x2bd
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x265/0x9c5
ub_slab_ptr+0x21/0x81
ub_slab_uncharge+0x36/0x41
system_call_after_swapgs+0x8a/0x8f

init          S ffff81007e46f090     0 14467      1
 ffff81001d8b59f8 0000000000000086 0000000000000000 0000000000000286
 ffff81007e46f090 ffff81007f5a9090 ffff81007e46f318 000000011d8b5a08
 ffff81007870a780 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
:ext3:ext3_ordered_write_end+0xfa/0x110
generic_file_buffered_write+0x206/0x61b
current_fs_time+0x1e/0x24
__d_lookup+0xd6/0x11e
do_lookup+0x85/0x1dd
:simfs:sim_systemcall+0x4e/0x272
__link_path_walk+0xd4f/0xddd
core_sys_select+0x1c5/0x27e
vfs_getattr+0x35/0x74
mntput_no_expire+0x20/0x10e
cp_new_stat+0xe7/0xff
sys_select+0x15a/0x183
system_call_after_swapgs+0x8a/0x8f

exim4         S ffff8100b24e7810     0 14704   8658
 ffff810119c859f8 0000000000000082 ffff810047992130 ffff81013a6c6f00
 ffff8100b24e7810 ffff8101076147d0 ffff8100b24e7a98 00000002a013388b
 0000000080281620 ffff81010a51de70 ffff81013f5e45c0 ffffffff8027ac8b
Call Trace:
get_page_from_freelist+0x416/0x587
schedule_timeout+0x1e/0xad
remove_wait_queue+0x12/0x45
add_wait_queue+0x15/0x46
tcp_poll+0x1b/0x1a2
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
vsnprintf+0x568/0x5b1
__alloc_pages_internal+0x3f6/0x41a
zone_statistics+0x3a/0x8e
__ub_unused_privvm_dec+0x44/0x60
snprintf+0x44/0x4c
core_sys_select+0x1c5/0x27e
ub_task_uncharge+0xbb/0x140
remove_wait_queue+0x12/0x45
do_wait+0x97c/0xa0c
sys_select+0xc1/0x183
system_call_after_swapgs+0x8a/0x8f

init          S ffff81007bd2a050     0 14730      1
 ffff81007e9419f8 0000000000000082 0000000000000000 0000000000000286
 ffff81007bd2a050 ffff81007f5a9090 ffff81007bd2a2d8 000000017e941a08
 ffff81007b4cbe98 0000000000000082 0000000000000000 ffffffff80249f2c
 ffff810029d1d050 ffff810058d5e050 ffff810029d1d2d8 00000000010144b8
 0000000000000286 ffffffff8024a6a2 0000000000000000 0000000000000296
Call Trace:
enqueue_hrtimer+0xd7/0xe4
hrtimer_start+0x112/0x134
do_nanosleep+0x5c/0x9c
hrtimer_nanosleep+0x54/0xbd
hrtimer_wakeup+0x0/0x21
do_nanosleep+0x41/0x9c
sys_nanosleep+0x4c/0x62
system_call_after_swapgs+0x8a/0x8f

exim4         S ffff810132b84050     0 15294   8743
 ffff81012b3b19f8 0000000000000086 ffff81005628eeb0 ffff8100864e4540
 ffff810132b84050 ffff8100bd948090 ffff810132b842d8 00000003a013388b
 00000000909e2338 ffff81010a51dea0 ffff81013facb408 ffff810086c38198
Call Trace:
schedule_timeout+0x1e/0xad
remove_wait_queue+0x12/0x45
add_wait_queue+0x15/0x46
tcp_poll+0x1b/0x1a2
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
vsnprintf+0x568/0x5b1
ub_kmemsize_charge+0x4e/0x86
__alloc_pages_internal+0x3f6/0x41a
__ub_unused_privvm_dec+0x44/0x60
snprintf+0x44/0x4c
core_sys_select+0x1c5/0x27e
ub_task_uncharge+0xbb/0x140
remove_wait_queue+0x12/0x45
do_wait+0x97c/0xa0c
sys_select+0xc1/0x183
system_call_after_swapgs+0x8a/0x8f

exim4         S ffff810110190050     0 15323   8616
 ffff81011e8e19f8 0000000000000082 ffff81012b93e3d0 ffff8100927d27b0
 ffff810110190050 ffff81013f020810 ffff8101101902d8 00000003a013388b
 000000003facb5a8 ffff81010a51df00 ffff810100d36678 ffff8101313f6338
Call Trace:
schedule_timeout+0x1e/0xad
remove_wait_queue+0x12/0x45
add_wait_queue+0x15/0x46
tcp_poll+0x1b/0x1a2
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
vsnprintf+0x568/0x5b1
ub_kmemsize_charge+0x4e/0x86
__alloc_pages_internal+0x3f6/0x41a
zone_statistics+0x3a/0x8e
__ub_unused_privvm_dec+0x44/0x60
snprintf+0x44/0x4c
core_sys_select+0x1c5/0x27e
ub_task_uncharge+0xbb/0x140
remove_wait_queue+0x12/0x45
do_wait+0x97c/0xa0c
sys_select+0xc1/0x183
 ffffe20004363400 ffff811
Call Trace:
pb_free+0x18/0x21
schedule_timeout+0x1e/0xad
lock_sock_nested+0x9b/0xa6
_spin_lock_bh+0x9/0x1f
release_sock+0x13/0x96
inet_csk_accept+0xb3/0x22a
autoremove_wake_function+0x0/0x2e
inet_accept+0x25/0xb6
sys_accept+0xfc/0x1ce
do_page_fault+0x5c9/0x9ab
ep_ptable_queue_proc+0x0/0x7c
system_call_after_swapgs+0x8a/0x8f

apache2       S ffff810078db5050     0 15803  15564
 ffff8100739f5d88 0000000000000082 ffff810075dc48c0 0000000000000286
 ffff810078db5050 ffff810012d7c090 ffff810078db52d8 000000007e549898
 ffffe20004363400 ffff81006e369880 00007fb05bb13a10 ffffffff80255cc1
Call Trace:
pb_free+0x18/0x21
schedule_timeout+0x1e/0xad
lock_sock_nested+0x9b/0xa6
_spin_lock_bh+0x9/0x1f
release_sock+0x13/0x96
inet_csk_accept+0xb3/0x22a
autoremove_wake_function+0x0/0x2e
inet_accept+0x25/0xb6
sys_accept+0xfc/0x1ce
do_page_fault+0x5c9/0x9ab
ep_ptable_queue_proc+0x0/0x7c
system_call_after_swapgs+0x8a/0x8f

apache2       S ffff81003f5a3810     0 15840  15564
 ffff8100579e5d88 0000000000000082 ffff81007395ace0 0000000000000286
 ffff81003f5a3810 ffff81009088e7d0 ffff81003f5a3a98 000000001d8f8898
 ffffe20004363400 ffff81007cc8b240 00007fb05bb13a10 ffffffff80255cc1
Call Trace:
pb_free+0x18/0x21
schedule_timeout+0x1e/0xad
lock_sock_nested+0x9b/0xa6
_spin_lock_bh+0x9/0x1f
release_sock+0x13/0x96
inet_csk_accept+0xb3/0x22a
autoremove_wake_function+0x0/0x2e
inet_accept+0x25/0xb6
sys_accept+0xfc/0x1ce
do_page_fault+0x5c9/0x9ab
ep_ptable_queue_proc+0x0/0x7c
system_call_after_swapgs+0x8a/0x8f

apache2       S ffff810035080050     0 15855  15564
 ffff81002996fd88 0000000000000086 ffff8100378ccce0 0000000000000286
 ffff810035080050 ffff81007124d810 ffff8100350802d8 0000000070954898
 ffffe20004363400 ffff810073563900 00007fb05bb13a10 ffffffff80255cc1
Call Trace:
pb_free+0x18/0x21
schedule_timeout+0x1e/0xad
lock_sock_nested+0x9b/0xa6
_spin_lock_bh+0x9/0x1f
release_sock+0x13/0x96
inet_csk_accept+0xb3/0x22a
8100902e9c
 ffff810000000000 ffff81004dc8a4b8 ffffe2000083a840 ffff8100032e0f40
Call Trace:
do_syslog+0x15c/0x542
autoremove_wake_function+0x0/0x2e
kmsg_read+0x3a/0x44
proc_reg_read+0x73/0x8e
vfs_read+0xaa/0x152
recalc_sigpending+0xe/0x38
sys_read+0x49/0xc2
system_call_after_swapgs+0x8a/0x8f

sshd          S ffff810120d90050     0 16441   9531
 ffff8100bfdeb9f8 0000000000000086 ffff81003a7da3d0 ffff81002fbf1338
 ffff810120d90050 ffff8100994817d0 ffff810120d902d8 00000003a013388b
 0000000080281620 ffff81010a51d720 000000003f6572c0 000000010000000b
Call Trace:
schedule_timeout+0x1e/0xad
add_wait_queue+0x15/0x46
tcp_poll+0x1b/0x1a2
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
default_wake_function+0x0/0xe
generic_file_buffered_write+0x206/0x61b
:ext3:__ext3_journal_dirty_metadata+0x1e/0x46
current_fs_time+0x1e/0x24
remove_suid+0x18/0x4b
dec_held_pages+0x4e/0x62
find_lock_page+0x1f/0x8a
filemap_fault+0x1c2/0x33d
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x265/0x9c5
ub_slab_ptr+0x21/0x81
ub_slab_uncharge+0x36/0x41
sys_select+0xc1/0x183
__up_read+0x13/0x8a
system_call_after_swapgs+0x8a/0x8f

rsyslogd      S ffff81013f01d090     0 16449   9234
 ffff810103d9d9f8 0000000000000086 0000000000000000 0000000000000286
 ffff81013f01d090 ffff81013f57c7d0 ffff81013f01d318 0000000203d9da08
 0000000000000008 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
handle_mm_fault+0x421/0x9c5
__pollwait+0x0/0xe1
:jbd:journal_dirty_metadata+0xcc/0xe3
bit_waitqueue+0x10/0x97
do_page_fault+0x5c9/0x9ab
__up_read+0x13/0x8a
error_exit+0x0/0x60
getnstimeofday+0x39/0x98
zone_statistics+0x3a/0x8e
ktime_get_ts+0x22/0x4b
ktime_get+0xc/0x41
hrtick_start_fair+0xfb/0x144
getnstimeofday+0x39/0x98
Mar  6 16:09:43 magrathea kernel: [146690 do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
vsnprintf+0x568/0x5b1
charge_dcache+0x61/0xb9
__ub_dentry_charge+0x4b/0x15f
__d_lookup+0xd6/0x11e
mix_pool_bytes_extract+0x5c/0x155
extract_buf+0xa0/0x105
ptep_set_access_flags+0x33/0x3a
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x930/0x9c5
do_uncharge_dcache+0x3d/0x51
sys_select+0x15a/0x183
system_call_after_swapgs+0x8a/0x8f

exim4         S ffff81008f126050     0 17310   9348
 ffff81010011f9f8 0000000000000086 ffff8100b7926d90 ffff8101071a3bc0
 ffff81008f126050 ffff8100990de7d0 ffff81008f1262d8 00000002a013388b
 0000000096576c90 ffff81010a51de58 00000000a5c50a20 000000010000000a
Call Trace:
schedule_timeout+0x1e/0xad
add_wait_queue+0x15/0x46
tcp_poll+0x1b/0x1a2
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
vsnprintf+0x568/0x5b1
handle_mm_fault+0x930/0x9c5
__alloc_pages_internal+0x3f6/0x41a
zone_statistics+0x3a/0x8e
do_page_fault+0x5c9/0x9ab
snprintf+0x44/0x4c
core_sys_select+0x1c5/0x27e
ub_task_uncharge+0xbb/0x140
remove_wait_queue+0x12/0x45
do_wait+0x97c/0xa0c
sys_select+0xc1/0x183
system_call_after_swapgs+0x8a/0x8f

exim4         S ffff8100850d4090     0 17315   9082
 ffff81010fd559f8 0000000000000086 ffff8100390ead30 ffff810115cc3540
 ffff8100850d4090 ffff81006d2c4090 ffff8100850d4318 00000001a013388b
 0000000019c6c200 ffff810067b11930 00000000bc8b7dc8 000000010000000a
Call Trace:
schedule_timeout+0x1e/0xad
remove_wait_queue+0x12/0x45
add_wait_queue+0x15/0x46
tcp_poll+0x1b/0x1a2
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
vsnprintf+0x568/0x5b1
__alloc_pages_internal+0x3f6/0x41a
zone_statistics+0x3a/0x8e
snprintf+0x44/0x4c
core_sys_select+0x1c5/0x27e
ub_task_uncharge+0xbb/0x140
remove_wait_queue+0x12/0x45
do_wait+0x97c/0xa0c
sys_select+0xc1/0x183
 31d9ec2f0
 ffffe20004363400 ffff81010015c900 00007f635b85ea10 ffffffff80255cc1
Call Trace:
pb_free+0x18/0x21
schedule_timeout+0x1e/0xad
lock_sock_nested+0x9b/0xa6
_spin_lock_bh+0x9/0x1f
release_sock+0x13/0x96
inet_csk_accept+0xb3/0x22a
autoremove_wake_function+0x0/0x2e
inet_accept+0x25/0xb6
sys_accept+0xfc/0x1ce
do_page_fault+0x5c9/0x9ab
ep_ptable_queue_proc+0x0/0x7c
system_call_after_swapgs+0x8a/0x8f

apache2       S ffff8100b93d97d0     0 17815  17264
 ffff81004dd87d88 0000000000000082 ffff8101225df4a0 0000000000000286
 ffff8100b93d97d0 ffff81013f020810 ffff8100b93d9a58 00000003738622f0
 ffffe20004363400 ffff810082429880 00007f635b85ea10 ffffffff80255cc1
Call Trace:
pb_free+0x18/0x21
schedule_timeout+0x1e/0xad
lock_sock_nested+0x9b/0xa6
_spin_lock_bh+0x9/0x1f
release_sock+0x13/0x96
inet_csk_accept+0xb3/0x22a
autoremove_wake_function+0x0/0x2e
inet_accept+0x25/0xb6
sys_accept+0xfc/0x1ce
do_page_fault+0x5c9/0x9ab
ep_ptable_queue_proc+0x0/0x7c
system_call_after_swapgs+0x8a/0x8f

atd           S ffff810108e467d0     0 17819   9082
 ffff810071661e98 0000000000000086 0000000000000000 ffffffff80249f2c
 ffff810108e467d0 ffff81010913d090 ffff810108e46a58 00000002822154b8
 0000000000000286 ffffffff8024a6a2 ffffffff802acb7c ffffffffa014c709
Call Trace:
enqueue_hrtimer+0xd7/0xe4
hrtimer_start+0x112/0x134
filldir+0x0/0xb7
:ext3:__ext3_journal_stop+0x1f/0x3d
do_nanosleep+0x5c/0x9c
hrtimer_nanosleep+0x54/0xbd
hrtimer_wakeup+0x0/0x21
do_nanosleep+0x41/0x9c
sys_nanosleep+0x4c/0x62
system_call_after_swapgs+0x8a/0x8f

cron          S ffff810119403090     0 17873   9082
 ffff81008257be98 0000000000000082 0000000000000000 ffffffff80249f2c
 ffff810119403090 ffff81007e078810 ffff810119403318 00000000010144b8
 0000000000000286 ffffffff8024a6a2 0000000000000000 0000000000000296
Call Trace:
enqueue_hrtimer+0xd7/0xe4
hrtimer_start+0x112/0x134
do_nanosleep+0x5c/0x9c
hrtimer_nanosleep+0x54/0xbd
hrtimer_wakeup+0x0/0x21
do_nanosleep+0x41/0x9c
ser_8f
Mar  6 16:09:43 magrathea kernel: 965   a05 11100299cb9f8 0000000000000082 0000000000000000 0000000000000282
 ffff810022eba050 ffffffff804ef480 ffff810022eba2d8 00000000299cba08
 0000000000000008 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
handle_mm_fault+0x421/0x9c5
__pollwait+0x0/0xe1
:jbd:journal_dirty_metadata+0xcc/0xe3
bit_waitqueue+0x10/0x97
do_page_fault+0x5c9/0x9ab
getnstimeofday+0x39/0x98
ktime_get_ts+0x22/0x4b
ktime_get+0xc/0x41
hrtick_start_fair+0xfb/0x144
__next_cpu+0x19/0x26
nr_iowait_ve+0x4c/0x64
enqueue_task+0x56/0x61
check_preempt_wakeup+0xbd/0xe8
getnstimeofday+0x39/0x98
rb_insert_color+0x61/0xda
enqueue_hrtimer+0xd7/0xe4
hrtimer_start+0x112/0x134
core_sys_select+0x1c5/0x27e
sysret_signal+0x2b/0x45
do_notify_resume+0x819/0x82b
signal_wake_up+0x21/0x30
send_signal+0x1bf/0x1db
group_send_sig_info+0x76/0x83
kill_pid_info+0x35/0x47
sys_select+0x15a/0x183
sysret_signal+0x2b/0x45
system_call_after_swapgs+0x8a/0x8f

rsyslogd      S ffff810032ba0050     0 18883  11853
 ffff810073817c98 0000000000000082 0000000000000000 ffffffff80249f2c
 ffff810032ba0050 ffff81007f5b2810 ffff810032ba02d8 000000038221f4b8
 0000000000000286 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
enqueue_hrtimer+0xd7/0xe4
futex_wait+0x24c/0x394
hrtimer_wakeup+0x0/0x21
futex_wait+0x228/0x394
file_update_time+0x3b/0xf2
default_wake_function+0x0/0xe
do_futex+0x81/0x777
getnstimeofday+0x39/0x98
ktime_get_ts+0x22/0x4b
sys_futex+0xfe/0x11c
vfs_write+0x121/0x156
getnstimeofday+0x39/0x98
system_call_after_swapgs+0x8a/0x8f

rsyslogd      S ffff81002f006050     0 18884  11853
 ffff81007e5cb9f8 0000000000000082 0000000000000000 ffff81007e112700
 ffff81002f006050 ffff81007f5a9090 ffff81002f0062d8 000000018027ac8b
 ffffffff80281620 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
Mar  6 16:09:43 magrathea kernel: [1466901388b
Mar  6 16:09:43 magrathea kernel: <4000000242aa7b0 000000010000000a
Call Trace:
schedule_timeout+0x1e/0xad
add_wait_queue+0x15/0x46
tcp_poll+0x1b/0x1a2
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
vsnprintf+0x568/0x5b1
handle_mm_fault+0x930/0x9c5
__alloc_pages_internal+0x3f6/0x41a
zone_statistics+0x3a/0x8e
do_page_fault+0x5c9/0x9ab
snprintf+0x44/0x4c
core_sys_select+0x1c5/0x27e
ub_task_uncharge+0xbb/0x140
remove_wait_queue+0x12/0x45
do_wait+0x97c/0xa0c
sys_select+0xc1/0x183
system_call_after_swapgs+0x8a/0x8f

apache2       S ffff81009b2d7090     0 19070   9082
 ffff81004c5659f8 0000000000000082 0000000000000000 0000000000000286
 ffff81009b2d7090 ffff81007f5b2810 ffff81009b2d7318 000000034c565a08
 0000000000000000 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
:jbd:journal_stop+0x181/0x18d
:ext3:__ext3_journal_stop+0x1f/0x3d
:ext3:ext3_ordered_write_end+0xfa/0x110
generic_file_buffered_write+0x206/0x61b
zone_statistics+0x3a/0x8e
__alloc_pages_internal+0x3f6/0x41a
inc_held_pages+0x4e/0x62
pb_add_ref+0x72/0x81
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x930/0x9c5
check_preempt_wakeup+0xbd/0xe8
remove_wait_queue+0x12/0x45
do_wait+0x97c/0xa0c
sys_select+0x15a/0x183
system_call_after_swapgs+0x8a/0x8f

apache2       S ffff8100b0115810     0 19120  19070
 ffff8100585cfd58 0000000000000086 ffff8101258d6000 ffffffff8027594a
 ffff8100b0115810 ffff810119d74050 ffff8100b0115a98 0000000280277799
 ffff810110cb2760 000000000006ede4 ffff81007e99eac0 0000000000000286
Call Trace:
find_lock_page+0x1f/0x8a
schedule_timeout+0x1e/0xad
prepare_to_wait_exclusive+0x15/0x5e
__skb_recv_datagram+0x186/0x219
autoremove_wake_function+0x0/0x2e
__ub_dentry_alloc+0x8d/0xb9
skb_recv_datagram+0x1c/0x21
unix_accept+0x54/0xe4
get_page_from_freelist+0x416/0x587
__rmqueue+0x1c/0x1b2
getnstimeofday+0x39/0x98
rb_insert_color+0x61/0xda
enqueuehrt
Mar  6 16:09:43 magrathea kernel: <453]_start+0x112/0x134
core_sys_select+0x1c5/0x27e
sysret_signal+0x2b/0x45
do_notify_resume+0x819/0x82b
signal_wake_up+0x21/0x30
send_signal+0x1bf/0x1db
group_send_sig_info+0x76/0x83
hrtimer_start+0x112/0x134
kill_pid_info+0x35/0x47
sys_select+0x15a/0x183
sysret_signal+0x2b/0x45
system_call_after_swapgs+0x8a/0x8f

rsyslogd      S ffff8100b0e26050     0 19392  11861
 ffff81008245b9f8 0000000000000086 0000000000000000 ffffffff8042393f
 ffff8100b0e26050 ffff81013f57c7d0 ffff8100b0e262d8 000000020000001e
 0000000000000000 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
_read_lock_bh+0x9/0x19
schedule_timeout+0x1e/0xad
add_wait_queue+0x15/0x46
unix_peer_get+0x10/0x28
unix_dgram_poll+0xd6/0x151
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
enqueue_hrtimer+0xd7/0xe4
ub_slab_ptr+0x21/0x81
ub_slab_uncharge+0x36/0x41
skb_free_datagram+0xc/0x31
unix_dgram_recvmsg+0x1f3/0x20e
enqueue_entity+0x68/0x8a
enqueue_task+0x56/0x61
activate_task+0x82/0xc6
apic_wait_icr_idle+0xe/0x15
core_sys_select+0x1c5/0x27e
wake_futex+0x1f/0x29
do_futex+0x33c/0x777
sockfd_lookup_light+0x1a/0x52
sys_recvfrom+0xff/0x119
sys_select+0xc1/0x183
do_gettimeofday+0x10/0x32
system_call_after_swapgs+0x8a/0x8f

rsyslogd      S ffff8100bfc287d0     0 19393  11861
 ffff810082415e28 0000000000000086 0000000000000000 00000000000385a1
 ffff8100bfc287d0 ffff8100a90127d0 ffff8100bfc28a58 0000000380252e9c
 ffff810000000000 ffff8100a9408380 ffffe200027b6840 ffff8100a41ca900
Call Trace:
do_syslog+0x15c/0x542
autoremove_wake_function+0x0/0x2e
kmsg_read+0x3a/0x44
proc_reg_read+0x73/0x8e
vfs_read+0xaa/0x152
recalc_sigpending+0xe/0x38
sys_read+0x49/0xc2
schedule_timeout+0x85/0xad
do_select+0x401/0x464
dnct>[1  [<ffnct>[1  [2a7xe
__alloc_pages_internal+0x3f6/0x41a
zone_statistics+0x3a/0x8e
ub_slab_ptr+0x21/0x81
snprintf+0x44/0x4c
core_sys_select+0x1c5/0x27e
ub_task_uncharge+0xbb/0x140
remove_wait_queue+0x12/0x45
do_wait+0x97c/0xa0c
sys_select+0x15a/0x183
system_call_after_swapgs+0x8a/0x8f

rsyslogd      S ffff81006d2c4090     0 19932  11555
 ffff81005177b9f8 0000000000000082 0000000000000000 0000000000000286
 ffff81006d2c4090 ffff81007f5a9090 ffff81006d2c4318 000000015177ba08
 0000000000000008 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
handle_mm_fault+0x421/0x9c5
__pollwait+0x0/0xe1
:jbd:journal_dirty_metadata+0xcc/0xe3
bit_waitqueue+0x10/0x97
do_page_fault+0x5c9/0x9ab
__up_read+0x13/0x8a
error_exit+0x0/0x60
getnstimeofday+0x39/0x98
zone_statistics+0x3a/0x8e
ktime_get_ts+0x22/0x4b
ktime_get+0xc/0x41
hrtick_start_fair+0xfb/0x144
getnstimeofday+0x39/0x98
ktime_get_ts+0x22/0x4b
update_curr+0x44/0x6f
ktime_get+0xc/0x41
hrtick_start_fair+0xfb/0x144
apic_wait_icr_idle+0xe/0x15
__next_cpu+0x19/0x26
core_sys_select+0x1c5/0x27e
apic_wait_icr_idle+0xe/0x15
signal_wake_up+0x21/0x30
send_signal+0x1bf/0x1db
group_send_sig_info+0x76/0x83
kill_pid_info+0x35/0x47
sys_select+0x15a/0x183
system_call_after_swapgs+0x8a/0x8f

rsyslogd      S ffff81007124d810     0 19934  11555
 ffff8100260f7c98 0000000000000082 0000000000000000 ffffffff80249f2c
 ffff81007124d810 ffff81007f5b2810 ffff81007124da98 000000038221f4b8
 0000000000000286 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
enqueue_hrtimer+0xd7/0xe4
futex_wait+0x24c/0x394
hrtimer_wakeup+0x0/0x21
futex_wait+0x228/0x394
file_update_time+0x3b/0xf2
Mar  6 16:09:43 magrathea kernel: <52e9c
 ffff810000000000 ffff810054286368 ffffe20001a8c680 ffffffff8024c72e
Call Trace:
getnstimeofday+0x39/0x98
do_syslog+0x15c/0x542
autoremove_wake_function+0x0/0x2e
__next_cpu+0x19/0x26
apic_wait_icr_idle+0xe/0x15
proc_reg_read+0x73/0x8e
vfs_read+0xaa/0x152
sys_read+0x49/0xc2
system_call_after_swapgs+0x8a/0x8f

mysqld_safe   S ffff810078801050     0 20826  15634
 ffff810029a4be88 0000000000000086 80000000507df065 ffff810001022020
 ffff810078801050 ffff81006e5f9050 ffff8100788012d8 0000000100000678
 ffff81004dd37020 ffff81000101e4b8 ffff81000101e4b8 ffff810001022020
Call Trace:
do_wait+0x93e/0xa0c
default_wake_function+0x0/0xe
sys_rt_sigaction+0x70/0x8c
sys_wait4+0x8a/0xa1
system_call_after_swapgs+0x8a/0x8f

munin-node    S ffff81011e91d050     0 20875   9348
 ffff81000b6219f8 0000000000000086 0000000000000000 0000000000000286
 ffff81011e91d050 ffff81013f57c7d0 ffff81011e91d2d8 000000020b621a08
 ffff8100ac09f1c0 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
vsnprintf+0x568/0x5b1
charge_dcache+0x61/0xb9
__ub_dentry_charge+0x4b/0x15f
__d_lookup+0xd6/0x11e
mix_pool_bytes_extract+0x5c/0x155
extract_buf+0xa0/0x105
ptep_set_access_flags+0x33/0x3a
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x930/0x9c5
do_uncharge_dcache+0x3d/0x51
sys_select+0x15a/0x183
system_call_after_swapgs+0x8a/0x8f

mysqld        S ffff81007e0b2050     0 20968  20826
 ffff81004892b9f8 0000000000000086 0000000000000000 ffffffff8027978e
 ffff81007e0b2050 ffff81009088e7d0 ffff81007e0b22d8 000000014892bac8
 0000000000000000 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
rmqueue_bulk+0x41/0x86
unix_poll+0x0/0xca
schedule_timeout+0x1e/0xad
remove_wait_queue+0x12/0x45
unix_poll+0x55/0xca
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
 [<ffffffff80ut_no_expire+0x20/0x10e_close+0x5d/0x65
system_call_after_swapgs+0x8a/0x8f

logger        S ffff810032ba07d0     0 20969  20826
 ffff81004660dcf8 0000000000000082 000000000000016c ffff810000000000
 ffff810032ba07d0 ffff81010913d810 ffff810032ba0a58 000000034660de48
 0000000000000000 ffff810107df5640 0000000000004000 00000000024782c0
Call Trace:
pipe_wait+0x66/0x8d
autoremove_wake_function+0x0/0x2e
pipe_read+0x31c/0x395
do_uncharge_dcache+0x3d/0x51
do_sync_read+0xc9/0x10c
autoremove_wake_function+0x0/0x2e
vfs_read+0xaa/0x152
sys_read+0x49/0xc2
system_call_after_swapgs+0x8a/0x8f

apache2       S ffff81008ecf37d0     0 21042   9234
 ffff81007c1b19f8 0000000000000086 0000000000000000 0000000000000286
 ffff81008ecf37d0 ffff81007f5b2810 ffff81008ecf3a58 000000037c1b1a08
 0000000000000000 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
:jbd:journal_stop+0x181/0x18d
:ext3:__ext3_journal_stop+0x1f/0x3d
:ext3:ext3_ordered_write_end+0xfa/0x110
generic_file_buffered_write+0x206/0x61b
zone_statistics+0x3a/0x8e
__alloc_pages_internal+0x3f6/0x41a
inc_held_pages+0x4e/0x62
pb_add_ref+0x72/0x81
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x930/0x9c5
check_preempt_wakeup+0xbd/0xe8
remove_wait_queue+0x12/0x45
do_wait+0x97c/0xa0c
sys_select+0x15a/0x183
system_call_after_swapgs+0x8a/0x8f

apache2       S ffff81008ecf3050     0 21046  21042
 ffff810103cdfd58 0000000000000082 ffff81007e17b000 ffffffff8027594a
 ffff81008ecf3050 ffff81005a0ab7d0 ffff81008ecf32d8 0000000080277799
 ffff8100bfc1f3f0 0000000000042d47 ffff810127014040 0000000000000286
Call Trace:
find_lock_page+0x1f/0x8a
schedule_timeout+0x1e/0xad
prepare_to_wait_exclusive+0x15/0x5e
__skb_recv_datagram+0x186/0x219
autoremove_wake_function+0x0/0x2e
__ub_dentry_alloc+0x8d/0xb9
skb_recv_datagram+0x1c/0x21
unix_accept+0x54/0xe4
sys_accept+0xfc/0x1ce
switch_uid+0x64/0x76
system_call_after_swapgs+0x8a/0x8f
getnstimeofday+0x39/0x98
zone_statistics+0x3a/0x8e
ktime_get_ts+0x22/0x4b
ktime_get+0xc/0x41
hrtick_start_fair+0xfb/0x144
getnstimeofday+0x39/0x98
ktime_get_ts+0x22/0x4b
enqueue_hrtimer+0xd7/0xe4
hrtimer_start+0x112/0x134
core_sys_select+0x1c5/0x27e
sysret_signal+0x2b/0x45
do_notify_resume+0x819/0x82b
signal_wake_up+0x21/0x30
send_signal+0x1bf/0x1db
group_send_sig_info+0x76/0x83
kill_pid_info+0x35/0x47
sys_select+0x15a/0x183
sysret_signal+0x2b/0x45
system_call_after_swapgs+0x8a/0x8f

rsyslogd      S ffff81003f46d810     0 21144  13144
 ffff81002f8499f8 0000000000000086 ffff81009718e3a0 ffffffff802c149f
 ffff81003f46d810 ffff810011038810 ffff81003f46da98 000000008fdf7dc8
 ffffffff80281620 00000000001280d2 ffff81007f5a6bc0 ffffffff8027ac8b
Call Trace:
__find_get_block+0x174/0x184
zone_statistics+0x3a/0x8e
get_page_from_freelist+0x416/0x587
schedule_timeout+0x1e/0xad
add_wait_queue+0x15/0x46
unix_peer_get+0x10/0x28
unix_dgram_poll+0xd6/0x151
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
ub_slab_ptr+0x21/0x81
ub_slab_uncharge+0x36/0x41
skb_free_datagram+0xc/0x31
unix_dgram_recvmsg+0x1f3/0x20e
getnstimeofday+0x39/0x98
ktime_get_ts+0x22/0x4b
ktime_get+0xc/0x41
hrtick_start_fair+0xfb/0x144
__next_cpu+0x19/0x26
nr_iowait_ve+0x4c/0x64
enqueue_hrtimer+0xd7/0xe4
core_sys_select+0x1c5/0x27e
sysret_signal+0x2b/0x45
do_notify_resume+0x819/0x82b
wake_futex+0x1f/0x29
do_futex+0x33c/0x777
sockfd_lookup_light+0x1a/0x52
sys_recvfrom+0xff/0x119
sys_select+0xc1/0x183
sysret_signal+0x2b/0x45
system_call_after_swapgs+0x8a/0x8f

rsyslogd      S ffff81005a070090     0 21145  13144
 ffff8100713d7e28 0000000000000086 0000000000000000 00000000000432b7
 ffff81005a070090 ffff810011038810 ffff81005a070318 0000000080252e9c
 ffff810000000000 ffff81004b94a640 ffffe20000a4adc0 ffff8_ule_timeout+0x1e/0xad
prepare_to_wait_exclusive+0x15/0x5e
__skb_recv_datagram+0x186/0x219
autoremove_wake_function+0x0/0x2e
__ub_dentry_alloc+0x8d/0xb9
skb_recv_datagram+0x1c/0x21
unix_accept+0x54/0xe4
sys_accept+0xfc/0x1ce
switch_uid+0x64/0x76
system_call_after_swapgs+0x8a/0x8f

munin-node    S ffff8100575c3090     0 21338   9087
 ffff81002d02f9f8 0000000000000086 0000000000000000 0000000000000286
 ffff8100575c3090 ffff81013f57c7d0 ffff8100575c3318 000000022d02fa08
 ffff8100921e8ac0 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
zone_statistics+0x3a/0x8e
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
vsnprintf+0x568/0x5b1
charge_dcache+0x61/0xb9
__ub_dentry_charge+0x4b/0x15f
__d_lookup+0xd6/0x11e
mix_pool_bytes_extract+0x5c/0x155
extract_buf+0xa0/0x105
ptep_set_access_flags+0x33/0x3a
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x930/0x9c5
do_uncharge_dcache+0x3d/0x51
sys_select+0x15a/0x183
system_call_after_swapgs+0x8a/0x8f

apache2       S ffff810078cc37d0     0 21354  21328
 ffff81000e1d3d88 0000000000000082 ffff81002980a6b0 0000000000000286
 ffff810078cc37d0 ffff81002f0067d0 ffff810078cc3a58 0000000127d12b28
 ffffe20004363400 ffff81000342a480 00007ffe75965a10 ffffffff80255cc1
Call Trace:
pb_free+0x18/0x21
schedule_timeout+0x1e/0xad
lock_sock_nested+0x9b/0xa6
_spin_lock_bh+0x9/0x1f
release_sock+0x13/0x96
inet_csk_accept+0xb3/0x22a
autoremove_wake_function+0x0/0x2e
inet_accept+0x25/0xb6
sys_accept+0xfc/0x1ce
do_page_fault+0x5c9/0x9ab
ep_ptable_queue_proc+0x0/0x7c
system_call_after_swapgs+0x8a/0x8f

apache2       S ffff81007e4b7090     0 21361  21328
 ffff810069ad1d88 0000000000000086 ffff810079c62970 0000000000000286
 ffff81007e4b7090 ffff81006be7c090 ffff81007e4b7318 000000031488cb28
 ffffe20004363400 ffff8100735635c0 00007ffe75965a10 ffffffff80255cc1
Call Trace:
pb_free+0x18/0x21
schedule_timeout+0x1e/0xad
ep_ptable_queue_proc+0x0/0x7c
system_call_after_swapgs+0x8a/0x8f

apache2       S ffff81013f6fb090     0 21805  21724
 ffff81001de0fd88 0000000000000082 ffff81008bd83340 0000000000000286
 ffff81013f6fb090 ffff810075ff07d0 ffff81013f6fb318 000000032d104500
 ffffe20004363400 ffff81013dc7e440 00007f46cd8a0a10 ffffffff80255cc1
Call Trace:
pb_free+0x18/0x21
schedule_timeout+0x1e/0xad
lock_sock_nested+0x9b/0xa6
_spin_lock_bh+0x9/0x1f
release_sock+0x13/0x96
inet_csk_accept+0xb3/0x22a
autoremove_wake_function+0x0/0x2e
inet_accept+0x25/0xb6
sys_accept+0xfc/0x1ce
do_page_fault+0x5c9/0x9ab
ep_ptable_queue_proc+0x0/0x7c
system_call_after_swapgs+0x8a/0x8f

apache2       S ffff8100adc7f7d0     0 21815  21724
 ffff810052563d88 0000000000000082 ffff81008d9d53f0 0000000000000286
 ffff8100adc7f7d0 ffff810075ff07d0 ffff8100adc7fa58 000000030d632500
 ffffe20004363400 ffff81013242c880 00007f46cd8a0a10 ffffffff80255cc1
Call Trace:
pb_free+0x18/0x21
schedule_timeout+0x1e/0xad
lock_sock_nested+0x9b/0xa6
_spin_lock_bh+0x9/0x1f
release_sock+0x13/0x96
inet_csk_accept+0xb3/0x22a
autoremove_wake_function+0x0/0x2e
inet_accept+0x25/0xb6
sys_accept+0xfc/0x1ce
do_page_fault+0x5c9/0x9ab
ep_ptable_queue_proc+0x0/0x7c
system_call_after_swapgs+0x8a/0x8f

rsyslogd      S ffff810031adc090     0 21936  14467
 ffff81005679d9f8 0000000000000086 0000000000000000 0000000000000282
 ffff810031adc090 ffff810012d7c810 ffff810031adc318 000000005679da08
 0000000000000008 0000000114a9fa05 0000000000000282 ffffffff8023e13b
Call Trace:
__mod_timer+0xbd/0xcc
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
handle_mm_fault+0x421/0x9c5
__pollwait+0x0/0xe1
:jbd:journal_dirty_metadata+0xcc/0xe3
bit_waitqueue+0x10/0x97
do_page_fault+0x5c9/0x9ab
__up_read+0x13/0x8a
error_exit+0x0/0x60
zone_statistics+0x3a/0x8e
__rmqueue+0xe1/0x1b2
getnstimeofday+0x39/0x98
ktime_get_ts+0x22/0x4b
ktime_get+0xc/0x41
futex_wait+0x228/0x394
file_update_time+0xb2/0xf2
default_wake_function+0x0/0xe
do_futex+0x81/0x777
getnstimeofday+0x39/0x98
sys_futex+0xfe/0x11c
vfs_write+0x121/0x156
getnstimeofday+0x39/0x98
system_call_after_swapgs+0x8a/0x8f

rsyslogd      S ffff81002cd1c090     0 22470  16176
 ffff81001d6299f8 0000000000000082 ffffe20001c06c28 0000000000000000
 ffff81002cd1c090 ffff81001ebae090 ffff81002cd1c318 000000038027967c
 ffffffff80281620 ffffffff80566d30 ffff81013f5e44c0 ffffffff8027ac8b
Call Trace:
zone_statistics+0x3a/0x8e
get_page_from_freelist+0x416/0x587
schedule_timeout+0x1e/0xad
add_wait_queue+0x15/0x46
unix_peer_get+0x10/0x28
unix_dgram_poll+0xd6/0x151
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
ub_slab_ptr+0x21/0x81
ub_slab_uncharge+0x36/0x41
skb_free_datagram+0xc/0x31
unix_dgram_recvmsg+0x1f3/0x20e
getnstimeofday+0x39/0x98
ktime_get_ts+0x22/0x4b
ktime_get+0xc/0x41
hrtick_start_fair+0xfb/0x144
rb_insert_color+0x61/0xda
enqueue_hrtimer+0xd7/0xe4
core_sys_select+0x1c5/0x27e
sysret_signal+0x2b/0x45
do_notify_resume+0x819/0x82b
wake_futex+0x1f/0x29
do_futex+0x33c/0x777
sockfd_lookup_light+0x1a/0x52
sys_recvfrom+0xff/0x119
sys_select+0xc1/0x183
sysret_signal+0x2b/0x45
system_call_after_swapgs+0x8a/0x8f

rsyslogd      S ffff810074e01810     0 22471  16176
 ffff810039297e28 0000000000000082 0000000000000000 000000000005be14
 ffff810074e01810 ffff810014b25090 ffff810074e01a98 0000000180252e9c
 ffff810000000000 ffff8100485284d8 ffffe20000f78500 ffff8100035ec580
Call Trace:
do_syslog+0x15c/0x542
autoremove_wake_function+0x0/0x2e
kmsg_read+0x3a/0x44
proc_reg_read+0x73/0x8e
vfs_read+0xaa/0x152
recalc_sigpending+0xe/0x38
sys_read+0x49/0xc2
system_call_after_swapgs+0x8a/0x8f

sshd          S ffff81007e06b050     0 22561  16176
 ffff810071e5b9f8 0000000000000086 ffff81010bc15e50 ffff81013fb0d268
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
_nte1a
 _page+0x1f/0x8a
filemap_fault+0x1c2/0x33d
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x265/0x9c5
hrtick_start_fair+0xfb/0x144
__up_read+0x13/0x8a
error_exit+0x0/0x60
sys_select+0x15a/0x183
__up_read+0x13/0x8a
system_call_after_swapgs+0x8a/0x8f

cron          S ffff810054ca87d0     0 23924  11440
 ffff810036999e98 0000000000000082 0000000000000000 ffffffff80249f2c
 ffff810054ca87d0 ffff81004ad5e090 ffff810054ca8a58 00000000010144b8
 0000000000000286 ffffffff8024a6a2 0000000000000000 0000000000000296
Call Trace:
enqueue_hrtimer+0xd7/0xe4
hrtimer_start+0x112/0x134
do_nanosleep+0x5c/0x9c
hrtimer_nanosleep+0x54/0xbd
hrtimer_wakeup+0x0/0x21
do_nanosleep+0x41/0x9c
sys_nanosleep+0x4c/0x62
system_call_after_swapgs+0x8a/0x8f

apache2       S ffff810012d7c810     0 24069  11853
 ffff8100276159f8 0000000000000086 0000000000000000 0000000000000282
 ffff810012d7c810 ffffffff804ef480 ffff810012d7ca98 0000000027615a08
 0000000000000000 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
:jbd:journal_stop+0x181/0x18d
:ext3:__ext3_journal_stop+0x1f/0x3d
:ext3:ext3_ordered_write_end+0xfa/0x110
generic_file_buffered_write+0x206/0x61b
zone_statistics+0x3a/0x8e
__alloc_pages_internal+0x3f6/0x41a
inc_held_pages+0x4e/0x62
pb_add_ref+0x72/0x81
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x930/0x9c5
remove_wait_queue+0x12/0x45
do_wait+0x97c/0xa0c
sys_select+0x15a/0x183
system_call_after_swapgs+0x8a/0x8f

courierlogger S ffff81010fdc3810     0 24094  13144
 ffff810028d2bcf8 0000000000000082 0000000000000000 0000000000000001
 ffff81010fdc3810 ffff81011d1e5050 ffff81010fdc3a98 0000000200000282
 ffff81010a51de58 ffff81010a51de58 0000000000000000 ffff81007cd250c0
Call Trace:
pipe_wait+0x66/0x8d
autoremove_wake_function+0x0/0x2e
pipe_read+0x31c/0x395
Mar  6 16:09:43 magrathea kernel: [146690>[14690fff sc+0x8a/fffoce/0x739656_tid
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
vsnprintf+0x568/0x5b1
charge_dcache+0x61/0xb9
__ub_dentry_charge+0x4b/0x15f
__d_lookup+0xd6/0x11e
mix_pool_bytes_extract+0x5c/0x155
extract_buf+0xa0/0x105
ptep_set_access_flags+0x33/0x3a
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x930/0x9c5
do_uncharge_dcache+0x3d/0x51
sys_select+0x15a/0x183
system_call_after_swapgs+0x8a/0x8f

exim4         S ffff8100850d4810     0 24717  13189
 ffff8100371359f8 0000000000000086 ffff81012f492cd0 ffff81007d1a74d8
 ffff8100850d4810 ffff81012f1ef7d0 ffff8100850d4a98 00000003a013388b
 00000000bf1857b0 ffff81010a51dc48 ffff81008f1b84d8 ffff8101045956e0
Call Trace:
schedule_timeout+0x1e/0xad
remove_wait_queue+0x12/0x45
add_wait_queue+0x15/0x46
tcp_poll+0x1b/0x1a2
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
vsnprintf+0x568/0x5b1
ub_kmemsize_charge+0x4e/0x86
__alloc_pages_internal+0x3f6/0x41a
zone_statistics+0x3a/0x8e
snprintf+0x44/0x4c
core_sys_select+0x1c5/0x27e
ub_task_uncharge+0xbb/0x140
remove_wait_queue+0x12/0x45
do_wait+0x97c/0xa0c
sys_select+0xc1/0x183
system_call_after_swapgs+0x8a/0x8f

exim4         S ffff8100716d9090     0 24757  15634
 ffff810014bed9f8 0000000000000082 ffff8100b718c490 ffff81008a9ef268
 ffff8100716d9090 ffff81009088e7d0 ffff8100716d9318 00000000a013388b
 000000003fad50c8 ffff810067b11c00 ffff810108418338 ffff81008a83ca88
Call Trace:
schedule_timeout+0x1e/0xad
add_wait_queue+0x15/0x46
tcp_poll+0x1b/0x1a2
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
vsnprintf+0x568/0x5b1
handle_mm_fault+0x930/0x9c5
__alloc_pages_internal+0x3f6/0x41a
do_page_fault+0x5c9/0x9ab
snprintf+0x44/0x4c
core_sys_select+0x1c5/0x27e
ub_task_uncharge+0xbb/0x140
remove_wait_queue+0x12/0x45
do_wait+0x97c/0xa0c
sys_select+0xc1/0x183
Mar  6 16:09:43 magrathea kernel: [146690 ffffffff80255cc1
Call Trace:
pb_free+0x18/0x21
schedule_timeout+0x1e/0xad
lock_sock_nested+0x9b/0xa6
_spin_lock_bh+0x9/0x1f
release_sock+0x13/0x96
inet_csk_accept+0xb3/0x22a
autoremove_wake_function+0x0/0x2e
inet_accept+0x25/0xb6
sys_accept+0xfc/0x1ce
do_page_fault+0x5c9/0x9ab
ep_ptable_queue_proc+0x0/0x7c
system_call_after_swapgs+0x8a/0x8f

atd           S ffff8101214eb810     0 24912  13189
 ffff810049025e98 0000000000000082 0000000000000000 ffffffff80249f2c
 ffff8101214eb810 ffff81010c566810 ffff8101214eba98 000000038221f4b8
 0000000000000286 ffffffff8024a6a2 ffffffff802acb7c ffffffffa014c709
Call Trace:
enqueue_hrtimer+0xd7/0xe4
hrtimer_start+0x112/0x134
filldir+0x0/0xb7
:ext3:__ext3_journal_stop+0x1f/0x3d
do_nanosleep+0x5c/0x9c
hrtimer_nanosleep+0x54/0xbd
hrtimer_wakeup+0x0/0x21
do_nanosleep+0x41/0x9c
sys_nanosleep+0x4c/0x62
system_call_after_swapgs+0x8a/0x8f

rsyslogd      S ffff8100843e6050     0 24916  15484
 ffff8100034239f8 0000000000000086 0000000000000000 0000000000000286
 ffff8100843e6050 ffff81013f676050 ffff8100843e62d8 0000000303423a08
 0000000000000008 0000000114a9fc4a 0000000000000286 ffffffff8023e13b
Call Trace:
__mod_timer+0xbd/0xcc
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
handle_mm_fault+0x421/0x9c5
__pollwait+0x0/0xe1
:jbd:journal_dirty_metadata+0xcc/0xe3
bit_waitqueue+0x10/0x97
do_page_fault+0x5c9/0x9ab
__up_read+0x13/0x8a
error_exit+0x0/0x60
getnstimeofday+0x39/0x98
zone_statistics+0x3a/0x8e
ktime_get_ts+0x22/0x4b
ktime_get+0xc/0x41
hrtick_start_fair+0xfb/0x144
getnstimeofday+0x39/0x98
ktime_get_ts+0x22/0x4b
enqueue_hrtimer+0xd7/0xe4
hrtimer_start+0x112/0x134
core_sys_select+0x1c5/0x27e
sysret_signal+0x2b/0x45
do_notify_resume+0x819/0x82b
signal_wake_up+0x21/0x30
send_signal+0x1bf/0x1db
system_call_after_swapgs+0x8a/0x8f

sshd          S ffff810079d1c090     0 24947  14780
 ffff81007643f9f8 0000000000000086 ffff810130054310 ffff81013fad79b8
 ffff810079d1c090 ffff81004ad5e810 ffff810079d1c318 00000001a013388b
 0000000080281620 ffff810067b11c60 000000007f5a6bc0 000000010000000b
Call Trace:
schedule_timeout+0x1e/0xad
add_wait_queue+0x15/0x46
tcp_poll+0x1b/0x1a2
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
default_wake_function+0x0/0xe
generic_file_buffered_write+0x206/0x61b
:ext3:__ext3_journal_dirty_metadata+0x1e/0x46
current_fs_time+0x1e/0x24
remove_suid+0x18/0x4b
dec_held_pages+0x4e/0x62
find_lock_page+0x1f/0x8a
filemap_fault+0x1c2/0x33d
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x265/0x9c5
ub_slab_ptr+0x21/0x81
ub_slab_uncharge+0x36/0x41
sys_select+0xc1/0x183
__up_read+0x13/0x8a
system_call_after_swapgs+0x8a/0x8f

exim4         S ffff8100bc0587d0     0 24970  14467
 ffff8100034339f8 0000000000000086 ffff8101300541f0 ffff81012119bcf8
 ffff8100bc0587d0 ffff810121456050 ffff8100bc058a58 00000003a013388b
 0000000000000000 ffff81010a51dc48 0000000000002000 0000000000000002
Call Trace:
schedule_timeout+0x1e/0xad
add_wait_queue+0x15/0x46
tcp_poll+0x1b/0x1a2
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
vsnprintf+0x568/0x5b1
handle_mm_fault+0x930/0x9c5
__alloc_pages_internal+0x3f6/0x41a
zone_statistics+0x3a/0x8e
__wake_up_common+0x41/0x74
snprintf+0x44/0x4c
core_sys_select+0x1c5/0x27e
ub_task_uncharge+0xbb/0x140
remove_wait_queue+0x12/0x45
do_wait+0x97c/0xa0c
sys_select+0xc1/0x183
system_call_after_swapgs+0x8a/0x8f

memcached     S ffff8100badbe7d0     0 25005  14467
 ffff810003325e78 0000000000000086 0000000000000000 0000000000000286
 ffff8100badbe7d0 ffff81013f57c7d0 ffff8100badbea58 0000000203325e88
 00000000000003e8 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
file_update_time+0x3b/0xf2
default_wake_function+0x0/0xe
do_futex+0x81/0x777
getnstimeofday+0x39/0x98
ktime_get_ts+0x22/0x4b
sys_futex+0xfe/0x11c
vfs_write+0x121/0x156
getnstimeofday+0x39/0x98
system_call_after_swapgs+0x8a/0x8f

rsyslogd      S ffff81006e441810     0 25166  13253
 ffff8100035239f8 0000000000000086 00000000001200d2 ffff8100579da048
 ffff81006e441810 ffff81002988b090 ffff81006e441a98 000000008027b3a1
 ffffffff80281620 ffffffff80566d30 ffff81013f5e44c0 ffffffff8027ac8b
Call Trace:
zone_statistics+0x3a/0x8e
get_page_from_freelist+0x416/0x587
schedule_timeout+0x1e/0xad
add_wait_queue+0x15/0x46
unix_peer_get+0x10/0x28
unix_dgram_poll+0xd6/0x151
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
ub_slab_ptr+0x21/0x81
__skb_recv_datagram+0x1f2/0x219
ub_skb_uncharge+0x246/0x2bd
skb_free_datagram+0xc/0x31
unix_dgram_recvmsg+0x1f3/0x20e
getnstimeofday+0x39/0x98
ktime_get_ts+0x22/0x4b
ktime_get+0xc/0x41
hrtick_start_fair+0xfb/0x144
apic_wait_icr_idle+0xe/0x15
enqueue_task+0x56/0x61
check_preempt_wakeup+0xbd/0xe8
core_sys_select+0x1c5/0x27e
wake_futex+0x1f/0x29
do_futex+0x33c/0x777
sockfd_lookup_light+0x1a/0x52
sys_recvfrom+0xff/0x119
sys_select+0xc1/0x183
do_gettimeofday+0x10/0x32
system_call_after_swapgs+0x8a/0x8f

rsyslogd      S ffff8100579c97d0     0 25167  13253
 ffff8100262b9e28 0000000000000086 0000000000000000 000000000002fc37
 ffff8100579c97d0 ffff810014b25810 ffff8100579c9a58 0000000080252e9c
 ffff810000000000 ffff810052d642f8 ffffe200004a0dc0 ffff81007ec50900
Call Trace:
do_syslog+0x15c/0x542
autoremove_wake_function+0x0/0x2e
kmsg_read+0x3a/0x44
proc_reg_read+0x73/0x8e
vfs_read+0xaa/0x152
recalc_sigpending+0xe/0x38
sys_read+0x49/0xc2
system_call_after_swapgs+0x8a/0x8f

cron          S ffff8100379a0810     0 25256  13144
 ffff8100033d3e98 0000000000000082 0000000000000000 ffffffff80249f2c
Mar  6 16:09:43 magrathea kernel: [14669000000000082 0000000000000000 0000000000000286
 ffff81013f676050 ffff81007f5b2810 ffff81013f6762d8 000000030357ba08
 0000000000000000 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
handle_mm_fault+0x421/0x9c5
__pollwait+0x0/0xe1
find_lock_page+0x1f/0x8a
shmem_getpage+0xbf/0x6dd
do_page_fault+0x5c9/0x9ab
zone_statistics+0x3a/0x8e
find_lock_page+0x1f/0x8a
filemap_fault+0x1c2/0x33d
pb_free+0x18/0x21
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x265/0x9c5
ub_slab_ptr+0x21/0x81
ub_slab_uncharge+0x36/0x41
sys_select+0x15a/0x183
system_call_after_swapgs+0x8a/0x8f

postgres      S ffff810119403810     0 25345  19822
 ffff8100457919f8 0000000000000082 0000000000000000 0000000000000286
 ffff810119403810 ffff81013f57c7d0 ffff810119403a98 0000000245791a08
 0000000000000000 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
handle_mm_fault+0x421/0x9c5
__pollwait+0x0/0xe1
:jbd:do_get_write_access+0x36a/0x3b0
:jbd:__journal_file_buffer+0xb5/0x154
:jbd:journal_dirty_metadata+0xcc/0xe3
:ext3:__ext3_journal_dirty_metadata+0x1e/0x46
:jbd:journal_stop+0x181/0x18d
:ext3:__ext3_journal_stop+0x1f/0x3d
current_fs_time+0x1e/0x24
__mark_inode_dirty+0x29/0x179
ub_slab_ptr+0x21/0x81
ub_slab_uncharge+0x36/0x41
__dequeue_signal+0x11a/0x17b
core_sys_select+0x1c5/0x27e
recalc_sigpending+0xe/0x38
do_notify_resume+0x747/0x82b
sys_select+0x15a/0x183
system_call_after_swapgs+0x8a/0x8f

postgres      S ffff8100bc106090     0 25347  19822
 ffff810003247b18 0000000000000082 ffff81004cf55bb0 0000000000000286
 ffff8100bc106090 ffff81007f5b9810 ffff8100bc106318 0000000303247b28
 ffff810003247e1c 0000000114a9e7c1 0000000000000286 ffffffff8023e13b
Call Trace:
__mod_timer+0xbd/0xcc
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
ep_ptable_queue_proc+0x0/0x7c
system_call_after_swapgs+0x8a/0x8f

apache2       S ffff81007e1627d0     0 25652  25559
 ffff810003533d88 0000000000000082 ffff810056ddd290 0000000000000286
 ffff81007e1627d0 ffff8100299c27d0 ffff81007e162a58 00000000404e91c8
 ffffe20004363400 ffff810003477780 00007f9800839a10 ffffffff80255cc1
Call Trace:
pb_free+0x18/0x21
schedule_timeout+0x1e/0xad
lock_sock_nested+0x9b/0xa6
_spin_lock_bh+0x9/0x1f
release_sock+0x13/0x96
inet_csk_accept+0xb3/0x22a
autoremove_wake_function+0x0/0x2e
inet_accept+0x25/0xb6
sys_accept+0xfc/0x1ce
do_page_fault+0x5c9/0x9ab
ep_ptable_queue_proc+0x0/0x7c
system_call_after_swapgs+0x8a/0x8f

apache2       S ffff81003cd6d810     0 25655  25559
 ffff810003573d88 0000000000000082 ffff81000a6df550 0000000000000286
 ffff81003cd6d810 ffff8100299c27d0 ffff81003cd6da98 00000000543401c8
 ffffe20004363400 ffff810003213580 00007f9800839a10 ffffffff80255cc1
Call Trace:
pb_free+0x18/0x21
schedule_timeout+0x1e/0xad
lock_sock_nested+0x9b/0xa6
_spin_lock_bh+0x9/0x1f
release_sock+0x13/0x96
inet_csk_accept+0xb3/0x22a
autoremove_wake_function+0x0/0x2e
inet_accept+0x25/0xb6
sys_accept+0xfc/0x1ce
do_page_fault+0x5c9/0x9ab
ep_ptable_queue_proc+0x0/0x7c
system_call_after_swapgs+0x8a/0x8f

apache2       S ffff8100299c27d0     0 25720  16176
 ffff8100034639f8 0000000000000086 0000000000000000 0000000000000286
 ffff8100299c27d0 ffff81007f5b7050 ffff8100299c2a58 0000000203463a08
 0000000000000000 0000000114a9e780 0000000000000286 ffffffff8023e13b
Call Trace:
__mod_timer+0xbd/0xcc
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
:jbd:journal_stop+0x181/0x18d
:ext3:__ext3_journal_stop+0x1f/0x3d
:ext3:ext3_ordered_write_end+0xfa/0x110
generic_file_buffered_write+0x206/0x61b
zone_statistics+0x3a/0x8e
__alloc_pages_internal+0x3f6/0x41a
inc_held_pages+0x4e/0x62
pb_add_ref+0x72/0x81
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x930/0x9c5
handle_mm_fault+0x265/0x9c5
check_preempt_wakeup+0xbd/0xe8
autoremove_wake_function+0x0/0x2e
virtinfo_notifier_call+0x5b/0xa9
do_page_fault+0x5c9/0x9ab
vfs_read+0xaa/0x152
sys_read+0x49/0xc2
system_call_after_swapgs+0x8a/0x8f

apache2       S ffff81011d0ad090     0 25879  25778
 ffff81000351fc98 0000000000000086 ffff81004398e730 0000000000000000
 ffff81011d0ad090 ffff81008f49b090 ffff81011d0ad318 0000000267b11810
 0000000000000000 ffff81000351fc98 000000000229c4f0 ffff81013f752400
Call Trace:
futex_wait+0x1ea/0x394
get_page_from_freelist+0x416/0x587
find_lock_page+0x1f/0x8a
inc_held_pages+0x4e/0x62
pb_add_ref+0x72/0x81
default_wake_function+0x0/0xe
do_futex+0x81/0x777
sys_futex+0xfe/0x11c
sys_rt_sigaction+0x70/0x8c
__up_read+0x13/0x8a
system_call_after_swapgs+0x8a/0x8f

apache2       S ffff81010d27f050     0 25880  25778
 ffff8100032c1c98 0000000000000086 ffff8100032c1eb5 ffffffff80313353
 ffff81010d27f050 ffff81008f49b090 ffff81010d27f2d8 000000028022ee29
 ffff810082218800 000000000000000d ffff8100032c1ea8 ffffffff804ad268
Call Trace:
vsnprintf+0x568/0x5b1
futex_wait+0x1ea/0x394
check_preempt_wakeup+0xbd/0xe8
get_page_from_freelist+0x416/0x587
default_wake_function+0x0/0xe
do_futex+0x81/0x777
pick_next_task_fair+0x6e/0x79
sys_futex+0xfe/0x11c
sys_rt_sigaction+0x70/0x8c
system_call_after_swapgs+0x8a/0x8f

apache2       S ffff8100990de050     0 25881  25778
 ffff8100032c3c98 0000000000000086 ffff8100032c3eb5 ffffffff80313353
 ffff8100990de050 ffff81008f49b090 ffff8100990de2d8 000000028022ee29
 ffff810082218800 000000000000000d ffff8100032c3ea8 ffffffff804ad268
Call Trace:
vsnprintf+0x568/0x5b1
futex_wait+0x1ea/0x394
check_preempt_wakeup+0xbd/0xe8
get_page_from_freelist+0x416/0x587
default_wake_function+0x0/0xe
do_futex+0x81/0x777
pick_next_task_fair+0x6e/0x79
sys_futex+0xfe/0x11c
sys_rt_sigaction+0x70/0x8c
system_call_after_swapgs+0x8a/0x8f

apache2       S ffff8100ba8ca050     0 25882  25778
 ffff8100032c5c98 0000000000000086 ffff8100032c5eb5 ffffffff80313353
 ffff8100ba8ca050 ffff81008f49b09x416/0x587
default_wake_function+0x0/0xe
do_futex+0x81/0x777
sys_futex+0xfe/0x11c
sys_rt_sigaction+0x70/0x8c
system_call_after_swapgs+0x8a/0x8f

apache2       S ffff81008ad5d7d0     0 25895  25778
 ffff8100032dfc98 0000000000000086 ffff8100032dfeb5 ffffffff80313353
 ffff81008ad5d7d0 ffff81008f49b090 ffff81008ad5da58 000000021031ef23
 ffff8100032dfc88 000000000000000d ffff8100032dfea8 ffffffff804ad268
Call Trace:
vsnprintf+0x568/0x5b1
futex_wait+0x1ea/0x394
check_preempt_wakeup+0xbd/0xe8
get_page_from_freelist+0x416/0x587
default_wake_function+0x0/0xe
do_futex+0x81/0x777
pick_next_task_fair+0x6e/0x79
sys_futex+0xfe/0x11c
sys_rt_sigaction+0x70/0x8c
system_call_after_swapgs+0x8a/0x8f

apache2       S ffff8100bb82b090     0 25896  25778
 ffff8100035c1c98 0000000000000086 ffffffff80281620 00000000001200d2
 ffff8100bb82b090 ffff81008f49b090 ffff8100bb82b318 0000000200012480
 000000007fc31ec0 0000000000000000 001200d200000044 ffff810000012488
Call Trace:
zone_statistics+0x3a/0x8e
futex_wait+0x1ea/0x394
get_page_from_freelist+0x416/0x587
default_wake_function+0x0/0xe
do_futex+0x81/0x777
sys_futex+0xfe/0x11c
sys_rt_sigaction+0x70/0x8c
system_call_after_swapgs+0x8a/0x8f

apache2       S ffff810121546050     0 25897  25778
 ffff8100035c3c98 0000000000000086 ffffffff80281620 00000000001200d2
 ffff810121546050 ffff81008f49b090 ffff8101215462d8 0000000280001c00
 0000000080281620 0000000000000000 001200d224a31fe0 ffff810080001c08
Call Trace:
zone_statistics+0x3a/0x8e
futex_wait+0x1ea/0x394
ktime_get_ts+0x22/0x4b
get_page_from_freelist+0x416/0x587
default_wake_function+0x0/0xe
do_futex+0x81/0x777
sys_futex+0xfe/0x11c
sys_rt_sigaction+0x70/0x8c
system_call_after_swapgs+0x8a/0x8f

apache2       S ffff810110d49090     0 25898  25778
 ffff8100035c5c98 0000000000000086 ffff810000000002 ffffffff8022ac30
 ffff810110d49090 ffff81013f666810 ffff810110d49318 000000030000000d
 ffff8100035c5e98 ffffffff804ad268 0000000000000001 0000000000000001
Call Trace:
enqueue_entity+0x68/0x8a
futex_wait+0x1ea/0x394
get_page_from_freelist+0x416/0x587
default_wake_function+0x0/0xe
 000000008000028
Call Trace:
zone_statistics+0x3a/0x8e
futex_wait+0x1ea/0x394
ktime_get_ts+0x22/0x4b
get_page_from_freelist+0x416/0x587
default_wake_function+0x0/0xe
do_futex+0x81/0x777
sys_futex+0xfe/0x11c
sys_rt_sigaction+0x70/0x8c
system_call_after_swapgs+0x8a/0x8f

apache2       S ffff8100b6210090     0 25925  25778
 ffff810003377c98 0000000000000086 ffffffff80281620 00000000001200d2
 ffff8100b6210090 ffff8100a9012050 ffff8100b6210318 0000000300012480
 0000000080281620 0000000000000000 001200d22a8c8a88 ffff810000012488
Call Trace:
zone_statistics+0x3a/0x8e
futex_wait+0x1ea/0x394
ktime_get_ts+0x22/0x4b
get_page_from_freelist+0x416/0x587
default_wake_function+0x0/0xe
do_futex+0x81/0x777
sys_futex+0xfe/0x11c
sys_rt_sigaction+0x70/0x8c
system_call_after_swapgs+0x8a/0x8f

apache2       S ffff8100bfdc8810     0 25931  25778
 ffff810003507c98 0000000000000086 ffffffff80281620 00000000001200d2
 ffff8100bfdc8810 ffff81005aacb090 ffff8100bfdc8a98 0000000200012480
 0000000080281620 0000000000000000 001200d208545a88 ffff810000012488
Call Trace:
zone_statistics+0x3a/0x8e
futex_wait+0x1ea/0x394
ktime_get_ts+0x22/0x4b
get_page_from_freelist+0x416/0x587
default_wake_function+0x0/0xe
do_futex+0x81/0x777
apic_wait_icr_idle+0xe/0x15
enqueue_task+0x56/0x61
check_preempt_wakeup+0xbd/0xe8
sys_futex+0xfe/0x11c
sys_rt_sigaction+0x70/0x8c
system_call_after_swapgs+0x8a/0x8f

apache2       S ffff8100a45b37d0     0 25936  25778
 ffff810003511c98 0000000000000086 ffffffff80281620 00000000001200d2
 ffff8100a45b37d0 ffff8100bd948810 ffff8100a45b3a58 0000000300012480
 0000000080281620 0000000000000000 001200d23d490b50 ffff810000012488
Call Trace:
zone_statistics+0x3a/0x8e
futex_wait+0x1ea/0x394
get_page_from_freelist+0x416/0x587
default_wake_function+0x0/0xe
do_futex+0x81/0x777
sys_futex+0xfe/0x11c
sys_rt_sigaction+0x70/0x8c
system_call_after_swapgs+0x8a/0x8f

apache2       S ffff8100a45b3050     0 25938  25778
 ffff810003517c98 0000000000000086 ffff8100384a0810 ffffffff80221f42
sys_futex+0xfe/0x11c
sys_rt_sigaction+0x70/0x8c
system_call_after_swapgs+0x8a/0x8f

apache2       S ffff8100884af050     0 25950  25778
 ffff8100033f3c98 0000000000000086 ffffffff80281620 ffffffff80566d30
 ffff8100884af050 ffff8100bd948810 ffff8100884af2d8 0000000380001c00
 000000003f5e44c0 0000000000000000 001200d200000044 ffff810080001c28
Call Trace:
zone_statistics+0x3a/0x8e
futex_wait+0x1ea/0x394
get_page_from_freelist+0x416/0x587
default_wake_function+0x0/0xe
do_futex+0x81/0x777
sys_futex+0xfe/0x11c
sys_rt_sigaction+0x70/0x8c
system_call_after_swapgs+0x8a/0x8f

apache2       S ffff810088998810     0 25951  25778
 ffff8100033f5c98 0000000000000086 ffffffff80281620 ffffffff80566d30
 ffff810088998810 ffff8100bd948810 ffff810088998a98 0000000380001c00
 0000000080281620 0000000000000000 0000000000000002 0000000000000000
Call Trace:
zone_statistics+0x3a/0x8e
futex_wait+0x1ea/0x394
get_page_from_freelist+0x416/0x587
get_page_from_freelist+0x416/0x587
default_wake_function+0x0/0xe
do_futex+0x81/0x777
sys_futex+0xfe/0x11c
sys_rt_sigaction+0x70/0x8c
system_call_after_swapgs+0x8a/0x8f

apache2       S ffff810088998090     0 25953  25778
 ffff8100033f7c98 0000000000000086 ffffffff80281620 00000000001200d2
 ffff810088998090 ffff8100bd948810 ffff810088998318 0000000380001c00
 0000000080281620 0000000000000000 001200d2bdc8c080 ffff810080001c08
Call Trace:
zone_statistics+0x3a/0x8e
futex_wait+0x1ea/0x394
get_page_from_freelist+0x416/0x587
default_wake_function+0x0/0xe
do_futex+0x81/0x777
sys_futex+0xfe/0x11c
sys_rt_sigaction+0x70/0x8c
system_call_after_swapgs+0x8a/0x8f

apache2       S ffff8100a60fe7d0     0 25954  25778
 ffff8100033f9c98 0000000000000086 ffffffff80281620 ffffffff80566d30
 ffff8100a60fe7d0 ffff8100bd948810 ffff8100a60fea58 0000000380001c00
 0000000000000001 0000000000000000 001200d2033f9c78 ffff810080001c28
Call Trace:
zone_statistics+0x3a/0x8e
futex_wait+0x1ea/0x394
get_page_from_freelist+0x416/0x587
default_wake_function+0x0/0xe
do_futex+0x81/0x777
sys_futex+0xfe/0x11c
sys_rt_sigaction+0x70/0x8c
system_call_after_swapgs+0x8a/0x8f

system_call_after_swapgs+0x8a/0x8f

apache2       S ffff8100bd510090     0 26426  25819
 ffff81000320bd88 0000000000000086 ffff810092c9f970 0000000000000286
 ffff8100bd510090 ffff81012d0c2810 ffff8100bd510318 000000032f1b9960
 ffffe20004363400 ffff8100b0e90ac0 00007f0c7c32ca10 ffffffff80255cc1
Call Trace:
pb_free+0x18/0x21
schedule_timeout+0x1e/0xad
lock_sock_nested+0x9b/0xa6
_spin_lock_bh+0x9/0x1f
release_sock+0x13/0x96
inet_csk_accept+0xb3/0x22a
autoremove_wake_function+0x0/0x2e
inet_accept+0x25/0xb6
sys_accept+0xfc/0x1ce
do_page_fault+0x5c9/0x9ab
thread_return+0xc6/0x107
system_call_after_swapgs+0x8a/0x8f

apache2       S ffff8100ab89e810     0 26498  25819
 ffff810003519d88 0000000000000086 ffff8100a954f810 0000000000000286
 ffff8100ab89e810 ffff81004dc68810 ffff8100ab89ea98 0000000114dbb960
 ffffe20004363400 ffff8100a41cb2c0 00007f0c7c32ca10 ffffffff80255cc1
Call Trace:
pb_free+0x18/0x21
schedule_timeout+0x1e/0xad
lock_sock_nested+0x9b/0xa6
_spin_lock_bh+0x9/0x1f
release_sock+0x13/0x96
inet_csk_accept+0xb3/0x22a
autoremove_wake_function+0x0/0x2e
inet_accept+0x25/0xb6
sys_accept+0xfc/0x1ce
do_page_fault+0x5c9/0x9ab
ep_ptable_queue_proc+0x0/0x7c
system_call_after_swapgs+0x8a/0x8f

exim4         S ffff8100bfdc8090     0 26500  15484
 ffff8100035d99f8 0000000000000086 ffff8100b884b7f0 ffff81010054c8e8
 ffff8100bfdc8090 ffff81012d0c2810 ffff8100bfdc8318 00000003a013388b
 00000000bf1857b0 ffff81010a51dc48 ffff810115da13a0 ffff81009df1ca88
Call Trace:
schedule_timeout+0x1e/0xad
add_wait_queue+0x15/0x46
tcp_poll+0x1b/0x1a2
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
vsnprintf+0x568/0x5b1
handle_mm_fault+0x930/0x9c5
__alloc_pages_internal+0x3f6/0x41a
zone_statistics+0x3a/0x8e
do_page_fault+0x5c9/0x9ab
snprintf+0x44/0x4c
core_sys_select+0x1c5/0x27e
ub_task_uncharge+0xbb/0x140
remove_wait_queue+0x12/0x45
do_wait+0x97c/0xa0c
sys_select+0xc1/0x183
.7346646683
Mar  6 16:09:43 magrathea kernel: aft3965 130009f0965000[<ffff39646654/timdo_n syem_739146000100.73fff
zo3a1f80ffffffff859][14c
.73pgs+e   fff[142a9000 Tre_t71>fff.739.739396739<4>
Mar  6 16:09:43 magrathea kernel: <40x1uf+tepfff901.>[140x54>[s+0   2516
cae20b
Mar  6 16:09:43 magrathea kernel: <62  08f8d50
 6690>[14/0xs+0   ff84660114361
caecfff
Mar  6 16:09:43 magrathea kernel: <66  000 ff4660ff:
fff9650x150x11xtr+0xtimys_fy_6b7<ff901x183_swae2 f81
 ffff810011e52600 00000000000162b7 ffff810088587540 0000000000000286
schedule_timeout+0x1e/0xad
prepare_to_wait_exclusive+0x15/0x5e
__skb_recv_datagram+0x186/0x219
autoremove_wake_function+0x0/0x2e
__ub_dentry_alloc+0x8d/0xb9
skb_recv_datagram+0x1c/0x21
unix_accept+0x54/0xe4
sys_accept+0xfc/0x1ce
switch_uid+0x64/0x76
system_call_after_swapgs+0x8a/0x8f

apache2       S ffff8100a9012050     0 27052  15484
 ffff8100854ad9f8 0000000000000082 0000000000000000 0000000000000286
 ffff8100a9012050 ffff81013f57c7d0 ffff8100a90122d8 00000002854ada08
 0000000000000000 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
pbd9f<ff01.x66
Mar  6 16:09:43 magrathea kernel: 0x12c/03
:[<f690x2ahar unc11>igp_po_catin466000a8a0000000<4>146
_fff146s+0g+0xon_vmsdattor3>]f8065966903/0er_sdprfff00
Mar  6 16:09:43 magrathea kernel: 0000001.7162fff965>[1>[16904>[2a
pfff<ff1.7146146e4
f80ffffff<6>0 20001.700d 000739+0xwak pinc_e>]fff6692aca/0xingc2
320000466c
 f
Mar  6 16:09:43 magrathea kernel: <S f9650000 f24 1.7schroc228<ff396[14/0xtiorna442<ff[<f1.7
Mar  6 16:09:43 magrathea kernel: <4e+0
 ffff810003425cf8 0000000000000086 0000000000000023 0000000000000000
 ffff81007137b030
 00000000000001a4 0000000000000023 0000000000000001 0000000000000000
Call Trace:
pipe_wait+0x66/0x8d
autoremove_wake_function+0x0/0x2e
pipe_read+0x31c/0x395
do_sync_read+0xc9/0x10c
handle_mm_fault+0x265/0x9c5
autoremove_wake_function+0x0/0x2e
notify_change+0x2ac/0x2d1
vfs_read+0xaa/0x152
recalc_sigpending+0xe/0x38
sys_read+0x49/0xc2
system_call_after_swapgs+0x8a/0x8f

apache2       S ffff81011f1f4810     0 27095  27052
 ffff810082575d88 0000000000000086 ffff8100889ced90 0000000000000286
 f96d2d8690.733964>[9/0socf6>0247 [<fffffffff<ff>[1ff8ff800090
zone_statistics+0x3a/0x8e
ub_slab_ptr+0x21/0x81
snprintf+0x44/0x4c
core_sys_select+0x1c5/0x27e
ub_task_uncharge+0xbb/0x140
remove_wait_queue+0x12/0x45
do_wait+0x97c/0xa0c
sys_select+0xc1/0x183
system_call_after_swapgs+0x8a/0x8f

pgpool        S ffff81002f8a07d0     0 27583  11861
 ffff8100035939f8 0000000000000082 0000000000000000 0000000000000000
 ffff81002f8a07d0 ffff81007f5b2810 ffff81002f8a0a58 0000000303593ac8
 0000000000000000 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x1e/0xad
bit_waitqueue+0x10/0x97
add_wait_queue+0x15/0x46
pipe_poll+0x2d/0x87
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
get_page_from_freelist+0x550/0x587
get_page_from_freelist+0x550/0x587
zone_statistics+0x3a/0x8e
__alloc_pages_internal+0x3f6/0x41a
inc_held_pages+0x4e/0x62
pb_add_ref+0x72/0x81
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x930/0x9c5
__next_cpu+0x19/0x26
ve_stop_idle+0x3b/0x66
apic_wait_icr_idle+0xe/0x15
virtinfo_notifier_call+0x5b/0xa9
sys_select+0xc1/0x183
__up_read+0x13/0x8a
system_call_after_swapgs+0x8a/0x8f

logger        S ffff8100393da090     0 27584  11861
 ffff81000337dcf8 0000000000000082 0000006600000253 ffff810000000069
 ffff8100393da090 ffff8100b0e26050 ffff8100393da318 0000000300000001
 0000000000000000 ffff8100970cdbc0 0000000000004000 0000000000e7a2c0
Call Trace:
pipe_wait+0x66/0x8d
autoremove_wake_function+0x0/0x2e
pipe_read+0x31c/0x395
sysret_signal+0x2b/0x45
hrtick_set+0x9e/0xf7
do_sync_read+0xc9/0x10c
autoremove_wake_function+0x0/0x2e
sys_connect+0x6c/0x9c
vfs_read+0xaa/0x152
sys_read+0x49/0xc2
sysret_signal+0x2b/0x45
system_call_after_swapgs+0x8a/0x8f

atd           S ffff810019338050     0 27589  11861
 ffff810014b73e98 0000000000000082 0000000000000000 ffffffff80249f2c
 ffff810019338050 ffff81008f1267d0 ffff8100193382d8 000000038221f4b8
 0000000000000286 ffffffff8024a6a2 ffffffff802acb7c ffffffffa014c709
Call Trace:
enqueue_hrtimer+0xd7/0xe4
hrtimer_start+0x112/0x134
filldir+0x0/0xb7
:ext3:__ext3_journal_stop+0x1f/0x3d
do_nanosleep+0x5c/0x9c
hrtimer_nanosleep+0x54/0xbd
hrtimer_wakeup+0x0/0x21
do_nanosleep+0x41/0x9c
sys_nanosleep+0x4c/0x62
system_call_after_swapgs+0x8a/0x8f

cron          S ffff810106a64050     0 27605  11861
 ffff81007a957e98 0000000000000082 0000000000000000 ffffffff80249f2c
 ffff810106a64050 ffff81007f5a9090 ffff810106a642d8 000000010101e4b8
 0000000000000286 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
enqueue_hrtimer+0xd7/0xe4
do_nanosleep+0x5c/0x9c
hrtimer_nanosleep+0x54/0xbd
hrtimer_wakeup+0x0/0x21
do_nanosleep+0x41/0x9c
sys_nanosleep+0x4c/0x62
system_call_after_swapgs+0x8a/0x8f

munin-node    S ffff81012223e050     0 27653  11861
 ffff8100035159f8 0000000000000086 0000000000000000 0000000000000286
 ffff81012223e050 ffff81007f5b2810 ffff81012223e2d8 0000000303515a08
 ffff8100b0db3d80 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
mix_pool_bytes_extract+0x5c/0x155
extract_buf+0xa0/0x105
mix_pool_bytes_extract+0x5c/0x155
extract_buf+0xa0/0x105
ptep_set_access_flags+0x33/0x3a
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x930/0x9c5
enqueue_hrtimer+0xd7/0xe4
hrtimer_start+0x112/0x134
sync_buffer+0x0/0x3f
thread_return+0xc6/0x107
sys_select+0x15a/0x183
system_call_after_swapgs+0x8a/0x8f

pgpool        S ffff81008f1267d0     0 27657  27583
 ffff81000320f9f8 0000000000000086 0000000000000000 0000000000000286
 ffff81008f1267d0 ffff81013f57c7d0 ffff81008f126a58 000000020320fa08
 ffff81008661eac0 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
default_wake_function+0x0/0xe
__alloc_collect_stats+0x45/0x8b
__alloc_pages_internal+0x388/0x41a
kmem_getpages+0x96/0x151
____cache_alloc_node+0x6d/0x106
fallback_alloc+0xc3/0x1bf
find_lock_page+0x1f/0x8a
filemap_fault+0x1c2/0x33d
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x265/0x9c5
__up_read+0x13/0x8a
sys_select+0x15a/0x183
__up_read+0x13/0x8a
system_call_after_swapgs+0x8a/0x8f

pgpool        S ffff81008b5ce7d0     0 27658  27583
 ffff81000327d9f8 0000000000000082 ffff810130054910 0000000000000286
 ffff81008b5ce7d0 ffff81002f8a07d0 ffff81008b5cea58 000000030327da08
 ffff81008661eac0 0000000114aaaf32 0000000000000286 ffffffff8023e13b
Call Trace:
__mod_timer+0xbd/0xcc
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
default_wake_function+0x0/0xe
__alloc_collect_stats+0x45/0x8b
__alloc_pages_internal+0x388/0x41a
kmem_getpages+0x96/0x151
____cache_alloc_node+0x6d/0x106
fallback_alloc+0xc3/0x1bf
find_lock_page+0x1f/0x8a
filemap_fault+0x1c2/0x33d
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x265/0x9c5
__up_read+0x13/0x8a
sys_select+0x15a/0x183
__up_read+0x13/0x8a
system_call_after_swapgs+0x8a/0x8f

pgpool        S ffff8101313da810     0 27659  27583
 ffff8100035059f8 0000000000000086 0000000000000000 0000000000000286
 ffff8101313da810 ffff81007f5a9090 ffff8101313daa98 0000000103505a08
 ffff81008661eac0 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
default_wake_function+0x0/0xe
get_page_from_freelist+0x35a/0x587
zone_statistics+0x3a/0x8e
find_lock_page+0x1f/0x8a
filemap_fault+0x1c2/0x33d
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x265/0x9c5
ktime_get+0xc/0x41
__switch_to+0xd2/0x35e
thread_return+0xc6/0x107
sys_select+0x15a/0x183
__up_read+0x13/0x8a
system_call_after_swapgs+0x8a/0x8f

pgpool        S ffff8100bb904090     0 27660  27583
 ffff81000359f9f8 0000000000000082 0000000000000000 0000000000000286
 ffff8100bb904090 ffff81013f57c7d0 ffff8100bb904318 000000020359fa08
 ffff81008661eac0 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
default_wake_function+0x0/0xe
zone_statistics+0x3a/0x8e
find_lock_page+0x1f/0x8a
filemap_fault+0x1c2/0x33d
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x265/0x9c5
__up_read+0x13/0x8a
sys_select+0x15a/0x183
__up_read+0x13/0x8a
system_call_after_swapgs+0x8a/0x8f

pgpool        S ffff8100bb904810     0 27661  27583
 ffff81010018b9f8 0000000000000086 0000000000000000 0000000000000286
 ffff8100bb904810 ffff81007f5a9090 ffff8100bb904a98 000000010018ba08
 ffff81008661eac0 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
default_wake_function+0x0/0xe
vsnprintf+0x568/0x5b1
__rmqueue_smallest+0x88/0x104
__rmqueue+0xe1/0x1b2
zone_statistics+0x3a/0x8e
find_lock_page+0x1f/0x8a
filemap_fault+0x1c2/0x33d
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x265/0x9c5
__up_read+0x13/0x8a
sys_select+0x15a/0x183
__up_read+0x13/0x8a
system_call_after_swapgs+0x8a/0x8f

pgpool        S ffff8100bb82a810     0 27662  27583
 ffff81010015b9f8 0000000000000086 0000000000000000 0000000000000286
 ffff8100bb82a810 ffff81013f57c7d0 ffff8100bb82aa98 000000020015ba08
 ffff81008661eac0 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
default_wake_function+0x0/0xe
zone_statistics+0x3a/0x8e
find_lock_page+0x1f/0x8a
filemap_fault+0x1c2/0x33d
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x265/0x9c5
__up_read+0x13/0x8a
sys_select+0x15a/0x183
__up_read+0x13/0x8a
system_call_after_swapgs+0x8a/0x8f

pgpool        S ffff81008642b050     0 27663  27583
 ffff81010010b9f8 0000000000000086 0000000000000000 0000000000000286
 ffff81008642b050 ffff81007f5a9090 ffff81008642b2d8 000000010010ba08
 ffff81008661eac0 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
default_wake_function+0x0/0xe
__rmqueue+0xe1/0x1b2
rmqueue_bulk+0x41/0x86
zone_statistics+0x3a/0x8e
find_lock_page+0x1f/0x8a
filemap_fault+0x1c2/0x33d
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x265/0x9c5
__up_read+0x13/0x8a
sys_select+0x15a/0x183
__up_read+0x13/0x8a
system_call_after_swapgs+0x8a/0x8f

pgpool        S ffff8100bfc45090     0 27664  27583
 ffff81010012b9f8 0000000000000082 0000000000000000 0000000000000286
 ffff8100bfc45090 ffff81013f57c7d0 ffff8100bfc45318 000000020012ba08
 ffff81008661eac0 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
default_wake_function+0x0/0xe
__rmqueue+0xe1/0x1b2
zone_statistics+0x3a/0x8e
find_lock_page+0x1f/0x8a
filemap_fault+0x1c2/0x33d
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x265/0x9c5
hrtick_start_fair+0xfb/0x144
__up_read+0x13/0x8a
sys_select+0x15a/0x183
__up_read+0x13/0x8a
system_call_after_swapgs+0x8a/0x8f

pgpool        S ffff81009088e050     0 27665  27583
 ffff8100b61339f8 0000000000000082 0000000000000000 0000000000000286
 ffff81009088e050 ffff81007f5a9090 ffff81009088e2d8 00000001b6133a08
 ffff81008661eac0 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
default_wake_function+0x0/0xe
zone_statistics+0x3a/0x8e
find_lock_page+0x1f/0x8a
filemap_fault+0x1c2/0x33d
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x265/0x9c5
__up_read+0x13/0x8a
sys_select+0x15a/0x183
__up_read+0x13/0x8a
system_call_after_swapgs+0x8a/0x8f

pgpool        S ffff8101231147d0     0 27666  27583
 ffff8100824499f8 0000000000000086 0000000000000000 0000000000000286
 ffff8101231147d0 ffff81013f57c7d0 ffff810123114a58 0000000282449a08
 ffff81008661eac0 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
default_wake_function+0x0/0xe
__do_fault+0x43e/0x451
__d_lookup+0xd6/0x11e
do_lookup+0x85/0x1dd
zone_statistics+0x3a/0x8e
find_lock_page+0x1f/0x8a
filemap_fault+0x1c2/0x33d
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x265/0x9c5
__up_read+0x13/0x8a
sys_select+0x15a/0x183
__up_read+0x13/0x8a
system_call_after_swapgs+0x8a/0x8f

pgpool        S ffff81008a963090     0 27667  27583
 ffff8100825059f8 0000000000000082 0000000000000000 0000000000000286
 ffff81008a963090 ffff81007f5a9090 ffff81008a963318 0000000182505a08
 ffff81008661eac0 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
default_wake_function+0x0/0xe
zone_statistics+0x3a/0x8e
find_lock_page+0x1f/0x8a
filemap_fault+0x1c2/0x33d
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x265/0x9c5
__up_read+0x13/0x8a
sys_select+0x15a/0x183
__up_read+0x13/0x8a
system_call_after_swapgs+0x8a/0x8f

pgpool        S ffff81011d1e5050     0 27668  27583
 ffff81000346d9f8 0000000000000082 0000000000000000 0000000000000286
 ffff81011d1e5050 ffff81013f57c7d0 ffff81011d1e52d8 000000020346da08
 ffff81008661eac0 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
default_wake_function+0x0/0xe
__alloc_collect_stats+0x45/0x8b
__alloc_pages_internal+0x388/0x41a
kmem_getpages+0x96/0x151
____cache_alloc_node+0x6d/0x106
fallback_alloc+0xc3/0x1bf
find_lock_page+0x1f/0x8a
filemap_fault+0x1c2/0x33d
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x265/0x9c5
__up_read+0x13/0x8a
sys_select+0x15a/0x183
__up_read+0x13/0x8a
system_call_after_swapgs+0x8a/0x8f

pgpool        S ffff81013f0d3050     0 27669  27583
 ffff8100035319f8 0000000000000086 0000000000000000 0000000000000286
 ffff81013f0d3050 ffff81007f5a9090 ffff81013f0d32d8 0000000103531a08
 ffff81008661eac0 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
default_wake_function+0x0/0xe
zone_statistics+0x3a/0x8e
find_lock_page+0x1f/0x8a
filemap_fault+0x1c2/0x33d
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x265/0x9c5
__up_read+0x13/0x8a
sys_select+0x15a/0x183
__up_read+0x13/0x8a
system_call_after_swapgs+0x8a/0x8f

pgpool        S ffff81008642b7d0     0 27670  27583
 ffff8100032439f8 0000000000000082 0000000000000000 0000000000000286
 ffff81008642b7d0 ffff81013f57c7d0 ffff81008642ba58 0000000203243a08
 ffff81008661eac0 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
default_wake_function+0x0/0xe
__alloc_collect_stats+0x45/0x8b
__alloc_pages_internal+0x388/0x41a
kmem_getpages+0x96/0x151
____cache_alloc_node+0x6d/0x106
fallback_alloc+0xc3/0x1bf
find_lock_page+0x1f/0x8a
filemap_fault+0x1c2/0x33d
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x265/0x9c5
__up_read+0x13/0x8a
sys_select+0x15a/0x183
__up_read+0x13/0x8a
system_call_after_swapgs+0x8a/0x8f

pgpool        S ffff81013078e810     0 27671  27583
 ffff8100033d59f8 0000000000000082 0000000000000000 0000000000000286
 ffff81013078e810 ffff81007f5a9090 ffff81013078ea98 00000001033d5a08
 ffff81008661eac0 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
default_wake_function+0x0/0xe
zone_statistics+0x3a/0x8e
find_lock_page+0x1f/0x8a
filemap_fault+0x1c2/0x33d
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x265/0x9c5
__up_read+0x13/0x8a
sys_select+0x15a/0x183
__up_read+0x13/0x8a
system_call_after_swapgs+0x8a/0x8f

pgpool        S ffff8100b0e267d0     0 27672  27583
 ffff8100033379f8 0000000000000082 0000000000000000 0000000000000286
 ffff8100b0e267d0 ffff81013f57c7d0 ffff8100b0e26a58 0000000203337a08
 ffff81008661eac0 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
default_wake_function+0x0/0xe
__alloc_collect_stats+0x45/0x8b
__alloc_pages_internal+0x388/0x41a
kmem_getpages+0x96/0x151
____cache_alloc_node+0x6d/0x106
fallback_alloc+0xc3/0x1bf
find_lock_page+0x1f/0x8a
filemap_fault+0x1c2/0x33d
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x265/0x9c5
__up_read+0x13/0x8a
sys_select+0x15a/0x183
__up_read+0x13/0x8a
system_call_after_swapgs+0x8a/0x8f

pgpool        S ffff8100bb8727d0     0 27673  27583
 ffff8100035799f8 0000000000000082 0000000000000000 0000000000000286
 ffff8100bb8727d0 ffff81007f5a9090 ffff8100bb872a58 0000000103579a08
 ffff81008661eac0 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
default_wake_function+0x0/0xe
zone_statistics+0x3a/0x8e
find_lock_page+0x1f/0x8a
filemap_fault+0x1c2/0x33d
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x265/0x9c5
__up_read+0x13/0x8a
sys_select+0x15a/0x183
__up_read+0x13/0x8a
system_call_after_swapgs+0x8a/0x8f

pgpool        S ffff81008bca9090     0 27674  27583
 ffff81000326b9f8 0000000000000082 0000000000000000 0000000000000286
 ffff81008bca9090 ffff81013f57c7d0 ffff81008bca9318 000000020326ba08
 ffff81008661eac0 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
default_wake_function+0x0/0xe
__alloc_collect_stats+0x45/0x8b
__alloc_pages_internal+0x388/0x41a
kmem_getpages+0x96/0x151
____cache_alloc_node+0x6d/0x106
fallback_alloc+0xc3/0x1bf
find_lock_page+0x1f/0x8a
filemap_fault+0x1c2/0x33d
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x265/0x9c5
__up_read+0x13/0x8a
sys_select+0x15a/0x183
__up_read+0x13/0x8a
system_call_after_swapgs+0x8a/0x8f

pgpool        S ffff81013121c090     0 27675  27583
 ffff8100034659f8 0000000000000082 0000000000000000 0000000000000286
 ffff81013121c090 ffff81007f5a9090 ffff81013121c318 0000000103465a08
 ffff81008661eac0 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
default_wake_function+0x0/0xe
zone_statistics+0x3a/0x8e
find_lock_page+0x1f/0x8a
filemap_fault+0x1c2/0x33d
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x265/0x9c5
__up_read+0x13/0x8a
sys_select+0x15a/0x183
__up_read+0x13/0x8a
system_call_after_swapgs+0x8a/0x8f

pgpool        S ffff810064aed090     0 27676  27583
 ffff81000357d9f8 0000000000000086 0000000000000000 0000000000000286
 ffff810064aed090 ffff81013f57c7d0 ffff810064aed318 000000020357da08
 ffff81008661eac0 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
default_wake_function+0x0/0xe
__alloc_collect_stats+0x45/0x8b
__alloc_pages_internal+0x388/0x41a
kmem_getpages+0x96/0x151
____cache_alloc_node+0x6d/0x106
fallback_alloc+0xc3/0x1bf
find_lock_page+0x1f/0x8a
filemap_fault+0x1c2/0x33d
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x265/0x9c5
__up_read+0x13/0x8a
sys_select+0x15a/0x183
__up_read+0x13/0x8a
system_call_after_swapgs+0x8a/0x8f

pgpool        S ffff810064aed810     0 27677  27583
 ffff8100035959f8 0000000000000082 0000000000000000 0000000000000286
 ffff810064aed810 ffff81007f5a9090 ffff810064aeda98 0000000103595a08
 ffff81008661eac0 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
default_wake_function+0x0/0xe
zone_statistics+0x3a/0x8e
find_lock_page+0x1f/0x8a
filemap_fault+0x1c2/0x33d
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x265/0x9c5
__up_read+0x13/0x8a
sys_select+0x15a/0x183
__up_read+0x13/0x8a
system_call_after_swapgs+0x8a/0x8f

pgpool        S ffff81000d101050     0 27678  27583
 ffff8100033279f8 0000000000000082 0000000000000000 0000000000000286
 ffff81000d101050 ffff81013f57c7d0 ffff81000d1012d8 0000000203327a08
 ffff81008661eac0 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
default_wake_function+0x0/0xe
__alloc_collect_stats+0x45/0x8b
__alloc_pages_internal+0x388/0x41a
kmem_getpages+0x96/0x151
____cache_alloc_node+0x6d/0x106
fallback_alloc+0xc3/0x1bf
find_lock_page+0x1f/0x8a
filemap_fault+0x1c2/0x33d
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x265/0x9c5
__up_read+0x13/0x8a
sys_select+0x15a/0x183
__up_read+0x13/0x8a
system_call_after_swapgs+0x8a/0x8f

pgpool        S ffff81000d1017d0     0 27679  27583
 ffff8100034219f8 0000000000000086 0000000000000000 0000000000000286
 ffff81000d1017d0 ffff81007f5a9090 ffff81000d101a58 0000000103421a08
 ffff81008661eac0 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
default_wake_function+0x0/0xe
vsnprintf+0x568/0x5b1
getnstimeofday+0x39/0x98
__rmqueue+0xe1/0x1b2
zone_statistics+0x3a/0x8e
find_lock_page+0x1f/0x8a
filemap_fault+0x1c2/0x33d
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x265/0x9c5
__up_read+0x13/0x8a
sys_select+0x15a/0x183
__up_read+0x13/0x8a
system_call_after_swapgs+0x8a/0x8f

pgpool        S ffff810106bbc7d0     0 27680  27583
 ffff8101001539f8 0000000000000082 0000000000000000 0000000000000286
 ffff810106bbc7d0 ffff81013f57c7d0 ffff810106bbca58 0000000200153a08
 ffff81008661eac0 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
default_wake_function+0x0/0xe
__rmqueue+0x1c/0x1b2
rmqueue_bulk+0x41/0x86
zone_statistics+0x3a/0x8e
find_lock_page+0x1f/0x8a
filemap_fault+0x1c2/0x33d
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x265/0x9c5
__up_read+0x13/0x8a
sys_select+0x15a/0x183
__up_read+0x13/0x8a
system_call_after_swapgs+0x8a/0x8f

pgpool        S ffff810106bbc050     0 27681  27583
 ffff8101001279f8 0000000000000082 ffff81012b93ff70 0000000000000286
 ffff810106bbc050 ffff81002f8a07d0 ffff810106bbc2d8 0000000300127a08
 ffff81008661eac0 0000000114aaaf36 0000000000000286 ffffffff8023e13b
Call Trace:
__mod_timer+0xbd/0xcc
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
default_wake_function+0x0/0xe
__alloc_pages_internal+0x3f6/0x41a
zone_statistics+0x3a/0x8e
find_lock_page+0x1f/0x8a
filemap_fault+0x1c2/0x33d
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x265/0x9c5
__up_read+0x13/0x8a
sys_select+0x15a/0x183
__up_read+0x13/0x8a
system_call_after_swapgs+0x8a/0x8f

pgpool        S ffff81010586b810     0 27682  27583
 ffff8101001039f8 0000000000000086 0000000000000000 0000000000000286
 ffff81010586b810 ffff81013f57c7d0 ffff81010586ba98 0000000200103a08
 ffff81008661eac0 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
default_wake_function+0x0/0xe
__rmqueue+0x1c/0x1b2
rmqueue_bulk+0x41/0x86
zone_statistics+0x3a/0x8e
find_lock_page+0x1f/0x8a
filemap_fault+0x1c2/0x33d
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x265/0x9c5
__up_read+0x13/0x8a
sys_select+0x15a/0x183
__up_read+0x13/0x8a
system_call_after_swapgs+0x8a/0x8f

pgpool        S ffff81010586b090     0 27683  27583
 ffff81009cc1f9f8 0000000000000086 8a840fc085c389dc 0000000000000286
 ffff81010586b090 ffff81002f8a07d0 ffff81010586b318 000000039cc1fa08
 ffff81008661eac0 0000000114aaaf36 0000000000000286 ffffffff8023e13b
Call Trace:
__mod_timer+0xbd/0xcc
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
default_wake_function+0x0/0xe
__alloc_pages_internal+0x3f6/0x41a
zone_statistics+0x3a/0x8e
find_lock_page+0x1f/0x8a
filemap_fault+0x1c2/0x33d
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x265/0x9c5
__up_read+0x13/0x8a
sys_select+0x15a/0x183
__up_read+0x13/0x8a
system_call_after_swapgs+0x8a/0x8f

pgpool        S ffff8100910167d0     0 27684  27583
 ffff8100894d99f8 0000000000000082 0000000000000000 0000000000000286
 ffff8100910167d0 ffff81007f5a9090 ffff810091016a58 00000001894d9a08
 ffff81008661eac0 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
default_wake_function+0x0/0xe
zone_statistics+0x3a/0x8e
find_lock_page+0x1f/0x8a
filemap_fault+0x1c2/0x33d
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x265/0x9c5
__up_read+0x13/0x8a
sys_select+0x15a/0x183
__up_read+0x13/0x8a
system_call_after_swapgs+0x8a/0x8f

pgpool        S ffff810091016050     0 27685  27583
 ffff8100824019f8 0000000000000086 0000000000000000 0000000000000286
 ffff810091016050 ffff81013f57c7d0 ffff8100910162d8 0000000282401a08
 ffff81008661eac0 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
default_wake_function+0x0/0xe
ub_kmemsize_charge+0x4e/0x86
__alloc_pages_internal+0x3f6/0x41a
zone_statistics+0x3a/0x8e
find_lock_page+0x1f/0x8a
filemap_fault+0x1c2/0x33d
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x265/0x9c5
__up_read+0x13/0x8a
sys_select+0x15a/0x183
__up_read+0x13/0x8a
system_call_after_swapgs+0x8a/0x8f

pgpool        S ffff810059422090     0 27686  27583
 ffff8100106e79f8 0000000000000086 0000000000000000 0000000000000286
 ffff810059422090 ffff81007f5a9090 ffff810059422318 00000001106e7a08
 ffff81008661eac0 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
default_wake_function+0x0/0xe
zone_statistics+0x3a/0x8e
find_lock_page+0x1f/0x8a
filemap_fault+0x1c2/0x33d
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x265/0x9c5
__up_read+0x13/0x8a
sys_select+0x15a/0x183
__up_read+0x13/0x8a
system_call_after_swapgs+0x8a/0x8f

pgpool        S ffff810059422810     0 27687  27583
 ffff8100032239f8 0000000000000086 0000000000000000 0000000000000286
 ffff810059422810 ffff81013f57c7d0 ffff810059422a98 0000000203223a08
 ffff81008661eac0 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
default_wake_function+0x0/0xe
__rmqueue+0x1c/0x1b2
getnstimeofday+0x39/0x98
ktime_get_ts+0x22/0x4b
ktime_get+0xc/0x41
zone_statistics+0x3a/0x8e
find_lock_page+0x1f/0x8a
filemap_fault+0x1c2/0x33d
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x265/0x9c5
__up_read+0x13/0x8a
sys_select+0x15a/0x183
__up_read+0x13/0x8a
system_call_after_swapgs+0x8a/0x8f

pgpool        S ffff8100109ac050     0 27688  27583
 ffff8100033399f8 0000000000000082 0000000000000000 0000000000000286
 ffff8100109ac050 ffff81007f5a9090 ffff8100109ac2d8 0000000103339a08
 ffff81008661eac0 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x8a/0xad
process_timeout+0x0/0x5
schedule_timeout+0x85/0xad
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
default_wake_function+0x0/0xe
zone_statistics+0x3a/0x8e
find_lock_page+0x1f/0x8a
filemap_fault+0x1c2/0x33d
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x265/0x9c5
__up_read+0x13/0x8a
sys_select+0x15a/0x183
__up_read+0x13/0x8a
system_call_after_swapgs+0x8a/0x8f

pgpool        S ffff8100109ac7d0     0 27689  27583
 ffff81000333b9f8 0000000000000082 0000000000000000 0000000000000246
 ffff8100109ac7d0 ffff81007f5a9090 ffff8100109aca58 000000010000001e
 0000000000000000 0000000000000000 00000000ffffffff 0000000000000000
Call Trace:
schedule_timeout+0x1e/0xad
ub_sock_make_wreserv+0x7e/0xb0
add_wait_queue+0x15/0x46
tcp_poll+0x1b/0x1a2
do_select+0x401/0x464
__pollwait+0x0/0xe1
default_wake_function+0x0/0xe
default_wake_function+0x0/0xe
__alloc_pages_internal+0x3f6/0x41a
zone_statistics+0x3a/0x8e
find_lock_page+0x1f/0x8a
filemap_fault+0x1c2/0x33d
core_sys_select+0x1c5/0x27e
handle_mm_fault+0x265/0x9c5
hrtick_start_fair+0xfb/0x144
__up_read+0x13/0x8a
error_exit+0x0/0x60
sys_select+0xc1/0x183
__up_read+0x13/0x8a
system_call_after_swapgs+0x8a/0x8f

Sched Debug Version: v0.07, 2.6.26-1-openvz-amd64 #1
now at 1387016215.306662 msecs
  .sysctl_sched_latency                    : 60.000000
  .sysctl_sched_min_granularity            : 12.000000
  .sysctl_sched_wakeup_granularity         : 30.000000
  .sysctl_sched_child_runs_first           : 0.000001
  .sysctl_sched_features                   : 895

cpu#0, 2204.996 MHz
  .nr_running                    : 0
  .load                          : 0
  .nr_switches                   : 30471130
  .nr_load_updates               : 35089687
  .nr_uninterruptible            : -102932
  .jiffies                       : 4641646349
  .next_balance                  : 4641.646354
  .curr->pid                     : 0
  .clock                         : 1387016214.283032
                  : 0
                  : 0
                  : 0
                  : 0
                  : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

runnable tasks:
            task   PID         tree-key  switches  prio     exec-runtime         sum-exec        sum-sleep
----------------------------------------------------------------------------------------------------------

cpu#1, 2204.996 MHz
  .nr_running                    : 1
  .load                          : 1024
  .nr_switches                   : 32936806
  .nr_load_updates               : 22654463
  .nr_uninterruptible            : 139329
  .jiffies                       : 4641646350
  .next_balance                  : 4641.646390
  .curr->pid                     : 0
  .clock                         : 1387016210.533443
                  : 1024
                  : 1016
                  : 888
                  : 623
                  : 381

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105275.936913
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444754.966062
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105275.936913
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444754.966062
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105275.936913
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444754.966062
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105275.936913
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444754.966062
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105275.936913
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444754.966062
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105275.936913
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444754.966062
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105275.936913
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444754.966062
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105275.936913
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444754.966062
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105275.936913
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444754.966062
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105275.936913
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444754.966062
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105275.936913
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444754.966062
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105275.936913
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444754.966062
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105275.936913
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444754.966062
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105275.936913
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444754.966062
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105275.936913
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444754.966062
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105275.936913
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444754.966062
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105275.936913
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444754.966062
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105275.936913
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444754.966062
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105275.936913
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444754.966062
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105275.936913
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444754.966062
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105275.936913
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444754.966062
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105275.936913
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444754.966062
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105275.936913
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444754.966062
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105275.936913
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444754.966062
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105275.936913
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444754.966062
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105275.936913
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444754.966062
  .nr_running                    : 1
  .load                          : 1024
  .nr_spread_over                : 0

runnable tasks:
            task   PID         tree-key  switches  prio     exec-runtime         sum-exec        sum-sleep
----------------------------------------------------------------------------------------------------------
R          klogd  2317  24105271.068476      6840   120               0               0               0.000000               0.000000               0.000000

cpu#2, 2204.996 MHz
  .nr_running                    : 1
  .load                          : 1024
  .nr_switches                   : 44301196
  .nr_load_updates               : 32481474
  .nr_uninterruptible            : -89345
  .jiffies                       : 4641646350
  .next_balance                  : 4641.646354
  .curr->pid                     : 12684
  .clock                         : 1387016125.008715
                  : 0
                  : 0
                  : 0
                  : 0
                  : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391044.167681
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730523.196830
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391044.167681
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730523.196830
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391044.167681
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730523.196830
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391044.167681
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730523.196830
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391044.167681
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730523.196830
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391044.167681
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730523.196830
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391044.167681
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730523.196830
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391044.167681
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730523.196830
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391044.167681
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730523.196830
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391044.167681
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730523.196830
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391044.167681
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730523.196830
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391044.167681
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730523.196830
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391044.167681
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730523.196830
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391044.167681
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730523.196830
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391044.167681
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730523.196830
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391044.167681
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730523.196830
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391044.167681
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730523.196830
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391044.167681
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730523.196830
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391044.167681
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730523.196830
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391044.167681
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730523.196830
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391044.167681
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730523.196830
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391044.167681
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730523.196830
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391044.167681
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730523.196830
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391044.167681
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730523.196830
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391044.167681
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730523.196830
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391044.167681
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730523.196830
  .nr_running                    : 1
  .load                          : 1024
  .nr_spread_over                : 0

runnable tasks:
            task   PID         tree-key  switches  prio     exec-runtime         sum-exec        sum-sleep
----------------------------------------------------------------------------------------------------------
R           bash 12684  14390984.173067      2860   120               0               0               0.000000               0.000000               0.000000

cpu#3, 2204.996 MHz
  .nr_running                    : 0
  .load                          : 0
  .nr_switches                   : 118967255
  .nr_load_updates               : 59435887
  .nr_uninterruptible            : 52948
  .jiffies                       : 4641646350
  .next_balance                  : 4641.646390
  .curr->pid                     : 0
  .clock                         : 1387016219.080416
                  : 1024
                  : 1024
                  : 1024
                  : 981
                  : 799

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290343.390853
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629822.420002
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290343.390853
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629822.420002
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290343.390853
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629822.420002
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290343.390853
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629822.420002
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290343.390853
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629822.420002
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290368.966455
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629847.995604
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290368.966455
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629847.995604
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290368.966455
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629847.995604
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290368.966455
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629847.995604
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290368.966455
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629847.995604
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290368.966455
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629847.995604
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290368.966455
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629847.995604
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290368.966455
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629847.995604
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290368.966455
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629847.995604
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290368.966455
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629847.995604
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290368.966455
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629847.995604
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290368.966455
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629847.995604
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290368.966455
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629847.995604
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290368.966455
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629847.995604
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290368.966455
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629847.995604
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290368.966455
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629847.995604
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290368.966455
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629847.995604
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290368.966455
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629847.995604
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290368.966455
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629847.995604
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290368.966455
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629847.995604
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290368.966455
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629847.995604
  .nr_running                    : 1
  .load                          : 1024
  .nr_spread_over                : 0

runnable tasks:
            task   PID         tree-key  switches  prio     exec-runtime         sum-exec        sum-sleep
----------------------------------------------------------------------------------------------------------
R        syslogd  2308  27290368.966455    256745   120               0               0               0.000000               0.000000               0.000000

Show Blocked State
  task                  taskaddr stack   pid father
Sched Debug Version: v0.07, 2.6.26-1-openvz-amd64 #1
now at 1387018393.662282 msecs
  .sysctl_sched_latency                    : 60.000000
  .sysctl_sched_min_granularity            : 12.000000
  .sysctl_sched_wakeup_granularity         : 30.000000
  .sysctl_sched_child_runs_first           : 0.000001
  .sysctl_sched_features                   : 895

cpu#0, 2204.996 MHz
  .nr_running                    : 0
  .load                          : 0
  .nr_switches                   : 30471169
  .nr_load_updates               : 35089754
  .nr_uninterruptible            : -102932
  .jiffies                       : 4641646894
  .next_balance                  : 4641.646910
  .curr->pid                     : 0
  .clock                         : 1387018351.631673
                  : 0
                  : 0
                  : 0
                  : 0
                  : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[0]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 10660520.970851
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 0.000000
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

runnable tasks:
            task   PID         tree-key  switches  prio     exec-runtime         sum-exec        sum-sleep
----------------------------------------------------------------------------------------------------------

cpu#1, 2204.996 MHz
  .nr_running                    : 1
  .load                          : 1024
  .nr_switches                   : 32940832
  .nr_load_updates               : 22654492
  .nr_uninterruptible            : 139329
  .jiffies                       : 4641646894
  .next_balance                  : 4641.646895
  .curr->pid                     : 2317
  .clock                         : 1387018392.027485
                  : 0
                  : 0
                  : 0
                  : 43
                  : 145

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105306.743889
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444785.773038
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105306.743889
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444785.773038
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105306.743889
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444785.773038
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105306.743889
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444785.773038
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105306.743889
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444785.773038
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105306.743889
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444785.773038
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105306.743889
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444785.773038
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105306.743889
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444785.773038
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105306.743889
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444785.773038
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105306.743889
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444785.773038
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105306.743889
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444785.773038
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105306.743889
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444785.773038
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105306.743889
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444785.773038
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105306.743889
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444785.773038
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105306.743889
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444785.773038
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105306.743889
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444785.773038
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105306.743889
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444785.773038
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105306.743889
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444785.773038
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105306.743889
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444785.773038
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105306.743889
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444785.773038
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105306.743889
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444785.773038
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105306.743889
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444785.773038
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105306.743889
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444785.773038
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105306.743889
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444785.773038
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105306.743889
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444785.773038
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[1]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 24105306.743889
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 13444785.773038
  .nr_running                    : 1
  .load                          : 1024
  .nr_spread_over                : 0

runnable tasks:
            task   PID         tree-key  switches  prio     exec-runtime         sum-exec        sum-sleep
----------------------------------------------------------------------------------------------------------
R          klogd  2317  24105311.222614      8832   120               0               0               0.000000               0.000000               0.000000

cpu#2, 2204.996 MHz
  .nr_running                    : 1
  .load                          : 1024
  .nr_switches                   : 44301325
  .nr_load_updates               : 32481554
  .nr_uninterruptible            : -89345
  .jiffies                       : 4641646894
  .next_balance                  : 4641.646906
  .curr->pid                     : 12684
  .clock                         : 1387018397.008357
                  : 0
                  : 0
                  : 0
                  : 0
                  : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391079.900199
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730558.929348
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391079.900199
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730558.929348
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391079.900199
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730558.929348
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391079.900199
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730558.929348
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391079.900199
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730558.929348
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391079.900199
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730558.929348
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391079.900199
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730558.929348
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391079.900199
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730558.929348
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391079.900199
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730558.929348
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391079.900199
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730558.929348
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391079.900199
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730558.929348
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391079.900199
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730558.929348
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391079.900199
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730558.929348
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391079.900199
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730558.929348
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391079.900199
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730558.929348
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391079.900199
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730558.929348
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391079.900199
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730558.929348
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391079.900199
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730558.929348
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391079.900199
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730558.929348
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391079.900199
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730558.929348
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391079.900199
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730558.929348
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391079.900199
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730558.929348
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391079.900199
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730558.929348
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391079.900199
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730558.929348
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391079.900199
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730558.929348
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[2]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 14391079.900199
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 3730558.929348
  .nr_running                    : 1
  .load                          : 1024
  .nr_spread_over                : 0

runnable tasks:
            task   PID         tree-key  switches  prio     exec-runtime         sum-exec        sum-sleep
----------------------------------------------------------------------------------------------------------
R           bash 12684  14391079.900199      2872   120               0               0               0.000000               0.000000               0.000000

cpu#3, 2204.996 MHz
  .nr_running                    : 1
  .load                          : 1024
  .nr_switches                   : 118967431
  .nr_load_updates               : 59435978
  .nr_uninterruptible            : 52948
  .jiffies                       : 4641646895
  .next_balance                  : 4641.646958
  .curr->pid                     : 2308
  .clock                         : 1387018398.252884
                  : 1024
                  : 512
                  : 256
                  : 136
                  : 96

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290443.360155
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629922.389304
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290443.360155
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629922.389304
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290443.360155
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629922.389304
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290443.360155
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629922.389304
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290443.360155
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629922.389304
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290443.360155
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629922.389304
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290443.360155
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629922.389304
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290443.360155
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629922.389304
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290443.360155
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629922.389304
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290443.360155
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629922.389304
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290443.360155
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629922.389304
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290443.360155
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629922.389304
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290443.360155
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629922.389304
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290443.360155
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629922.389304
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290443.360155
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629922.389304
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290443.360155
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629922.389304
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290443.360155
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629922.389304
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290443.360155
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629922.389304
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290443.360155
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629922.389304
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290443.360155
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629922.389304
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290443.360155
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629922.389304
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290443.360155
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629922.389304
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290443.360155
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629922.389304
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290443.360155
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629922.389304
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290443.360155
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629922.389304
  .nr_running                    : 0
  .load                          : 0
  .nr_spread_over                : 0

cfs_rq[3]:
  .exec_clock                    : 0.000000
  .MIN_vruntime                  : 0.000001
  .min_vruntime                  : 27290443.360155
  .max_vruntime                  : 0.000001
  .spread                        : 0.000000
  .spread0                       : 16629922.389304
  .nr_running                    : 1
  .load                          : 1024
  .nr_spread_over                : 0

runnable tasks:
            task   PID         tree-key  switches  prio     exec-runtime         sum-exec        sum-sleep
----------------------------------------------------------------------------------------------------------
R        syslogd  2308  27290444.103330    256750   120               0               0               0.000000               0.000000               0.000000

Reply to:

Follow-Ups:
- Bug#513537: linux-image-2.6.26-1-openvz-amd64 hanging
  - From: Vitaliy Gusev <vgusev@openvz.org>

References:
- Bug#513537: linux-image-2.6.26-1-openvz-amd64 hanging
  - From: Tom Rathborne <tomr@tinyplanet.ca>
- Bug#513537: linux-image-2.6.26-1-openvz-amd64 hanging
  - From: Vitaliy Gusev <vgusev@openvz.org>

Prev by Date: Bug#516374: Experiencing this with KVM, too
Next by Date: Bug#518582: linux-image-2.6-iop32x: Please enable Phillips Webcam support(pwc) in the next kernel update for lenny.
Previous by thread: Bug#513537: linux-image-2.6.26-1-openvz-amd64 hanging
Next by thread: Bug#513537: linux-image-2.6.26-1-openvz-amd64 hanging
Index(es):
- Date
- Thread