[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Bug#548397: linux-image-2.6.30-2-686-bigmem: Random Lockup with automount, mysqld, and kswapd0 error messages.



Package: linux-image-2.6.30-2-686-bigmem
Version: 2.6.30-7
Severity: critical
Justification: breaks the whole system


After a semi-random period of normal operation (anywhere from a few hours to a week) the machine will suddenly get a series of page allocation errors followed by a series of "soft lockup - CPU#[X] stuck" messages after which the machine is completely non responsive and has to be hard restarted.

I've seen this occur on two other systems in addition to this one.

Sep 24 11:02:53 kolache kernel: [177179.808484] kswapd0: page allocation failure. order:0, mode:0x20
Sep 24 11:02:53 kolache kernel: [177179.808494] Pid: 222, comm: kswapd0 Not tainted 2.6.30-2-686-bigmem #1
Sep 24 11:02:53 kolache kernel: [177179.808498] Call Trace:
Sep 24 11:02:53 kolache kernel: [177179.808518]  [<c0175783>] ? __alloc_pages_internal+0x385/0x39d
Sep 24 11:02:53 kolache kernel: [177179.808530]  [<c02c83f2>] ? tcp_rcv_established+0x39a/0x4d4
Sep 24 11:02:53 kolache kernel: [177179.808540]  [<c0190f6a>] ? cache_alloc_refill+0x27d/0x483
Sep 24 11:02:53 kolache kernel: [177179.808547]  [<c01911ed>] ? __kmalloc+0x7d/0xed
Sep 24 11:02:53 kolache kernel: [177179.808555]  [<c0295dcd>] ? __alloc_skb+0x46/0x10b
Sep 24 11:02:53 kolache kernel: [177179.808563]  [<c02b766f>] ? ip_local_deliver_finish+0x10c/0x18c
Sep 24 11:02:53 kolache kernel: [177179.808603]  [<c02967c2>] ? __netdev_alloc_skb+0x14/0x2d
Sep 24 11:02:53 kolache kernel: [177179.808625]  [<f8430bc1>] ? e1000_alloc_rx_buffers+0x7b/0x2a8 [e1000]
Sep 24 11:02:53 kolache kernel: [177179.808641]  [<f84311cd>] ? e1000_clean_rx_irq+0x3df/0x409 [e1000]
Sep 24 11:02:53 kolache kernel: [177179.808662]  [<f8433567>] ? e1000_clean+0x295/0x402 [e1000]
Sep 24 11:02:53 kolache kernel: [177179.808678]  [<f84336a2>] ? e1000_clean+0x3d0/0x402 [e1000]
Sep 24 11:02:53 kolache kernel: [177179.808687]  [<c029b7f9>] ? net_rx_action+0x90/0x161
Sep 24 11:02:53 kolache kernel: [177179.808695]  [<c01309b7>] ? __do_softirq+0x8e/0x135
Sep 24 11:02:53 kolache kernel: [177179.808701]  [<c0130a8c>] ? do_softirq+0x2e/0x38
Sep 24 11:02:53 kolache kernel: [177179.808706]  [<c0130b6f>] ? irq_exit+0x26/0x53
Sep 24 11:02:53 kolache kernel: [177179.808714]  [<c0108fc2>] ? do_IRQ+0x65/0x76
Sep 24 11:02:53 kolache kernel: [177179.808720]  [<c0107c09>] ? common_interrupt+0x29/0x30
Sep 24 11:02:53 kolache kernel: [177179.808729]  [<c03296dc>] ? _spin_lock+0xa/0x15
Sep 24 11:02:53 kolache kernel: [177179.808737]  [<c01a062b>] ? __shrink_dcache_sb+0xcf/0x28f
Sep 24 11:02:53 kolache kernel: [177179.808743]  [<c01a08af>] ? shrink_dcache_memory+0xc4/0x144
Sep 24 11:02:53 kolache kernel: [177179.808751]  [<c0179bd4>] ? shrink_slab+0xe6/0x13f
Sep 24 11:02:53 kolache kernel: [177179.808757]  [<c017a002>] ? kswapd+0x3d5/0x53b
Sep 24 11:02:53 kolache kernel: [177179.808763]  [<c0178234>] ? isolate_pages_global+0x0/0x1d0
Sep 24 11:02:53 kolache kernel: [177179.808771]  [<c013c782>] ? autoremove_wake_function+0x0/0x2d
Sep 24 11:02:53 kolache kernel: [177179.808777]  [<c0179c2d>] ? kswapd+0x0/0x53b
Sep 24 11:02:53 kolache kernel: [177179.808782]  [<c013c490>] ? kthread+0x42/0x67
Sep 24 11:02:53 kolache kernel: [177179.808787]  [<c013c44e>] ? kthread+0x0/0x67
Sep 24 11:02:53 kolache kernel: [177179.808792]  [<c0107ff7>] ? kernel_thread_helper+0x7/0x10
Sep 24 11:02:53 kolache kernel: [177179.808796] Mem-Info:
Sep 24 11:02:53 kolache kernel: [177179.808799] DMA per-cpu:
Sep 24 11:02:53 kolache kernel: [177179.808803] CPU    0: hi:    0, btch:   1 usd:   0
Sep 24 11:02:53 kolache kernel: [177179.808807] CPU    1: hi:    0, btch:   1 usd:   0
Sep 24 11:02:53 kolache kernel: [177179.808811] CPU    2: hi:    0, btch:   1 usd:   0
Sep 24 11:02:53 kolache kernel: [177179.808815] CPU    3: hi:    0, btch:   1 usd:   0
Sep 24 11:02:53 kolache kernel: [177179.808818] Normal per-cpu:
Sep 24 11:02:53 kolache kernel: [177179.808821] CPU    0: hi:  186, btch:  31 usd: 165
Sep 24 11:02:53 kolache kernel: [177179.808825] CPU    1: hi:  186, btch:  31 usd: 153
Sep 24 11:02:53 kolache kernel: [177179.808829] CPU    2: hi:  186, btch:  31 usd: 138
Sep 24 11:02:53 kolache kernel: [177179.808833] CPU    3: hi:  186, btch:  31 usd:  86
Sep 24 11:02:53 kolache kernel: [177179.808836] HighMem per-cpu:
Sep 24 11:02:53 kolache kernel: [177179.808840] CPU    0: hi:  186, btch:  31 usd:  11
Sep 24 11:02:53 kolache kernel: [177179.808844] CPU    1: hi:  186, btch:  31 usd:  55
Sep 24 11:02:53 kolache kernel: [177179.808848] CPU    2: hi:  186, btch:  31 usd:   5
Sep 24 11:02:53 kolache kernel: [177179.808852] CPU    3: hi:  186, btch:  31 usd:  55
Sep 24 11:02:53 kolache kernel: [177179.808859] Active_anon:58021 active_file:82347 inactive_anon:19871
Sep 24 11:02:53 kolache kernel: [177179.808861]  inactive_file:546658 unevictable:0 dirty:11549 writeback:0 unstable:0
Sep 24 11:02:53 kolache kernel: [177179.808863]  free:226523 slab:99492 mapped:3630 pagetables:637 bounce:0
Sep 24 11:02:53 kolache kernel: [177179.808871] DMA free:3488kB min:64kB low:80kB high:96kB active_anon:0kB inactive_anon:0kB active_file:6952kB inactive_file:1252kB unevictable:0kB present:15872kB pages_scanned:0 all_unreclaimable? no
Sep 24 11:02:53 kolache kernel: [177179.808876] lowmem_reserve[]: 0 867 4046 4046
Sep 24 11:02:53 kolache kernel: [177179.808887] Normal free:1380kB min:3732kB low:4664kB high:5596kB active_anon:0kB inactive_anon:844kB active_file:224536kB inactive_file:220720kB unevictable:0kB present:887976kB pages_scanned:101 all_unreclaimable? no
Sep 24 11:02:53 kolache kernel: [177179.808893] lowmem_reserve[]: 0 0 25438 25438
Sep 24 11:02:53 kolache kernel: [177179.808904] HighMem free:901224kB min:512kB low:3932kB high:7356kB active_anon:232084kB inactive_anon:78640kB active_file:97900kB inactive_file:1964660kB unevictable:0kB present:3256148kB pages_scanned:0 all_unreclaimable? no
Sep 24 11:02:53 kolache kernel: [177179.808909] lowmem_reserve[]: 0 0 0 0
Sep 24 11:02:53 kolache kernel: [177179.808916] DMA: 26*4kB 15*8kB 16*16kB 8*32kB 3*64kB 4*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 3488kB
Sep 24 11:02:53 kolache kernel: [177179.808934] Normal: 0*4kB 0*8kB 0*16kB 0*32kB 1*64kB 1*128kB 0*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 1216kB
Sep 24 11:02:53 kolache kernel: [177179.808951] HighMem: 173*4kB 130*8kB 37*16kB 16077*32kB 5309*64kB 329*128kB 3*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 900980kB
Sep 24 11:02:53 kolache kernel: [177179.808970] 629155 total pagecache pages
Sep 24 11:02:53 kolache kernel: [177179.808973] 0 pages in swap cache
Sep 24 11:02:53 kolache kernel: [177179.808977] Swap cache stats: add 0, delete 0, find 0/0
Sep 24 11:02:53 kolache kernel: [177179.808980] Free swap  = 4208968kB
Sep 24 11:02:53 kolache kernel: [177179.808983] Total swap = 4208968kB
Sep 24 11:02:53 kolache kernel: [177179.812010] 1081344 pages RAM
Sep 24 11:02:53 kolache kernel: [177179.812010] 853506 pages HighMem
Sep 24 11:02:53 kolache kernel: [177179.812010] 42666 pages reserved
Sep 24 11:02:53 kolache kernel: [177179.812010] 579955 pages shared
Sep 24 11:02:53 kolache kernel: [177179.812010] 246326 pages non-shared
Sep 24 11:02:53 kolache kernel: [177179.839722] kswapd0: page allocation failure. order:0, mode:0x20
Sep 24 11:02:53 kolache kernel: [177179.839729] Pid: 222, comm: kswapd0 Not tainted 2.6.30-2-686-bigmem #1
Sep 24 11:02:53 kolache kernel: [177179.839733] Call Trace:
Sep 24 11:02:53 kolache kernel: [177179.839747]  [<c0175783>] ? __alloc_pages_internal+0x385/0x39d
Sep 24 11:02:53 kolache kernel: [177179.839756]  [<c02c84e0>] ? tcp_rcv_established+0x488/0x4d4
Sep 24 11:02:53 kolache kernel: [177179.839765]  [<c0190f6a>] ? cache_alloc_refill+0x27d/0x483
Sep 24 11:02:53 kolache kernel: [177179.839771]  [<c01911ed>] ? __kmalloc+0x7d/0xed
Sep 24 11:02:53 kolache kernel: [177179.839778]  [<c0295dcd>] ? __alloc_skb+0x46/0x10b
Sep 24 11:02:53 kolache kernel: [177179.839786]  [<c02b766f>] ? ip_local_deliver_finish+0x10c/0x18c
Sep 24 11:02:53 kolache kernel: [177179.839819]  [<c02967c2>] ? __netdev_alloc_skb+0x14/0x2d
Sep 24 11:02:53 kolache kernel: [177179.839837]  [<f8430bc1>] ? e1000_alloc_rx_buffers+0x7b/0x2a8 [e1000]
Sep 24 11:02:53 kolache kernel: [177179.839853]  [<f84311cd>] ? e1000_clean_rx_irq+0x3df/0x409 [e1000]
Sep 24 11:02:53 kolache kernel: [177179.839873]  [<f8433567>] ? e1000_clean+0x295/0x402 [e1000]
Sep 24 11:02:53 kolache kernel: [177179.839885]  [<c01340bb>] ? run_timer_softirq+0x13d/0x19d
Sep 24 11:02:53 kolache kernel: [177179.839893]  [<c029b7f9>] ? net_rx_action+0x90/0x161
Sep 24 11:02:53 kolache kernel: [177179.839899]  [<c01309b7>] ? __do_softirq+0x8e/0x135
Sep 24 11:02:53 kolache kernel: [177179.839905]  [<c0130a8c>] ? do_softirq+0x2e/0x38
Sep 24 11:02:53 kolache kernel: [177179.839910]  [<c0130b6f>] ? irq_exit+0x26/0x53
Sep 24 11:02:53 kolache kernel: [177179.839917]  [<c0108fc2>] ? do_IRQ+0x65/0x76
Sep 24 11:02:53 kolache kernel: [177179.839922]  [<c0107c09>] ? common_interrupt+0x29/0x30
Sep 24 11:02:53 kolache kernel: [177179.839932]  [<c03296dc>] ? _spin_lock+0xa/0x15
Sep 24 11:02:53 kolache kernel: [177179.839939]  [<c01a062b>] ? __shrink_dcache_sb+0xcf/0x28f
Sep 24 11:02:53 kolache kernel: [177179.839945]  [<c01a08af>] ? shrink_dcache_memory+0xc4/0x144
Sep 24 11:02:53 kolache kernel: [177179.839953]  [<c0179bd4>] ? shrink_slab+0xe6/0x13f
Sep 24 11:02:53 kolache kernel: [177179.839959]  [<c017a002>] ? kswapd+0x3d5/0x53b
Sep 24 11:02:53 kolache kernel: [177179.839965]  [<c0178234>] ? isolate_pages_global+0x0/0x1d0
Sep 24 11:02:53 kolache kernel: [177179.839972]  [<c013c782>] ? autoremove_wake_function+0x0/0x2d
Sep 24 11:02:53 kolache kernel: [177179.839978]  [<c0179c2d>] ? kswapd+0x0/0x53b
Sep 24 11:02:53 kolache kernel: [177179.839983]  [<c013c490>] ? kthread+0x42/0x67
Sep 24 11:02:53 kolache kernel: [177179.839988]  [<c013c44e>] ? kthread+0x0/0x67
Sep 24 11:02:53 kolache kernel: [177179.839994]  [<c0107ff7>] ? kernel_thread_helper+0x7/0x10
Sep 24 11:02:53 kolache kernel: [177179.839997] Mem-Info:
Sep 24 11:02:53 kolache kernel: [177179.840001] DMA per-cpu:
Sep 24 11:02:53 kolache kernel: [177179.840005] CPU    0: hi:    0, btch:   1 usd:   0
Sep 24 11:02:53 kolache kernel: [177179.840009] CPU    1: hi:    0, btch:   1 usd:   0
Sep 24 11:02:53 kolache kernel: [177179.840013] CPU    2: hi:    0, btch:   1 usd:   0
Sep 24 11:02:53 kolache kernel: [177179.840017] CPU    3: hi:    0, btch:   1 usd:   0
Sep 24 11:02:53 kolache kernel: [177179.840020] Normal per-cpu:
Sep 24 11:02:53 kolache kernel: [177179.840023] CPU    0: hi:  186, btch:  31 usd: 165
Sep 24 11:02:53 kolache kernel: [177179.840027] CPU    1: hi:  186, btch:  31 usd: 153
Sep 24 11:02:53 kolache kernel: [177179.840031] CPU    2: hi:  186, btch:  31 usd: 138
Sep 24 11:02:53 kolache kernel: [177179.840035] CPU    3: hi:  186, btch:  31 usd:  86
Sep 24 11:02:53 kolache kernel: [177179.840038] HighMem per-cpu:
Sep 24 11:02:53 kolache kernel: [177179.840042] CPU    0: hi:  186, btch:  31 usd:  11
Sep 24 11:02:53 kolache kernel: [177179.840045] CPU    1: hi:  186, btch:  31 usd:  55
Sep 24 11:02:53 kolache kernel: [177179.840049] CPU    2: hi:  186, btch:  31 usd:   5
Sep 24 11:02:53 kolache kernel: [177179.840053] CPU    3: hi:  186, btch:  31 usd:  55
Sep 24 11:02:53 kolache kernel: [177179.840061] Active_anon:58021 active_file:82347 inactive_anon:19871
Sep 24 11:02:53 kolache kernel: [177179.840063]  inactive_file:546658 unevictable:0 dirty:11549 writeback:0 unstable:0
Sep 24 11:02:53 kolache kernel: [177179.840065]  free:226523 slab:99492 mapped:3630 pagetables:637 bounce:0
Sep 24 11:02:53 kolache kernel: [177179.840073] DMA free:3488kB min:64kB low:80kB high:96kB active_anon:0kB inactive_anon:0kB active_file:6952kB inactive_file:1252kB unevictable:0kB present:15872kB pages_scanned:0 all_unreclaimable? no
Sep 24 11:02:53 kolache kernel: [177179.840078] lowmem_reserve[]: 0 867 4046 4046
Sep 24 11:02:53 kolache kernel: [177179.840089] Normal free:1380kB min:3732kB low:4664kB high:5596kB active_anon:0kB inactive_anon:844kB active_file:224536kB inactive_file:220720kB unevictable:0kB present:887976kB pages_scanned:101 all_unreclaimable? no
Sep 24 11:02:53 kolache kernel: [177179.840095] lowmem_reserve[]: 0 0 25438 25438
Sep 24 11:02:53 kolache kernel: [177179.840106] HighMem free:901224kB min:512kB low:3932kB high:7356kB active_anon:232084kB inactive_anon:78640kB active_file:97900kB inactive_file:1964660kB unevictable:0kB present:3256148kB pages_scanned:0 all_unreclaimable? no
Sep 24 11:02:53 kolache kernel: [177179.840111] lowmem_reserve[]: 0 0 0 0
Sep 24 11:02:53 kolache kernel: [177179.840118] DMA: 26*4kB 15*8kB 16*16kB 8*32kB 3*64kB 4*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 3488kB
Sep 24 11:02:53 kolache kernel: [177179.840136] Normal: 0*4kB 0*8kB 0*16kB 0*32kB 1*64kB 1*128kB 0*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 1216kB
Sep 24 11:02:53 kolache kernel: [177179.840154] HighMem: 173*4kB 130*8kB 37*16kB 16077*32kB 5309*64kB 329*128kB 3*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 900980kB
Sep 24 11:02:53 kolache kernel: [177179.840172] 629155 total pagecache pages
Sep 24 11:02:53 kolache kernel: [177179.840176] 0 pages in swap cache
Sep 24 11:02:53 kolache kernel: [177179.840179] Swap cache stats: add 0, delete 0, find 0/0
Sep 24 11:02:53 kolache kernel: [177179.840183] Free swap  = 4208968kB
Sep 24 11:02:53 kolache kernel: [177179.840186] Total swap = 4208968kB
Sep 24 11:02:53 kolache kernel: [177179.843639] 1081344 pages RAM
Sep 24 11:02:53 kolache kernel: [177179.843639] 853506 pages HighMem
Sep 24 11:02:53 kolache kernel: [177179.843639] 42666 pages reserved
Sep 24 11:02:53 kolache kernel: [177179.843639] 579955 pages shared
Sep 24 11:02:53 kolache kernel: [177179.843639] 246326 pages non-shared
Sep 24 11:02:53 kolache kernel: [177179.869463] kswapd0: page allocation failure. order:0, mode:0x20
Sep 24 11:02:53 kolache kernel: [177179.869470] Pid: 222, comm: kswapd0 Not tainted 2.6.30-2-686-bigmem #1
Sep 24 11:02:53 kolache kernel: [177179.869474] Call Trace:
Sep 24 11:02:53 kolache kernel: [177179.869488]  [<c0175783>] ? __alloc_pages_internal+0x385/0x39d
Sep 24 11:02:53 kolache kernel: [177179.869497]  [<c0190f6a>] ? cache_alloc_refill+0x27d/0x483
Sep 24 11:02:53 kolache kernel: [177179.869504]  [<c01911ed>] ? __kmalloc+0x7d/0xed
Sep 24 11:02:53 kolache kernel: [177179.869512]  [<c0295dcd>] ? __alloc_skb+0x46/0x10b
Sep 24 11:02:53 kolache kernel: [177179.869545]  [<c02967c2>] ? __netdev_alloc_skb+0x14/0x2d
Sep 24 11:02:53 kolache kernel: [177179.869564]  [<f8430bc1>] ? e1000_alloc_rx_buffers+0x7b/0x2a8 [e1000]
Sep 24 11:02:53 kolache kernel: [177179.869580]  [<f84311cd>] ? e1000_clean_rx_irq+0x3df/0x409 [e1000]
Sep 24 11:02:53 kolache kernel: [177179.869591]  [<c02c9ca0>] ? tcp_transmit_skb+0x591/0x5c8
Sep 24 11:02:53 kolache kernel: [177179.869607]  [<f8433567>] ? e1000_clean+0x295/0x402 [e1000]
Sep 24 11:02:53 kolache kernel: [177179.869617]  [<c01340bb>] ? run_timer_softirq+0x13d/0x19d
Sep 24 11:02:53 kolache kernel: [177179.869625]  [<c029b7f9>] ? net_rx_action+0x90/0x161
Sep 24 11:02:53 kolache kernel: [177179.869631]  [<c01309b7>] ? __do_softirq+0x8e/0x135
Sep 24 11:02:53 kolache kernel: [177179.869637]  [<c0130a8c>] ? do_softirq+0x2e/0x38
Sep 24 11:02:53 kolache kernel: [177179.869642]  [<c0130b6f>] ? irq_exit+0x26/0x53
Sep 24 11:02:53 kolache kernel: [177179.869649]  [<c0108fc2>] ? do_IRQ+0x65/0x76
Sep 24 11:02:53 kolache kernel: [177179.869655]  [<c0107c09>] ? common_interrupt+0x29/0x30
Sep 24 11:02:53 kolache kernel: [177179.869663]  [<c03296dc>] ? _spin_lock+0xa/0x15
Sep 24 11:02:53 kolache kernel: [177179.869671]  [<c01a062b>] ? __shrink_dcache_sb+0xcf/0x28f
Sep 24 11:02:53 kolache kernel: [177179.869676]  [<c01a08af>] ? shrink_dcache_memory+0xc4/0x144
Sep 24 11:02:53 kolache kernel: [177179.869685]  [<c0179bd4>] ? shrink_slab+0xe6/0x13f
Sep 24 11:02:53 kolache kernel: [177179.869691]  [<c017a002>] ? kswapd+0x3d5/0x53b
Sep 24 11:02:53 kolache kernel: [177179.869698]  [<c0178234>] ? isolate_pages_global+0x0/0x1d0
Sep 24 11:02:53 kolache kernel: [177179.869705]  [<c013c782>] ? autoremove_wake_function+0x0/0x2d
Sep 24 11:02:53 kolache kernel: [177179.869711]  [<c0179c2d>] ? kswapd+0x0/0x53b
Sep 24 11:02:53 kolache kernel: [177179.869716]  [<c013c490>] ? kthread+0x42/0x67
Sep 24 11:02:53 kolache kernel: [177179.869721]  [<c013c44e>] ? kthread+0x0/0x67
Sep 24 11:02:53 kolache kernel: [177179.869726]  [<c0107ff7>] ? kernel_thread_helper+0x7/0x10
Sep 24 11:02:53 kolache kernel: [177179.869730] Mem-Info:
Sep 24 11:02:53 kolache kernel: [177179.869733] DMA per-cpu:
Sep 24 11:02:53 kolache kernel: [177179.869736] CPU    0: hi:    0, btch:   1 usd:   0
Sep 24 11:02:53 kolache kernel: [177179.869740] CPU    1: hi:    0, btch:   1 usd:   0
Sep 24 11:02:53 kolache kernel: [177179.869744] CPU    2: hi:    0, btch:   1 usd:   0
Sep 24 11:02:53 kolache kernel: [177179.869748] CPU    3: hi:    0, btch:   1 usd:   0
Sep 24 11:02:53 kolache kernel: [177179.869751] Normal per-cpu:
Sep 24 11:02:53 kolache kernel: [177179.869754] CPU    0: hi:  186, btch:  31 usd: 165
Sep 24 11:02:53 kolache kernel: [177179.869758] CPU    1: hi:  186, btch:  31 usd: 153
Sep 24 11:02:53 kolache kernel: [177179.869762] CPU    2: hi:  186, btch:  31 usd: 138
Sep 24 11:02:53 kolache kernel: [177179.869766] CPU    3: hi:  186, btch:  31 usd:  86
Sep 24 11:02:53 kolache kernel: [177179.869769] HighMem per-cpu:
Sep 24 11:02:53 kolache kernel: [177179.869773] CPU    0: hi:  186, btch:  31 usd:  11
Sep 24 11:02:53 kolache kernel: [177179.869776] CPU    1: hi:  186, btch:  31 usd:  55
Sep 24 11:02:53 kolache kernel: [177179.869780] CPU    2: hi:  186, btch:  31 usd:   5
Sep 24 11:02:53 kolache kernel: [177179.869784] CPU    3: hi:  186, btch:  31 usd:  55
Sep 24 11:02:53 kolache kernel: [177179.869792] Active_anon:58021 active_file:82347 inactive_anon:19871
Sep 24 11:02:53 kolache kernel: [177179.869794]  inactive_file:546658 unevictable:0 dirty:11549 writeback:0 unstable:0
Sep 24 11:02:53 kolache kernel: [177179.869796]  free:226523 slab:99492 mapped:3630 pagetables:637 bounce:0
Sep 24 11:02:53 kolache kernel: [177179.869804] DMA free:3488kB min:64kB low:80kB high:96kB active_anon:0kB inactive_anon:0kB active_file:6952kB inactive_file:1252kB unevictable:0kB present:15872kB pages_scanned:0 all_unreclaimable? no
Sep 24 11:02:53 kolache kernel: [177179.869809] lowmem_reserve[]: 0 867 4046 4046
Sep 24 11:02:53 kolache kernel: [177179.869820] Normal free:1380kB min:3732kB low:4664kB high:5596kB active_anon:0kB inactive_anon:844kB active_file:224536kB inactive_file:220720kB unevictable:0kB present:887976kB pages_scanned:101 all_unreclaimable? no
Sep 24 11:02:53 kolache kernel: [177179.869825] lowmem_reserve[]: 0 0 25438 25438
Sep 24 11:02:53 kolache kernel: [177179.869836] HighMem free:901224kB min:512kB low:3932kB high:7356kB active_anon:232084kB inactive_anon:78640kB active_file:97900kB inactive_file:1964660kB unevictable:0kB present:3256148kB pages_scanned:0 all_unreclaimable? no
Sep 24 11:02:53 kolache kernel: [177179.869842] lowmem_reserve[]: 0 0 0 0
Sep 24 11:02:53 kolache kernel: [177179.869848] DMA: 26*4kB 15*8kB 16*16kB 8*32kB 3*64kB 4*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 3488kB
Sep 24 11:02:53 kolache kernel: [177179.869866] Normal: 0*4kB 0*8kB 0*16kB 0*32kB 1*64kB 1*128kB 0*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 1216kB
Sep 24 11:02:53 kolache kernel: [177179.869884] HighMem: 173*4kB 130*8kB 37*16kB 16077*32kB 5309*64kB 329*128kB 3*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 900980kB
Sep 24 11:02:53 kolache kernel: [177179.869903] 629155 total pagecache pages
Sep 24 11:02:53 kolache kernel: [177179.869907] 0 pages in swap cache
Sep 24 11:02:53 kolache kernel: [177179.869911] Swap cache stats: add 0, delete 0, find 0/0
Sep 24 11:02:53 kolache kernel: [177179.869915] Free swap  = 4208968kB
Sep 24 11:02:53 kolache kernel: [177179.869918] Total swap = 4208968kB
Sep 24 11:02:53 kolache kernel: [177179.873409] 1081344 pages RAM
Sep 24 11:02:53 kolache kernel: [177179.873409] 853506 pages HighMem
Sep 24 11:02:53 kolache kernel: [177179.873409] 42666 pages reserved
Sep 24 11:02:53 kolache kernel: [177179.873409] 579955 pages shared
Sep 24 11:02:53 kolache kernel: [177179.873409] 246326 pages non-shared
Sep 24 11:02:53 kolache kernel: [177179.899310] kswapd0: page allocation failure. order:0, mode:0x20
Sep 24 11:02:53 kolache kernel: [177179.899317] Pid: 222, comm: kswapd0 Not tainted 2.6.30-2-686-bigmem #1
Sep 24 11:02:53 kolache kernel: [177179.899321] Call Trace:
Sep 24 11:02:53 kolache kernel: [177179.899334]  [<c0175783>] ? __alloc_pages_internal+0x385/0x39d
Sep 24 11:02:53 kolache kernel: [177179.899344]  [<c02c83f2>] ? tcp_rcv_established+0x39a/0x4d4
Sep 24 11:02:53 kolache kernel: [177179.899352]  [<c0190f6a>] ? cache_alloc_refill+0x27d/0x483
Sep 24 11:02:53 kolache kernel: [177179.899358]  [<c01911ed>] ? __kmalloc+0x7d/0xed
Sep 24 11:02:53 kolache kernel: [177179.899365]  [<c0295dcd>] ? __alloc_skb+0x46/0x10b
Sep 24 11:02:53 kolache kernel: [177179.899373]  [<c02b766f>] ? ip_local_deliver_finish+0x10c/0x18c
Sep 24 11:02:53 kolache kernel: [177179.899406]  [<c02967c2>] ? __netdev_alloc_skb+0x14/0x2d
Sep 24 11:02:53 kolache kernel: [177179.899425]  [<f8430bc1>] ? e1000_alloc_rx_buffers+0x7b/0x2a8 [e1000]
Sep 24 11:02:53 kolache kernel: [177179.899440]  [<f84311cd>] ? e1000_clean_rx_irq+0x3df/0x409 [e1000]
Sep 24 11:02:53 kolache kernel: [177179.899461]  [<f8433567>] ? e1000_clean+0x295/0x402 [e1000]
Sep 24 11:02:53 kolache kernel: [177179.899472]  [<c01340bb>] ? run_timer_softirq+0x13d/0x19d
Sep 24 11:02:53 kolache kernel: [177179.899480]  [<c029b7f9>] ? net_rx_action+0x90/0x161
Sep 24 11:02:53 kolache kernel: [177179.899486]  [<c01309b7>] ? __do_softirq+0x8e/0x135
Sep 24 11:02:53 kolache kernel: [177179.899491]  [<c0130a8c>] ? do_softirq+0x2e/0x38
Sep 24 11:02:53 kolache kernel: [177179.899497]  [<c0130b6f>] ? irq_exit+0x26/0x53
Sep 24 11:02:53 kolache kernel: [177179.899504]  [<c0108fc2>] ? do_IRQ+0x65/0x76
Sep 24 11:02:53 kolache kernel: [177179.899509]  [<c0107c09>] ? common_interrupt+0x29/0x30
Sep 24 11:02:53 kolache kernel: [177179.899517]  [<c03296dc>] ? _spin_lock+0xa/0x15
Sep 24 11:02:53 kolache kernel: [177179.899524]  [<c01a062b>] ? __shrink_dcache_sb+0xcf/0x28f
Sep 24 11:02:53 kolache kernel: [177179.899530]  [<c01a08af>] ? shrink_dcache_memory+0xc4/0x144
Sep 24 11:02:53 kolache kernel: [177179.899538]  [<c0179bd4>] ? shrink_slab+0xe6/0x13f
Sep 24 11:02:53 kolache kernel: [177179.899543]  [<c017a002>] ? kswapd+0x3d5/0x53b
Sep 24 11:02:53 kolache kernel: [177179.899550]  [<c0178234>] ? isolate_pages_global+0x0/0x1d0
Sep 24 11:02:53 kolache kernel: [177179.899556]  [<c013c782>] ? autoremove_wake_function+0x0/0x2d
Sep 24 11:02:53 kolache kernel: [177179.899562]  [<c0179c2d>] ? kswapd+0x0/0x53b
Sep 24 11:02:53 kolache kernel: [177179.899567]  [<c013c490>] ? kthread+0x42/0x67
Sep 24 11:02:53 kolache kernel: [177179.899572]  [<c013c44e>] ? kthread+0x0/0x67
Sep 24 11:02:53 kolache kernel: [177179.899577]  [<c0107ff7>] ? kernel_thread_helper+0x7/0x10
Sep 24 11:02:53 kolache kernel: [177179.899580] Mem-Info:
Sep 24 11:02:53 kolache kernel: [177179.899584] DMA per-cpu:
Sep 24 11:02:53 kolache kernel: [177179.899587] CPU    0: hi:    0, btch:   1 usd:   0
Sep 24 11:02:53 kolache kernel: [177179.899591] CPU    1: hi:    0, btch:   1 usd:   0
Sep 24 11:02:53 kolache kernel: [177179.899595] CPU    2: hi:    0, btch:   1 usd:   0
Sep 24 11:02:53 kolache kernel: [177179.899599] CPU    3: hi:    0, btch:   1 usd:   0
Sep 24 11:02:53 kolache kernel: [177179.899602] Normal per-cpu:
Sep 24 11:02:53 kolache kernel: [177179.899605] CPU    0: hi:  186, btch:  31 usd: 165
Sep 24 11:02:53 kolache kernel: [177179.899609] CPU    1: hi:  186, btch:  31 usd: 153
Sep 24 11:02:53 kolache kernel: [177179.899613] CPU    2: hi:  186, btch:  31 usd: 138
Sep 24 11:02:53 kolache kernel: [177179.899617] CPU    3: hi:  186, btch:  31 usd:  86
Sep 24 11:02:53 kolache kernel: [177179.899620] HighMem per-cpu:
Sep 24 11:02:53 kolache kernel: [177179.899624] CPU    0: hi:  186, btch:  31 usd:  11
Sep 24 11:02:53 kolache kernel: [177179.899627] CPU    1: hi:  186, btch:  31 usd:  55
Sep 24 11:02:53 kolache kernel: [177179.899631] CPU    2: hi:  186, btch:  31 usd:   5
Sep 24 11:02:53 kolache kernel: [177179.899635] CPU    3: hi:  186, btch:  31 usd:  55
Sep 24 11:02:53 kolache kernel: [177179.899642] Active_anon:58021 active_file:82347 inactive_anon:19871
Sep 24 11:02:53 kolache kernel: [177179.899644]  inactive_file:546658 unevictable:0 dirty:11549 writeback:0 unstable:0
Sep 24 11:02:53 kolache kernel: [177179.899647]  free:226523 slab:99492 mapped:3630 pagetables:637 bounce:0
Sep 24 11:02:53 kolache kernel: [177179.899654] DMA free:3488kB min:64kB low:80kB high:96kB active_anon:0kB inactive_anon:0kB active_file:6952kB inactive_file:1252kB unevictable:0kB present:15872kB pages_scanned:0 all_unreclaimable? no
Sep 24 11:02:53 kolache kernel: [177179.899659] lowmem_reserve[]: 0 867 4046 4046
Sep 24 11:02:53 kolache kernel: [177179.899670] Normal free:1380kB min:3732kB low:4664kB high:5596kB active_anon:0kB inactive_anon:844kB active_file:224536kB inactive_file:220720kB unevictable:0kB present:887976kB pages_scanned:101 all_unreclaimable? no
Sep 24 11:02:53 kolache kernel: [177179.899675] lowmem_reserve[]: 0 0 25438 25438
Sep 24 11:02:53 kolache kernel: [177179.899686] HighMem free:901224kB min:512kB low:3932kB high:7356kB active_anon:232084kB inactive_anon:78640kB active_file:97900kB inactive_file:1964660kB unevictable:0kB present:3256148kB pages_scanned:0 all_unreclaimable? no
Sep 24 11:02:53 kolache kernel: [177179.899691] lowmem_reserve[]: 0 0 0 0
Sep 24 11:02:53 kolache kernel: [177179.899698] DMA: 26*4kB 15*8kB 16*16kB 8*32kB 3*64kB 4*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 3488kB
Sep 24 11:02:53 kolache kernel: [177179.899716] Normal: 0*4kB 0*8kB 0*16kB 0*32kB 1*64kB 1*128kB 0*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 1216kB
Sep 24 11:02:53 kolache kernel: [177179.899733] HighMem: 173*4kB 130*8kB 37*16kB 16077*32kB 5309*64kB 329*128kB 3*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 900980kB
Sep 24 11:02:53 kolache kernel: [177179.899752] 629155 total pagecache pages
Sep 24 11:02:53 kolache kernel: [177179.899755] 0 pages in swap cache
Sep 24 11:02:53 kolache kernel: [177179.899759] Swap cache stats: add 0, delete 0, find 0/0
Sep 24 11:02:53 kolache kernel: [177179.899762] Free swap  = 4208968kB
Sep 24 11:02:53 kolache kernel: [177179.899765] Total swap = 4208968kB
Sep 24 11:02:53 kolache kernel: [177179.903226] 1081344 pages RAM
Sep 24 11:02:53 kolache kernel: [177179.903226] 853506 pages HighMem
Sep 24 11:02:53 kolache kernel: [177179.903226] 42666 pages reserved
Sep 24 11:02:53 kolache kernel: [177179.903226] 579955 pages shared
Sep 24 11:02:53 kolache kernel: [177179.903226] 246326 pages non-shared
Sep 24 11:02:53 kolache kernel: [177179.936535] kswapd0: page allocation failure. order:0, mode:0x20
Sep 24 11:02:53 kolache kernel: [177179.936543] Pid: 222, comm: kswapd0 Not tainted 2.6.30-2-686-bigmem #1
Sep 24 11:02:53 kolache kernel: [177179.936547] Call Trace:
Sep 24 11:02:53 kolache kernel: [177179.936560]  [<c0175783>] ? __alloc_pages_internal+0x385/0x39d
Sep 24 11:02:53 kolache kernel: [177179.936570]  [<c02c84e0>] ? tcp_rcv_established+0x488/0x4d4
Sep 24 11:02:53 kolache kernel: [177179.936579]  [<c0190f6a>] ? cache_alloc_refill+0x27d/0x483
Sep 24 11:02:53 kolache kernel: [177179.936585]  [<c01911ed>] ? __kmalloc+0x7d/0xed
Sep 24 11:02:53 kolache kernel: [177179.936593]  [<c0295dcd>] ? __alloc_skb+0x46/0x10b
Sep 24 11:02:53 kolache kernel: [177179.936602]  [<c02b766f>] ? ip_local_deliver_finish+0x10c/0x18c
Sep 24 11:02:53 kolache kernel: [177179.936634]  [<c02967c2>] ? __netdev_alloc_skb+0x14/0x2d
Sep 24 11:02:53 kolache kernel: [177179.936653]  [<f8430bc1>] ? e1000_alloc_rx_buffers+0x7b/0x2a8 [e1000]
Sep 24 11:02:53 kolache kernel: [177179.936669]  [<f84311cd>] ? e1000_clean_rx_irq+0x3df/0x409 [e1000]
Sep 24 11:02:53 kolache kernel: [177179.936689]  [<f8433567>] ? e1000_clean+0x295/0x402 [e1000]
Sep 24 11:02:53 kolache kernel: [177179.936698]  [<c01340bb>] ? run_timer_softirq+0x13d/0x19d
Sep 24 11:02:53 kolache kernel: [177179.936706]  [<c029b7f9>] ? net_rx_action+0x90/0x161
Sep 24 11:02:53 kolache kernel: [177179.936713]  [<c01309b7>] ? __do_softirq+0x8e/0x135
Sep 24 11:02:53 kolache kernel: [177179.936718]  [<c0130a8c>] ? do_softirq+0x2e/0x38
Sep 24 11:02:53 kolache kernel: [177179.936723]  [<c0130b6f>] ? irq_exit+0x26/0x53
Sep 24 11:02:53 kolache kernel: [177179.936730]  [<c0108fc2>] ? do_IRQ+0x65/0x76
Sep 24 11:02:53 kolache kernel: [177179.936736]  [<c0107c09>] ? common_interrupt+0x29/0x30
Sep 24 11:02:53 kolache kernel: [177179.936745]  [<c03296dc>] ? _spin_lock+0xa/0x15
Sep 24 11:02:53 kolache kernel: [177179.936751]  [<c01a062b>] ? __shrink_dcache_sb+0xcf/0x28f
Sep 24 11:02:53 kolache kernel: [177179.936757]  [<c01a08af>] ? shrink_dcache_memory+0xc4/0x144
Sep 24 11:02:53 kolache kernel: [177179.936765]  [<c0179bd4>] ? shrink_slab+0xe6/0x13f
Sep 24 11:02:53 kolache kernel: [177179.936771]  [<c017a002>] ? kswapd+0x3d5/0x53b
Sep 24 11:02:53 kolache kernel: [177179.936777]  [<c0178234>] ? isolate_pages_global+0x0/0x1d0
Sep 24 11:02:53 kolache kernel: [177179.936784]  [<c013c782>] ? autoremove_wake_function+0x0/0x2d
Sep 24 11:02:53 kolache kernel: [177179.936790]  [<c0179c2d>] ? kswapd+0x0/0x53b
Sep 24 11:02:53 kolache kernel: [177179.936795]  [<c013c490>] ? kthread+0x42/0x67
Sep 24 11:02:53 kolache kernel: [177179.936800]  [<c013c44e>] ? kthread+0x0/0x67
Sep 24 11:02:53 kolache kernel: [177179.936805]  [<c0107ff7>] ? kernel_thread_helper+0x7/0x10
Sep 24 11:02:53 kolache kernel: [177179.936808] Mem-Info:
Sep 24 11:02:53 kolache kernel: [177179.936812] DMA per-cpu:
Sep 24 11:02:53 kolache kernel: [177179.936816] CPU    0: hi:    0, btch:   1 usd:   0
Sep 24 11:02:53 kolache kernel: [177179.936819] CPU    1: hi:    0, btch:   1 usd:   0
Sep 24 11:02:53 kolache kernel: [177179.936823] CPU    2: hi:    0, btch:   1 usd:   0
Sep 24 11:02:53 kolache kernel: [177179.936827] CPU    3: hi:    0, btch:   1 usd:   0
Sep 24 11:02:53 kolache kernel: [177179.936830] Normal per-cpu:
Sep 24 11:02:53 kolache kernel: [177179.936834] CPU    0: hi:  186, btch:  31 usd: 165
Sep 24 11:02:53 kolache kernel: [177179.936838] CPU    1: hi:  186, btch:  31 usd: 153
Sep 24 11:02:53 kolache kernel: [177179.936841] CPU    2: hi:  186, btch:  31 usd: 138
Sep 24 11:02:53 kolache kernel: [177179.936845] CPU    3: hi:  186, btch:  31 usd:  86
Sep 24 11:02:53 kolache kernel: [177179.936848] HighMem per-cpu:
Sep 24 11:02:53 kolache kernel: [177179.936852] CPU    0: hi:  186, btch:  31 usd:  11
Sep 24 11:02:53 kolache kernel: [177179.936856] CPU    1: hi:  186, btch:  31 usd:  55
Sep 24 11:02:53 kolache kernel: [177179.936860] CPU    2: hi:  186, btch:  31 usd:   5
Sep 24 11:02:53 kolache kernel: [177179.936863] CPU    3: hi:  186, btch:  31 usd:  55
Sep 24 11:02:53 kolache kernel: [177179.936871] Active_anon:58021 active_file:82347 inactive_anon:19871
Sep 24 11:02:53 kolache kernel: [177179.936873]  inactive_file:546658 unevictable:0 dirty:11549 writeback:0 unstable:0
Sep 24 11:02:53 kolache kernel: [177179.936875]  free:226523 slab:99492 mapped:3630 pagetables:637 bounce:0
Sep 24 11:02:53 kolache kernel: [177179.936882] DMA free:3488kB min:64kB low:80kB high:96kB active_anon:0kB inactive_anon:0kB active_file:6952kB inactive_file:1252kB unevictable:0kB present:15872kB pages_scanned:0 all_unreclaimable? no
Sep 24 11:02:53 kolache kernel: [177179.936887] lowmem_reserve[]: 0 867 4046 4046
Sep 24 11:02:53 kolache kernel: [177179.936899] Normal free:1380kB min:3732kB low:4664kB high:5596kB active_anon:0kB inactive_anon:844kB active_file:224536kB inactive_file:220720kB unevictable:0kB present:887976kB pages_scanned:101 all_unreclaimable? no
Sep 24 11:02:53 kolache kernel: [177179.936904] lowmem_reserve[]: 0 0 25438 25438
Sep 24 11:02:53 kolache kernel: [177179.936915] HighMem free:901224kB min:512kB low:3932kB high:7356kB active_anon:232084kB inactive_anon:78640kB active_file:97900kB inactive_file:1964660kB unevictable:0kB present:3256148kB pages_scanned:0 all_unreclaimable? no
Sep 24 11:02:53 kolache kernel: [177179.936920] lowmem_reserve[]: 0 0 0 0
Sep 24 11:02:53 kolache kernel: [177179.936927] DMA: 26*4kB 15*8kB 16*16kB 8*32kB 3*64kB 4*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 3488kB
Sep 24 11:02:53 kolache kernel: [177179.936945] Normal: 0*4kB 0*8kB 0*16kB 0*32kB 1*64kB 1*128kB 0*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 1216kB
Sep 24 11:02:53 kolache kernel: [177179.936962] HighMem: 173*4kB 130*8kB 37*16kB 16077*32kB 5309*64kB 329*128kB 3*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 900980kB
Sep 24 11:02:53 kolache kernel: [177179.936981] 629155 total pagecache pages
Sep 24 11:02:53 kolache kernel: [177179.936984] 0 pages in swap cache
Sep 24 11:02:53 kolache kernel: [177179.936988] Swap cache stats: add 0, delete 0, find 0/0
Sep 24 11:02:53 kolache kernel: [177179.936991] Free swap  = 4208968kB
Sep 24 11:02:53 kolache kernel: [177179.936994] Total swap = 4208968kB
Sep 24 11:02:53 kolache kernel: [177179.940456] 1081344 pages RAM
Sep 24 11:02:53 kolache kernel: [177179.940456] 853506 pages HighMem
Sep 24 11:02:53 kolache kernel: [177179.940456] 42666 pages reserved
Sep 24 11:02:53 kolache kernel: [177179.940456] 579955 pages shared
Sep 24 11:02:53 kolache kernel: [177179.940456] 246326 pages non-shared
Sep 24 11:02:53 kolache kernel: [177179.966915] kswapd0: page allocation failure. order:0, mode:0x20
Sep 24 11:02:53 kolache kernel: [177179.966922] Pid: 222, comm: kswapd0 Not tainted 2.6.30-2-686-bigmem #1
Sep 24 11:02:53 kolache kernel: [177179.966926] Call Trace:
Sep 24 11:02:53 kolache kernel: [177179.966939]  [<c0175783>] ? __alloc_pages_internal+0x385/0x39d
Sep 24 11:02:53 kolache kernel: [177179.966949]  [<c02c84e0>] ? tcp_rcv_established+0x488/0x4d4
Sep 24 11:02:53 kolache kernel: [177179.966958]  [<c0190f6a>] ? cache_alloc_refill+0x27d/0x483
Sep 24 11:02:53 kolache kernel: [177179.966964]  [<c01911ed>] ? __kmalloc+0x7d/0xed
Sep 24 11:02:53 kolache kernel: [177179.966972]  [<c0295dcd>] ? __alloc_skb+0x46/0x10b
Sep 24 11:02:53 kolache kernel: [177179.966979]  [<c02b766f>] ? ip_local_deliver_finish+0x10c/0x18c
Sep 24 11:02:53 kolache kernel: [177179.967011]  [<c02967c2>] ? __netdev_alloc_skb+0x14/0x2d
Sep 24 11:02:53 kolache kernel: [177179.967030]  [<f8430bc1>] ? e1000_alloc_rx_buffers+0x7b/0x2a8 [e1000]
Sep 24 11:02:53 kolache kernel: [177179.967045]  [<f84311cd>] ? e1000_clean_rx_irq+0x3df/0x409 [e1000]
Sep 24 11:02:53 kolache kernel: [177179.967065]  [<f8433567>] ? e1000_clean+0x295/0x402 [e1000]
Sep 24 11:02:53 kolache kernel: [177179.967076]  [<c029b7f9>] ? net_rx_action+0x90/0x161
Sep 24 11:02:53 kolache kernel: [177179.967084]  [<c01309b7>] ? __do_softirq+0x8e/0x135
Sep 24 11:02:53 kolache kernel: [177179.967089]  [<c0130a8c>] ? do_softirq+0x2e/0x38
Sep 24 11:02:53 kolache kernel: [177179.967095]  [<c0130b6f>] ? irq_exit+0x26/0x53
Sep 24 11:02:53 kolache kernel: [177179.967102]  [<c0108fc2>] ? do_IRQ+0x65/0x76
Sep 24 11:02:53 kolache kernel: [177179.967107]  [<c0107c09>] ? common_interrupt+0x29/0x30
Sep 24 11:02:53 kolache kernel: [177179.967116]  [<c03296dc>] ? _spin_lock+0xa/0x15
Sep 24 11:02:53 kolache kernel: [177179.967123]  [<c01a062b>] ? __shrink_dcache_sb+0xcf/0x28f
Sep 24 11:02:53 kolache kernel: [177179.967129]  [<c01a08af>] ? shrink_dcache_memory+0xc4/0x144
Sep 24 11:02:53 kolache kernel: [177179.967137]  [<c0179bd4>] ? shrink_slab+0xe6/0x13f
Sep 24 11:02:53 kolache kernel: [177179.967142]  [<c017a002>] ? kswapd+0x3d5/0x53b
Sep 24 11:02:53 kolache kernel: [177179.967149]  [<c0178234>] ? isolate_pages_global+0x0/0x1d0
Sep 24 11:02:53 kolache kernel: [177179.967156]  [<c013c782>] ? autoremove_wake_function+0x0/0x2d
Sep 24 11:02:53 kolache kernel: [177179.967162]  [<c0179c2d>] ? kswapd+0x0/0x53b
Sep 24 11:02:53 kolache kernel: [177179.967167]  [<c013c490>] ? kthread+0x42/0x67
Sep 24 11:02:53 kolache kernel: [177179.967172]  [<c013c44e>] ? kthread+0x0/0x67
Sep 24 11:02:53 kolache kernel: [177179.967177]  [<c0107ff7>] ? kernel_thread_helper+0x7/0x10
Sep 24 11:02:53 kolache kernel: [177179.967181] Mem-Info:
Sep 24 11:02:53 kolache kernel: [177179.967184] DMA per-cpu:
Sep 24 11:02:53 kolache kernel: [177179.967188] CPU    0: hi:    0, btch:   1 usd:   0
Sep 24 11:02:53 kolache kernel: [177179.967192] CPU    1: hi:    0, btch:   1 usd:   0
Sep 24 11:02:53 kolache kernel: [177179.967196] CPU    2: hi:    0, btch:   1 usd:   0
Sep 24 11:02:53 kolache kernel: [177179.967199] CPU    3: hi:    0, btch:   1 usd:   0
Sep 24 11:02:53 kolache kernel: [177179.967202] Normal per-cpu:
Sep 24 11:02:53 kolache kernel: [177179.967206] CPU    0: hi:  186, btch:  31 usd: 165
Sep 24 11:02:53 kolache kernel: [177179.967210] CPU    1: hi:  186, btch:  31 usd: 153
Sep 24 11:02:53 kolache kernel: [177179.967214] CPU    2: hi:  186, btch:  31 usd: 138
Sep 24 11:02:53 kolache kernel: [177179.967218] CPU    3: hi:  186, btch:  31 usd:  86
Sep 24 11:02:53 kolache kernel: [177179.967221] HighMem per-cpu:
Sep 24 11:02:53 kolache kernel: [177179.967225] CPU    0: hi:  186, btch:  31 usd:  11
Sep 24 11:02:53 kolache kernel: [177179.967229] CPU    1: hi:  186, btch:  31 usd:  55
Sep 24 11:02:53 kolache kernel: [177179.967233] CPU    2: hi:  186, btch:  31 usd:   5
Sep 24 11:02:53 kolache kernel: [177179.967237] CPU    3: hi:  186, btch:  31 usd:  55
Sep 24 11:02:53 kolache kernel: [177179.967244] Active_anon:58021 active_file:82347 inactive_anon:19871
Sep 24 11:02:53 kolache kernel: [177179.967246]  inactive_file:546658 unevictable:0 dirty:11549 writeback:0 unstable:0
Sep 24 11:02:53 kolache kernel: [177179.967248]  free:226523 slab:99492 mapped:3630 pagetables:637 bounce:0
Sep 24 11:02:53 kolache kernel: [177179.967256] DMA free:3488kB min:64kB low:80kB high:96kB active_anon:0kB inactive_anon:0kB active_file:6952kB inactive_file:1252kB unevictable:0kB present:15872kB pages_scanned:0 all_unreclaimable? no
Sep 24 11:02:53 kolache kernel: [177179.967261] lowmem_reserve[]: 0 867 4046 4046
Sep 24 11:02:53 kolache kernel: [177179.967272] Normal free:1380kB min:3732kB low:4664kB high:5596kB active_anon:0kB inactive_anon:844kB active_file:224536kB inactive_file:220720kB unevictable:0kB present:887976kB pages_scanned:101 all_unreclaimable? no
Sep 24 11:02:53 kolache kernel: [177179.967277] lowmem_reserve[]: 0 0 25438 25438
Sep 24 11:02:53 kolache kernel: [177179.967288] HighMem free:901224kB min:512kB low:3932kB high:7356kB active_anon:232084kB inactive_anon:78640kB active_file:97900kB inactive_file:1964660kB unevictable:0kB present:3256148kB pages_scanned:0 all_unreclaimable? no
Sep 24 11:02:53 kolache kernel: [177179.967294] lowmem_reserve[]: 0 0 0 0
Sep 24 11:02:53 kolache kernel: [177179.967301] DMA: 26*4kB 15*8kB 16*16kB 8*32kB 3*64kB 4*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 3488kB
Sep 24 11:02:53 kolache kernel: [177179.967318] Normal: 0*4kB 0*8kB 0*16kB 0*32kB 1*64kB 1*128kB 0*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 1216kB
Sep 24 11:02:53 kolache kernel: [177179.967335] HighMem: 173*4kB 130*8kB 37*16kB 16077*32kB 5309*64kB 329*128kB 3*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 900980kB
Sep 24 11:02:53 kolache kernel: [177179.967354] 629155 total pagecache pages
Sep 24 11:02:53 kolache kernel: [177179.967357] 0 pages in swap cache
Sep 24 11:02:53 kolache kernel: [177179.967361] Swap cache stats: add 0, delete 0, find 0/0
Sep 24 11:02:53 kolache kernel: [177179.967364] Free swap  = 4208968kB
Sep 24 11:02:53 kolache kernel: [177179.967367] Total swap = 4208968kB
Sep 24 11:02:53 kolache kernel: [177179.970857] 1081344 pages RAM
Sep 24 11:02:53 kolache kernel: [177179.970857] 853506 pages HighMem
Sep 24 11:02:53 kolache kernel: [177179.970857] 42666 pages reserved
Sep 24 11:02:53 kolache kernel: [177179.970857] 579955 pages shared
Sep 24 11:02:53 kolache kernel: [177179.970857] 246326 pages non-shared
Sep 24 11:02:53 kolache kernel: [177179.998059] nfsd: page allocation failure. order:0, mode:0x20
Sep 24 11:02:53 kolache kernel: [177179.998071] Pid: 3035, comm: nfsd Not tainted 2.6.30-2-686-bigmem #1
Sep 24 11:02:53 kolache kernel: [177179.998079] Call Trace:
Sep 24 11:02:53 kolache kernel: [177179.998110]  [<c0175783>] ? __alloc_pages_internal+0x385/0x39d
Sep 24 11:02:53 kolache kernel: [177179.998128]  [<c0190f6a>] ? cache_alloc_refill+0x27d/0x483
Sep 24 11:02:53 kolache kernel: [177179.998135]  [<c01911ed>] ? __kmalloc+0x7d/0xed
Sep 24 11:02:53 kolache kernel: [177179.998146]  [<c0295dcd>] ? __alloc_skb+0x46/0x10b
Sep 24 11:02:53 kolache kernel: [177179.998223]  [<c02967c2>] ? __netdev_alloc_skb+0x14/0x2d
Sep 24 11:02:53 kolache kernel: [177179.998283]  [<f8430bc1>] ? e1000_alloc_rx_buffers+0x7b/0x2a8 [e1000]
Sep 24 11:02:53 kolache kernel: [177179.998307]  [<f84311cd>] ? e1000_clean_rx_irq+0x3df/0x409 [e1000]
Sep 24 11:02:53 kolache kernel: [177179.998325]  [<c0291c14>] ? lock_sock_nested+0x87/0x8f
Sep 24 11:02:53 kolache kernel: [177179.998343]  [<c0329786>] ? _spin_lock_bh+0x8/0x1e
Sep 24 11:02:53 kolache kernel: [177179.998372]  [<f8433567>] ? e1000_clean+0x295/0x402 [e1000]
Sep 24 11:02:53 kolache kernel: [177179.998392]  [<c029b7f9>] ? net_rx_action+0x90/0x161
Sep 24 11:02:53 kolache kernel: [177179.998410]  [<c01309b7>] ? __do_softirq+0x8e/0x135
Sep 24 11:02:53 kolache kernel: [177179.998418]  [<c0130a8c>] ? do_softirq+0x2e/0x38
Sep 24 11:02:53 kolache kernel: [177179.998428]  [<c0130b6f>] ? irq_exit+0x26/0x53
Sep 24 11:02:53 kolache kernel: [177179.998442]  [<c0108fc2>] ? do_IRQ+0x65/0x76
Sep 24 11:02:53 kolache kernel: [177179.998449]  [<c0107c09>] ? common_interrupt+0x29/0x30
Sep 24 11:02:53 kolache kernel: [177179.998466]  [<c012904b>] ? finish_task_switch+0x36/0xae
Sep 24 11:02:53 kolache kernel: [177179.998476]  [<c0328469>] ? __schedule+0x6ec/0x746
Sep 24 11:02:53 kolache kernel: [177179.998487]  [<c028faee>] ? kernel_recvmsg+0x2b/0x3a
Sep 24 11:02:53 kolache kernel: [177179.998496]  [<c03284c8>] ? schedule+0x5/0x13
Sep 24 11:02:53 kolache kernel: [177179.998503]  [<c0328680>] ? schedule_timeout+0xa1/0xbd
Sep 24 11:02:53 kolache kernel: [177179.998519]  [<c0134471>] ? process_timeout+0x0/0x5
Sep 24 11:02:53 kolache kernel: [177179.998526]  [<c032867b>] ? schedule_timeout+0x9c/0xbd
Sep 24 11:02:53 kolache kernel: [177179.998642]  [<f8d7321f>] ? svc_recv+0x2c8/0x689 [sunrpc]
Sep 24 11:02:53 kolache kernel: [177179.998655]  [<c01277d1>] ? default_wake_function+0x0/0x8
Sep 24 11:02:53 kolache kernel: [177179.998710]  [<f8ebd694>] ? nfsd+0x9b/0x11d [nfsd]
Sep 24 11:02:53 kolache kernel: [177179.998732]  [<f8ebd5f9>] ? nfsd+0x0/0x11d [nfsd]
Sep 24 11:02:53 kolache kernel: [177179.998742]  [<c013c490>] ? kthread+0x42/0x67
Sep 24 11:02:53 kolache kernel: [177179.998751]  [<c013c44e>] ? kthread+0x0/0x67
Sep 24 11:02:53 kolache kernel: [177179.998760]  [<c0107ff7>] ? kernel_thread_helper+0x7/0x10
Sep 24 11:02:53 kolache kernel: [177179.998767] Mem-Info:
Sep 24 11:02:53 kolache kernel: [177179.998773] DMA per-cpu:
Sep 24 11:02:53 kolache kernel: [177179.998781] CPU    0: hi:    0, btch:   1 usd:   0
Sep 24 11:02:53 kolache kernel: [177179.998786] CPU    1: hi:    0, btch:   1 usd:   0
Sep 24 11:02:53 kolache kernel: [177179.998794] CPU    2: hi:    0, btch:   1 usd:   0
Sep 24 11:02:53 kolache kernel: [177179.998798] CPU    3: hi:    0, btch:   1 usd:   0
Sep 24 11:02:53 kolache kernel: [177179.998803] Normal per-cpu:
Sep 24 11:02:53 kolache kernel: [177179.998809] CPU    0: hi:  186, btch:  31 usd: 165
Sep 24 11:02:53 kolache kernel: [177179.998815] CPU    1: hi:  186, btch:  31 usd: 155
Sep 24 11:02:53 kolache kernel: [177179.998820] CPU    2: hi:  186, btch:  31 usd: 138
Sep 24 11:02:53 kolache kernel: [177179.998827] CPU    3: hi:  186, btch:  31 usd:  90
Sep 24 11:02:53 kolache kernel: [177179.998832] HighMem per-cpu:
Sep 24 11:02:53 kolache kernel: [177179.998838] CPU    0: hi:  186, btch:  31 usd:  11
Sep 24 11:02:53 kolache kernel: [177179.998843] CPU    1: hi:  186, btch:  31 usd:  55
Sep 24 11:02:53 kolache kernel: [177179.998849] CPU    2: hi:  186, btch:  31 usd:   5
Sep 24 11:02:53 kolache kernel: [177179.998856] CPU    3: hi:  186, btch:  31 usd:  55
Sep 24 11:02:53 kolache kernel: [177179.998866] Active_anon:58021 active_file:82320 inactive_anon:19871
Sep 24 11:02:53 kolache kernel: [177179.998868]  inactive_file:546648 unevictable:0 dirty:11549 writeback:0 unstable:0
Sep 24 11:02:53 kolache kernel: [177179.998872]  free:226549 slab:99509 mapped:3630 pagetables:637 bounce:0
Sep 24 11:02:53 kolache kernel: [177179.998883] DMA free:3488kB min:64kB low:80kB high:96kB active_anon:0kB inactive_anon:0kB active_file:6952kB inactive_file:1252kB unevictable:0kB present:15872kB pages_scanned:0 all_unreclaimable? no
Sep 24 11:02:53 kolache kernel: [177179.998892] lowmem_reserve[]: 0 867 4046 4046
Sep 24 11:02:53 kolache kernel: [177179.998907] Normal free:1484kB min:3732kB low:4664kB high:5596kB active_anon:0kB inactive_anon:844kB active_file:224428kB inactive_file:220680kB unevictable:0kB present:887976kB pages_scanned:17 all_unreclaimable? no
Sep 24 11:02:53 kolache kernel: [177179.998916] lowmem_reserve[]: 0 0 25438 25438
Sep 24 11:02:53 kolache kernel: [177179.998931] HighMem free:901224kB min:512kB low:3932kB high:7356kB active_anon:232084kB inactive_anon:78640kB active_file:97900kB inactive_file:1964660kB unevictable:0kB present:3256148kB pages_scanned:0 all_unreclaimable? no
Sep 24 11:02:53 kolache kernel: [177179.998938] lowmem_reserve[]: 0 0 0 0
Sep 24 11:02:53 kolache kernel: [177179.998950] DMA: 26*4kB 15*8kB 16*16kB 8*32kB 3*64kB 4*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 3488kB
Sep 24 11:02:53 kolache kernel: [177179.998974] Normal: 62*4kB 0*8kB 0*16kB 0*32kB 1*64kB 1*128kB 0*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 1464kB
Sep 24 11:02:53 kolache kernel: [177179.998997] HighMem: 173*4kB 130*8kB 37*16kB 16077*32kB 5309*64kB 329*128kB 3*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 900980kB
Sep 24 11:02:53 kolache kernel: [177179.999024] 629112 total pagecache pages
Sep 24 11:02:53 kolache kernel: [177179.999030] 0 pages in swap cache
Sep 24 11:02:53 kolache kernel: [177179.999037] Swap cache stats: add 0, delete 0, find 0/0
Sep 24 11:02:53 kolache kernel: [177179.999041] Free swap  = 4208968kB
Sep 24 11:02:53 kolache kernel: [177179.999046] Total swap = 4208968kB
Sep 24 11:02:53 kolache kernel: [177180.041039] 1081344 pages RAM
Sep 24 11:02:53 kolache kernel: [177180.041039] 853506 pages HighMem
Sep 24 11:02:53 kolache kernel: [177180.041039] 42666 pages reserved
Sep 24 11:02:53 kolache kernel: [177180.041039] 579885 pages shared
Sep 24 11:02:53 kolache kernel: [177180.041039] 246221 pages non-shared
Sep 24 11:33:34 kolache kernel: [179021.170262] nfsd: last server has exited, flushing export cache
Sep 24 11:33:35 kolache kernel: [179022.633621] svc: failed to register lockdv1 RPC service (errno 97).
Sep 24 11:33:35 kolache kernel: [179022.634596] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
Sep 24 11:33:35 kolache kernel: [179022.643558] NFSD: starting 90-second grace period
Sep 24 15:53:30 kolache kernel: [194616.664354] lp0: using parport0 (interrupt-driven).
Sep 24 15:53:30 kolache kernel: [194616.709533] ppdev: user-space parallel port driver
Sep 25 08:03:37 kolache kernel: [252824.367604]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:03:38 kolache kernel: [252824.867277]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:03:38 kolache kernel: [252825.367470]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:03:42 kolache kernel: [252829.178026]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:03:42 kolache kernel: [252829.678105]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:03:43 kolache kernel: [252830.178191]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:03:47 kolache kernel: [252834.288945]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:03:48 kolache kernel: [252834.789033]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:03:48 kolache kernel: [252835.289090]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:03:52 kolache kernel: [252838.989733]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:03:52 kolache kernel: [252839.489775]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:03:53 kolache kernel: [252839.989897]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:03:53 kolache kernel: [252840.489945]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:03:55 kolache kernel: [252842.184061]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:03:55 kolache kernel: [252842.680311]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:03:56 kolache kernel: [252843.180462]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:03:56 kolache kernel: [252843.680496]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:03:57 kolache kernel: [252844.180579]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:03:58 kolache kernel: [252844.680758]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:03:58 kolache kernel: [252845.180753]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:00 kolache kernel: [252847.572776]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:01 kolache kernel: [252848.583415]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:02 kolache kernel: [252849.081427]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:02 kolache kernel: [252849.581512]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:03 kolache kernel: [252850.081581]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:03 kolache kernel: [252850.581930]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:06 kolache kernel: [252852.693531]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:12 kolache kernel: [252859.467326]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:13 kolache kernel: [252859.986136]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:13 kolache kernel: [252860.506221]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:14 kolache kernel: [252861.061547]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:14 kolache kernel: [252861.635585]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:15 kolache kernel: [252862.133640]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:15 kolache kernel: [252862.633708]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:16 kolache kernel: [252863.133806]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:16 kolache kernel: [252863.633877]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:17 kolache kernel: [252864.154011]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:17 kolache kernel: [252864.654075]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:18 kolache kernel: [252865.154176]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:34 kolache kernel: [252881.262166]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:35 kolache kernel: [252881.817194]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:35 kolache kernel: [252882.377088]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:36 kolache kernel: [252882.967183]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:36 kolache kernel: [252883.577287]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:37 kolache kernel: [252884.127375]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:38 kolache kernel: [252884.707570]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:38 kolache kernel: [252885.297582]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:39 kolache kernel: [252885.887772]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:39 kolache kernel: [252886.567807]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:40 kolache kernel: [252887.098054]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:40 kolache kernel: [252887.647978]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:41 kolache kernel: [252888.208135]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:42 kolache kernel: [252888.838232]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:42 kolache kernel: [252889.408280]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:43 kolache kernel: [252889.988390]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:43 kolache kernel: [252890.548473]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:45 kolache kernel: [252892.250026]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:46 kolache kernel: [252892.778860]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:46 kolache kernel: [252893.308940]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:47 kolache kernel: [252893.839041]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:47 kolache kernel: [252894.399247]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:48 kolache kernel: [252894.949222]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:48 kolache kernel: [252895.489320]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:49 kolache kernel: [252896.041108]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:49 kolache kernel: [252896.669528]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:50 kolache kernel: [252897.259616]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:51 kolache kernel: [252897.839726]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:51 kolache kernel: [252898.419922]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:52 kolache kernel: [252898.989913]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:52 kolache kernel: [252899.650023]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:04:53 kolache kernel: [252900.230131]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:05:01 kolache kernel: [252908.539286]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:05:02 kolache kernel: [252909.131643]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:05:03 kolache kernel: [252909.801754]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:05:03 kolache kernel: [252910.381856]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:05:04 kolache kernel: [252910.971952]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:05:04 kolache kernel: [252911.532056]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:05:05 kolache kernel: [252912.122151]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:05:06 kolache kernel: [252912.782264]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:05:06 kolache kernel: [252913.352405]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:05:07 kolache kernel: [252913.952459]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:05:07 kolache kernel: [252914.532589]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:05:08 kolache kernel: [252915.192706]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:05:09 kolache kernel: [252915.762785]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:05:09 kolache kernel: [252916.292864]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 08:05:10 kolache kernel: [252916.842958]  CIFS VFS: Write2 ret -28, wrote 0
Sep 25 12:23:18 kolache kernel: [268405.067373] kswapd0: page allocation failure. order:0, mode:0x20
Sep 25 12:23:18 kolache kernel: [268405.067383] Pid: 222, comm: kswapd0 Not tainted 2.6.30-2-686-bigmem #1
Sep 25 12:23:18 kolache kernel: [268405.067386] Call Trace:
Sep 25 12:23:18 kolache kernel: [268405.067405]  [<c0175783>] ? __alloc_pages_internal+0x385/0x39d
Sep 25 12:23:18 kolache kernel: [268405.067414]  [<c02c83f2>] ? tcp_rcv_established+0x39a/0x4d4
Sep 25 12:23:18 kolache kernel: [268405.067423]  [<c0190f6a>] ? cache_alloc_refill+0x27d/0x483
Sep 25 12:23:18 kolache kernel: [268405.067428]  [<c01911ed>] ? __kmalloc+0x7d/0xed
Sep 25 12:23:18 kolache kernel: [268405.067435]  [<c0295dcd>] ? __alloc_skb+0x46/0x10b
Sep 25 12:23:18 kolache kernel: [268405.067442]  [<c02b766f>] ? ip_local_deliver_finish+0x10c/0x18c
Sep 25 12:23:18 kolache kernel: [268405.067481]  [<c02967c2>] ? __netdev_alloc_skb+0x14/0x2d
Sep 25 12:23:18 kolache kernel: [268405.067501]  [<f8430bc1>] ? e1000_alloc_rx_buffers+0x7b/0x2a8 [e1000]
Sep 25 12:23:18 kolache kernel: [268405.067515]  [<f84311cd>] ? e1000_clean_rx_irq+0x3df/0x409 [e1000]
Sep 25 12:23:18 kolache kernel: [268405.067523]  [<c0108fc2>] ? do_IRQ+0x65/0x76
Sep 25 12:23:18 kolache kernel: [268405.067541]  [<f8433567>] ? e1000_clean+0x295/0x402 [e1000]
Sep 25 12:23:18 kolache kernel: [268405.067555]  [<f84336a2>] ? e1000_clean+0x3d0/0x402 [e1000]
Sep 25 12:23:18 kolache kernel: [268405.067567]  [<c029b7f9>] ? net_rx_action+0x90/0x161
Sep 25 12:23:18 kolache kernel: [268405.067574]  [<c01309b7>] ? __do_softirq+0x8e/0x135
Sep 25 12:23:18 kolache kernel: [268405.067579]  [<c0130a8c>] ? do_softirq+0x2e/0x38
Sep 25 12:23:18 kolache kernel: [268405.067583]  [<c0130b6f>] ? irq_exit+0x26/0x53
Sep 25 12:23:18 kolache kernel: [268405.067588]  [<c0108fc2>] ? do_IRQ+0x65/0x76
Sep 25 12:23:18 kolache kernel: [268405.067592]  [<c0107c09>] ? common_interrupt+0x29/0x30
Sep 25 12:23:18 kolache kernel: [268405.067598]  [<c0190869>] ? kmem_cache_free+0x3b/0x68
Sep 25 12:23:18 kolache kernel: [268405.067604]  [<c01a2ad5>] ? destroy_inode+0x1c/0x2b
Sep 25 12:23:18 kolache kernel: [268405.067609]  [<c01a2b8e>] ? dispose_list+0xaa/0xd0
Sep 25 12:23:18 kolache kernel: [268405.067613]  [<c01a2d5a>] ? shrink_icache_memory+0x1a6/0x1d3
Sep 25 12:23:18 kolache kernel: [268405.067620]  [<c0179bd4>] ? shrink_slab+0xe6/0x13f
Sep 25 12:23:18 kolache kernel: [268405.067625]  [<c017a002>] ? kswapd+0x3d5/0x53b
Sep 25 12:23:18 kolache kernel: [268405.067631]  [<c0178234>] ? isolate_pages_global+0x0/0x1d0
Sep 25 12:23:18 kolache kernel: [268405.067637]  [<c013c782>] ? autoremove_wake_function+0x0/0x2d
Sep 25 12:23:18 kolache kernel: [268405.067642]  [<c0179c2d>] ? kswapd+0x0/0x53b
Sep 25 12:23:18 kolache kernel: [268405.067646]  [<c013c490>] ? kthread+0x42/0x67
Sep 25 12:23:18 kolache kernel: [268405.067650]  [<c013c44e>] ? kthread+0x0/0x67
Sep 25 12:23:18 kolache kernel: [268405.067655]  [<c0107ff7>] ? kernel_thread_helper+0x7/0x10
Sep 25 12:23:18 kolache kernel: [268405.067658] Mem-Info:
Sep 25 12:23:18 kolache kernel: [268405.067661] DMA per-cpu:
Sep 25 12:23:18 kolache kernel: [268405.067664] CPU    0: hi:    0, btch:   1 usd:   0
Sep 25 12:23:18 kolache kernel: [268405.067667] CPU    1: hi:    0, btch:   1 usd:   0
Sep 25 12:23:18 kolache kernel: [268405.067670] CPU    2: hi:    0, btch:   1 usd:   0
Sep 25 12:23:18 kolache kernel: [268405.067674] CPU    3: hi:    0, btch:   1 usd:   0
Sep 25 12:23:18 kolache kernel: [268405.067676] Normal per-cpu:
Sep 25 12:23:18 kolache kernel: [268405.067679] CPU    0: hi:  186, btch:  31 usd: 152
Sep 25 12:23:18 kolache kernel: [268405.067682] CPU    1: hi:  186, btch:  31 usd: 170
Sep 25 12:23:18 kolache kernel: [268405.067686] CPU    2: hi:  186, btch:  31 usd: 153
Sep 25 12:23:18 kolache kernel: [268405.067689] CPU    3: hi:  186, btch:  31 usd: 162
Sep 25 12:23:18 kolache kernel: [268405.067691] HighMem per-cpu:
Sep 25 12:23:18 kolache kernel: [268405.067694] CPU    0: hi:  186, btch:  31 usd: 100
Sep 25 12:23:18 kolache kernel: [268405.067698] CPU    1: hi:  186, btch:  31 usd: 130
Sep 25 12:23:18 kolache kernel: [268405.067701] CPU    2: hi:  186, btch:  31 usd: 115
Sep 25 12:23:18 kolache kernel: [268405.067704] CPU    3: hi:  186, btch:  31 usd:  82
Sep 25 12:23:18 kolache kernel: [268405.067710] Active_anon:15474 active_file:82603 inactive_anon:18536
Sep 25 12:23:18 kolache kernel: [268405.067712]  inactive_file:278053 unevictable:0 dirty:324 writeback:0 unstable:0
Sep 25 12:23:18 kolache kernel: [268405.067714]  free:559126 slab:78712 mapped:4516 pagetables:625 bounce:0
Sep 25 12:23:18 kolache kernel: [268405.067720] DMA free:3488kB min:64kB low:80kB high:96kB active_anon:0kB inactive_anon:0kB active_file:6956kB inactive_file:1248kB unevictable:0kB present:15872kB pages_scanned:0 all_unreclaimable? no
Sep 25 12:23:18 kolache kernel: [268405.067724] lowmem_reserve[]: 0 867 4046 4046
Sep 25 12:23:18 kolache kernel: [268405.067734] Normal free:1392kB min:3732kB low:4664kB high:5596kB active_anon:0kB inactive_anon:264kB active_file:151560kB inactive_file:377076kB unevictable:0kB present:887976kB pages_scanned:0 all_unreclaimable? no
Sep 25 12:23:18 kolache kernel: [268405.067739] lowmem_reserve[]: 0 0 25438 25438
Sep 25 12:23:18 kolache kernel: [268405.067748] HighMem free:2231624kB min:512kB low:3932kB high:7356kB active_anon:61896kB inactive_anon:73880kB active_file:171896kB inactive_file:733888kB unevictable:0kB present:3256148kB pages_scanned:0 all_unreclaimable? no
Sep 25 12:23:18 kolache kernel: [268405.067753] lowmem_reserve[]: 0 0 0 0
Sep 25 12:23:18 kolache kernel: [268405.067759] DMA: 28*4kB 14*8kB 16*16kB 10*32kB 2*64kB 4*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 3488kB
Sep 25 12:23:18 kolache kernel: [268405.067774] Normal: 0*4kB 1*8kB 0*16kB 1*32kB 0*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 1320kB
Sep 25 12:23:18 kolache kernel: [268405.067788] HighMem: 22*4kB 222*8kB 362*16kB 16491*32kB 11240*64kB 4788*128kB 1270*256kB 72*512kB 2*1024kB 0*2048kB 0*4096kB = 2231624kB
Sep 25 12:23:18 kolache kernel: [268405.067804] 360824 total pagecache pages
Sep 25 12:23:18 kolache kernel: [268405.067807] 0 pages in swap cache
Sep 25 12:23:18 kolache kernel: [268405.067810] Swap cache stats: add 0, delete 0, find 0/0
Sep 25 12:23:18 kolache kernel: [268405.067813] Free swap  = 4208968kB
Sep 25 12:23:18 kolache kernel: [268405.067815] Total swap = 4208968kB
Sep 25 12:23:18 kolache kernel: [268405.068009] 1081344 pages RAM
Sep 25 12:23:18 kolache kernel: [268405.068009] 853506 pages HighMem
Sep 25 12:23:18 kolache kernel: [268405.068009] 42666 pages reserved
Sep 25 12:23:18 kolache kernel: [268405.068009] 216768 pages shared
Sep 25 12:23:18 kolache kernel: [268405.068009] 280876 pages non-shared
Sep 25 12:23:18 kolache kernel: [268405.092814] kswapd0: page allocation failure. order:0, mode:0x20
Sep 25 12:23:18 kolache kernel: [268405.092827] Pid: 222, comm: kswapd0 Not tainted 2.6.30-2-686-bigmem #1
Sep 25 12:23:18 kolache kernel: [268405.092836] Call Trace:
Sep 25 12:23:18 kolache kernel: [268405.092855]  [<c0175783>] ? __alloc_pages_internal+0x385/0x39d
Sep 25 12:23:18 kolache kernel: [268405.092870]  [<c02c83f2>] ? tcp_rcv_established+0x39a/0x4d4
Sep 25 12:23:18 kolache kernel: [268405.092884]  [<c0190f6a>] ? cache_alloc_refill+0x27d/0x483
Sep 25 12:23:18 kolache kernel: [268405.092897]  [<c01911ed>] ? __kmalloc+0x7d/0xed
Sep 25 12:23:18 kolache kernel: [268405.092910]  [<c0295dcd>] ? __alloc_skb+0x46/0x10b
Sep 25 12:23:18 kolache kernel: [268405.092923]  [<c02b766f>] ? ip_local_deliver_finish+0x10c/0x18c
Sep 25 12:23:18 kolache kernel: [268405.092964]  [<c02967c2>] ? __netdev_alloc_skb+0x14/0x2d
Sep 25 12:23:18 kolache kernel: [268405.092989]  [<f8430bc1>] ? e1000_alloc_rx_buffers+0x7b/0x2a8 [e1000]
Sep 25 12:23:18 kolache kernel: [268405.093011]  [<f843116d>] ? e1000_clean_rx_irq+0x37f/0x409 [e1000]
Sep 25 12:23:18 kolache kernel: [268405.093026]  [<c0108fc2>] ? do_IRQ+0x65/0x76
Sep 25 12:23:18 kolache kernel: [268405.093051]  [<f8433567>] ? e1000_clean+0x295/0x402 [e1000]
Sep 25 12:23:18 kolache kernel: [268405.093068]  [<c029b7f9>] ? net_rx_action+0x90/0x161
Sep 25 12:23:18 kolache kernel: [268405.093082]  [<c01309b7>] ? __do_softirq+0x8e/0x135
Sep 25 12:23:18 kolache kernel: [268405.093095]  [<c0130a8c>] ? do_softirq+0x2e/0x38
Sep 25 12:23:18 kolache kernel: [268405.093107]  [<c0130b6f>] ? irq_exit+0x26/0x53
Sep 25 12:23:18 kolache kernel: [268405.093118]  [<c0108fc2>] ? do_IRQ+0x65/0x76
Sep 25 12:23:18 kolache kernel: [268405.093130]  [<c0107c09>] ? common_interrupt+0x29/0x30
Sep 25 12:23:18 kolache kernel: [268405.093142]  [<c0190869>] ? kmem_cache_free+0x3b/0x68
Sep 25 12:23:18 kolache kernel: [268405.093155]  [<c01a2ad5>] ? destroy_inode+0x1c/0x2b
Sep 25 12:23:18 kolache kernel: [268405.093166]  [<c01a2b8e>] ? dispose_list+0xaa/0xd0
Sep 25 12:23:18 kolache kernel: [268405.093177]  [<c01a2d5a>] ? shrink_icache_memory+0x1a6/0x1d3
Sep 25 12:23:18 kolache kernel: [268405.093192]  [<c0179bd4>] ? shrink_slab+0xe6/0x13f
Sep 25 12:23:18 kolache kernel: [268405.093203]  [<c017a002>] ? kswapd+0x3d5/0x53b
Sep 25 12:23:18 kolache kernel: [268405.093215]  [<c0178234>] ? isolate_pages_global+0x0/0x1d0
Sep 25 12:23:18 kolache kernel: [268405.093228]  [<c013c782>] ? autoremove_wake_function+0x0/0x2d
Sep 25 12:23:18 kolache kernel: [268405.093240]  [<c0179c2d>] ? kswapd+0x0/0x53b
Sep 25 12:23:18 kolache kernel: [268405.093251]  [<c013c490>] ? kthread+0x42/0x67
Sep 25 12:23:18 kolache kernel: [268405.093261]  [<c013c44e>] ? kthread+0x0/0x67
Sep 25 12:23:18 kolache kernel: [268405.093273]  [<c0107ff7>] ? kernel_thread_helper+0x7/0x10
Sep 25 12:23:18 kolache kernel: [268405.093281] Mem-Info:
Sep 25 12:23:18 kolache kernel: [268405.093287] DMA per-cpu:
Sep 25 12:23:18 kolache kernel: [268405.093294] CPU    0: hi:    0, btch:   1 usd:   0
Sep 25 12:23:18 kolache kernel: [268405.093302] CPU    1: hi:    0, btch:   1 usd:   0
Sep 25 12:23:18 kolache kernel: [268405.093311] CPU    2: hi:    0, btch:   1 usd:   0
Sep 25 12:23:18 kolache kernel: [268405.093319] CPU    3: hi:    0, btch:   1 usd:   0
Sep 25 12:23:18 kolache kernel: [268405.093326] Normal per-cpu:
Sep 25 12:23:18 kolache kernel: [268405.093333] CPU    0: hi:  186, btch:  31 usd: 152
Sep 25 12:23:18 kolache kernel: [268405.093341] CPU    1: hi:  186, btch:  31 usd: 170
Sep 25 12:23:18 kolache kernel: [268405.093349] CPU    2: hi:  186, btch:  31 usd: 153
Sep 25 12:23:18 kolache kernel: [268405.093356] CPU    3: hi:  186, btch:  31 usd: 162
Sep 25 12:23:18 kolache kernel: [268405.093364] HighMem per-cpu:
Sep 25 12:23:18 kolache kernel: [268405.093371] CPU    0: hi:  186, btch:  31 usd: 100
Sep 25 12:23:18 kolache kernel: [268405.093379] CPU    1: hi:  186, btch:  31 usd: 130
Sep 25 12:23:18 kolache kernel: [268405.093387] CPU    2: hi:  186, btch:  31 usd: 115
Sep 25 12:23:18 kolache kernel: [268405.093395] CPU    3: hi:  186, btch:  31 usd:  82
Sep 25 12:23:18 kolache kernel: [268405.093406] Active_anon:15474 active_file:82603 inactive_anon:18536
Sep 25 12:23:18 kolache kernel: [268405.093411]  inactive_file:278053 unevictable:0 dirty:324 writeback:0 unstable:0
Sep 25 12:23:18 kolache kernel: [268405.093418]  free:559126 slab:78712 mapped:4516 pagetables:625 bounce:0
Sep 25 12:23:18 kolache kernel: [268405.093431] DMA free:3488kB min:64kB low:80kB high:96kB active_anon:0kB inactive_anon:0kB active_file:6956kB inactive_file:1248kB unevictable:0kB present:15872kB pages_scanned:0 all_unreclaimable? no
Sep 25 12:23:18 kolache kernel: [268405.093448] lowmem_reserve[]: 0 867 4046 4046
Sep 25 12:23:18 kolache kernel: [268405.093474] Normal free:1392kB min:3732kB low:4664kB high:5596kB active_anon:0kB inactive_anon:264kB active_file:151560kB inactive_file:377076kB unevictable:0kB present:887976kB pages_scanned:0 all_unreclaimable? no
Sep 25 12:23:18 kolache kernel: [268405.093490] lowmem_reserve[]: 0 0 25438 25438
Sep 25 12:23:18 kolache kernel: [268405.093516] HighMem free:2231624kB min:512kB low:3932kB high:7356kB active_anon:61896kB inactive_anon:73880kB active_file:171896kB inactive_file:733888kB unevictable:0kB present:3256148kB pages_scanned:0 all_unreclaimable? no
Sep 25 12:23:18 kolache kernel: [268405.093535] lowmem_reserve[]: 0 0 0 0
Sep 25 12:23:18 kolache kernel: [268405.093558] DMA: 28*4kB 14*8kB 16*16kB 10*32kB 2*64kB 4*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 3488kB
Sep 25 12:23:18 kolache kernel: [268405.093606] Normal: 0*4kB 1*8kB 0*16kB 1*32kB 0*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 1320kB
Sep 25 12:23:18 kolache kernel: [268405.093654] HighMem: 22*4kB 222*8kB 362*16kB 16491*32kB 11240*64kB 4788*128kB 1270*256kB 72*512kB 2*1024kB 0*2048kB 0*4096kB = 2231624kB
Sep 25 12:23:18 kolache kernel: [268405.093704] 360824 total pagecache pages
Sep 25 12:23:18 kolache kernel: [268405.093713] 0 pages in swap cache
Sep 25 12:23:18 kolache kernel: [268405.093720] Swap cache stats: add 0, delete 0, find 0/0
Sep 25 12:23:18 kolache kernel: [268405.093729] Free swap  = 4208968kB
Sep 25 12:23:18 kolache kernel: [268405.093736] Total swap = 4208968kB
Sep 25 12:23:18 kolache kernel: [268405.096713] 1081344 pages RAM
Sep 25 12:23:18 kolache kernel: [268405.096713] 853506 pages HighMem
Sep 25 12:23:18 kolache kernel: [268405.096713] 42666 pages reserved
Sep 25 12:23:18 kolache kernel: [268405.096713] 216706 pages shared
Sep 25 12:23:18 kolache kernel: [268405.096713] 280876 pages non-shared
Sep 25 12:23:18 kolache kernel: [268405.119558] kswapd0: page allocation failure. order:0, mode:0x20
Sep 25 12:23:18 kolache kernel: [268405.119565] Pid: 222, comm: kswapd0 Not tainted 2.6.30-2-686-bigmem #1
Sep 25 12:23:18 kolache kernel: [268405.119568] Call Trace:
Sep 25 12:23:18 kolache kernel: [268405.119582]  [<c0175783>] ? __alloc_pages_internal+0x385/0x39d
Sep 25 12:23:18 kolache kernel: [268405.119590]  [<c02c84e0>] ? tcp_rcv_established+0x488/0x4d4
Sep 25 12:23:18 kolache kernel: [268405.119598]  [<c0190f6a>] ? cache_alloc_refill+0x27d/0x483
Sep 25 12:23:18 kolache kernel: [268405.119603]  [<c01911ed>] ? __kmalloc+0x7d/0xed
Sep 25 12:23:18 kolache kernel: [268405.119610]  [<c0295dcd>] ? __alloc_skb+0x46/0x10b
Sep 25 12:23:18 kolache kernel: [268405.119643]  [<c02967c2>] ? __netdev_alloc_skb+0x14/0x2d
Sep 25 12:23:18 kolache kernel: [268405.119661]  [<f8430bc1>] ? e1000_alloc_rx_buffers+0x7b/0x2a8 [e1000]
Sep 25 12:23:18 kolache kernel: [268405.119674]  [<f84311cd>] ? e1000_clean_rx_irq+0x3df/0x409 [e1000]
Sep 25 12:23:18 kolache kernel: [268405.119691]  [<f8433567>] ? e1000_clean+0x295/0x402 [e1000]
Sep 25 12:23:18 kolache kernel: [268405.119701]  [<c029b7f9>] ? net_rx_action+0x90/0x161
Sep 25 12:23:18 kolache kernel: [268405.119709]  [<c01309b7>] ? __do_softirq+0x8e/0x135
Sep 25 12:23:18 kolache kernel: [268405.119713]  [<c0130a8c>] ? do_softirq+0x2e/0x38
Sep 25 12:23:18 kolache kernel: [268405.119717]  [<c0130b6f>] ? irq_exit+0x26/0x53
Sep 25 12:23:18 kolache kernel: [268405.119723]  [<c0108fc2>] ? do_IRQ+0x65/0x76
Sep 25 12:23:18 kolache kernel: [268405.119728]  [<c0107c09>] ? common_interrupt+0x29/0x30
Sep 25 12:23:18 kolache kernel: [268405.119734]  [<c01a230b>] ? inode_wait+0x0/0x8
Sep 25 12:23:18 kolache kernel: [268405.119741]  [<c01a2b39>] ? dispose_list+0x55/0xd0
Sep 25 12:23:18 kolache kernel: [268405.119746]  [<c01a2d5a>] ? shrink_icache_memory+0x1a6/0x1d3
Sep 25 12:23:18 kolache kernel: [268405.119753]  [<c0179bd4>] ? shrink_slab+0xe6/0x13f
Sep 25 12:23:18 kolache kernel: [268405.119757]  [<c017a002>] ? kswapd+0x3d5/0x53b
Sep 25 12:23:18 kolache kernel: [268405.119762]  [<c0178234>] ? isolate_pages_global+0x0/0x1d0
Sep 25 12:23:18 kolache kernel: [268405.119769]  [<c013c782>] ? autoremove_wake_function+0x0/0x2d
Sep 25 12:23:18 kolache kernel: [268405.119773]  [<c0179c2d>] ? kswapd+0x0/0x53b
Sep 25 12:23:18 kolache kernel: [268405.119777]  [<c013c490>] ? kthread+0x42/0x67
Sep 25 12:23:18 kolache kernel: [268405.119781]  [<c013c44e>] ? kthread+0x0/0x67
Sep 25 12:23:18 kolache kernel: [268405.119786]  [<c0107ff7>] ? kernel_thread_helper+0x7/0x10
Sep 25 12:23:18 kolache kernel: [268405.119789] Mem-Info:
Sep 25 12:23:18 kolache kernel: [268405.119792] DMA per-cpu:
Sep 25 12:23:18 kolache kernel: [268405.119795] CPU    0: hi:    0, btch:   1 usd:   0
Sep 25 12:23:18 kolache kernel: [268405.119798] CPU    1: hi:    0, btch:   1 usd:   0
Sep 25 12:23:18 kolache kernel: [268405.119801] CPU    2: hi:    0, btch:   1 usd:   0
Sep 25 12:23:18 kolache kernel: [268405.119804] CPU    3: hi:    0, btch:   1 usd:   0
Sep 25 12:23:18 kolache kernel: [268405.119806] Normal per-cpu:
Sep 25 12:23:18 kolache kernel: [268405.119809] CPU    0: hi:  186, btch:  31 usd: 152
Sep 25 12:23:18 kolache kernel: [268405.119812] CPU    1: hi:  186, btch:  31 usd: 172
Sep 25 12:23:18 kolache kernel: [268405.119815] CPU    2: hi:  186, btch:  31 usd: 153
Sep 25 12:23:18 kolache kernel: [268405.119819] CPU    3: hi:  186, btch:  31 usd: 162
Sep 25 12:23:18 kolache kernel: [268405.119821] HighMem per-cpu:
Sep 25 12:23:18 kolache kernel: [268405.119824] CPU    0: hi:  186, btch:  31 usd: 100
Sep 25 12:23:18 kolache kernel: [268405.119827] CPU    1: hi:  186, btch:  31 usd: 130
Sep 25 12:23:18 kolache kernel: [268405.119830] CPU    2: hi:  186, btch:  31 usd: 115
Sep 25 12:23:18 kolache kernel: [268405.119833] CPU    3: hi:  186, btch:  31 usd:  82
Sep 25 12:23:18 kolache kernel: [268405.119839] Active_anon:15474 active_file:82603 inactive_anon:18536
Sep 25 12:23:18 kolache kernel: [268405.119841]  inactive_file:277989 unevictable:0 dirty:324 writeback:0 unstable:0
Sep 25 12:23:18 kolache kernel: [268405.119842]  free:559101 slab:78787 mapped:4516 pagetables:625 bounce:0
Sep 25 12:23:18 kolache kernel: [268405.119848] DMA free:3488kB min:64kB low:80kB high:96kB active_anon:0kB inactive_anon:0kB active_file:6956kB inactive_file:1248kB unevictable:0kB present:15872kB pages_scanned:0 all_unreclaimable? no
Sep 25 12:23:18 kolache kernel: [268405.119852] lowmem_reserve[]: 0 867 4046 4046
Sep 25 12:23:18 kolache kernel: [268405.119861] Normal free:1292kB min:3732kB low:4664kB high:5596kB active_anon:0kB inactive_anon:264kB active_file:151560kB inactive_file:376820kB unevictable:0kB present:887976kB pages_scanned:0 all_unreclaimable? no
Sep 25 12:23:18 kolache kernel: [268405.119866] lowmem_reserve[]: 0 0 25438 25438
Sep 25 12:23:18 kolache kernel: [268405.119875] HighMem free:2231624kB min:512kB low:3932kB high:7356kB active_anon:61896kB inactive_anon:73880kB active_file:171896kB inactive_file:733888kB unevictable:0kB present:3256148kB pages_scanned:0 all_unreclaimable? no
Sep 25 12:23:18 kolache kernel: [268405.119879] lowmem_reserve[]: 0 0 0 0
Sep 25 12:23:18 kolache kernel: [268405.119885] DMA: 28*4kB 14*8kB 16*16kB 10*32kB 2*64kB 4*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 3488kB
Sep 25 12:23:18 kolache kernel: [268405.119899] Normal: 0*4kB 1*8kB 0*16kB 1*32kB 0*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 1320kB
Sep 25 12:23:18 kolache kernel: [268405.119913] HighMem: 22*4kB 222*8kB 362*16kB 16491*32kB 11240*64kB 4788*128kB 1270*256kB 72*512kB 2*1024kB 0*2048kB 0*4096kB = 2231624kB
Sep 25 12:23:18 kolache kernel: [268405.119929] 360750 total pagecache pages
Sep 25 12:23:18 kolache kernel: [268405.119932] 0 pages in swap cache
Sep 25 12:23:18 kolache kernel: [268405.119935] Swap cache stats: add 0, delete 0, find 0/0
Sep 25 12:23:18 kolache kernel: [268405.119937] Free swap  = 4208968kB
Sep 25 12:23:18 kolache kernel: [268405.119939] Total swap = 4208968kB
Sep 25 12:23:18 kolache kernel: [268405.122710] 1081344 pages RAM
Sep 25 12:23:18 kolache kernel: [268405.122710] 853506 pages HighMem
Sep 25 12:23:18 kolache kernel: [268405.122710] 42666 pages reserved
Sep 25 12:23:18 kolache kernel: [268405.122710] 216645 pages shared
Sep 25 12:23:18 kolache kernel: [268405.122710] 280938 pages non-shared
Sep 25 20:01:06 kolache kernel: [295872.784500] BUG: soft lockup - CPU#1 stuck for 61s! [automount:355]
Sep 25 20:01:06 kolache kernel: [295872.784503] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:01:06 kolache kernel: [295872.784503] 
Sep 25 20:01:06 kolache kernel: [295872.784503] Pid: 355, comm: automount Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:01:06 kolache kernel: [295872.784503] EIP: 0060:[<c03296e0>] EFLAGS: 00000202 CPU: 1
Sep 25 20:01:06 kolache kernel: [295872.784503] EIP is at _spin_lock+0xe/0x15
Sep 25 20:01:06 kolache kernel: [295872.784503] EAX: c04fb9c4 EBX: c04fb9c4 ECX: 8b7d58ee EDX: 00002a2b
Sep 25 20:01:06 kolache kernel: [295872.784503] ESI: b80eeba0 EDI: 00000000 EBP: c3408000 ESP: c3409ed0
Sep 25 20:01:06 kolache kernel: [295872.784503]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:01:06 kolache kernel: [295872.784503] CR0: 8005003b CR2: b7f03340 CR3: 1710c000 CR4: 000006f0
Sep 25 20:01:06 kolache kernel: [295872.784503] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:01:06 kolache kernel: [295872.784503] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:01:06 kolache kernel: [295872.784503] Call Trace:
Sep 25 20:01:06 kolache kernel: [295872.784503]  [<c0147a31>] ? futex_wake+0x4d/0xbd
Sep 25 20:01:06 kolache kernel: [295872.784503]  [<c0148962>] ? do_futex+0x99/0x7bd
Sep 25 20:01:06 kolache kernel: [295872.784503]  [<c01203d4>] ? kmap_atomic_prot+0xdd/0x101
Sep 25 20:01:06 kolache kernel: [295872.784503]  [<c013f3c4>] ? ktime_get_ts+0x1d/0x3f
Sep 25 20:01:06 kolache kernel: [295872.784503]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:01:06 kolache kernel: [295872.784503]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:01:06 kolache kernel: [295872.784503]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:02:11 kolache kernel: [295938.280501] BUG: soft lockup - CPU#1 stuck for 61s! [automount:355]
Sep 25 20:02:11 kolache kernel: [295938.280503] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:02:11 kolache kernel: [295938.280503] 
Sep 25 20:02:11 kolache kernel: [295938.280503] Pid: 355, comm: automount Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:02:11 kolache kernel: [295938.280503] EIP: 0060:[<c03296e2>] EFLAGS: 00000206 CPU: 1
Sep 25 20:02:11 kolache kernel: [295938.280503] EIP is at _spin_lock+0x10/0x15
Sep 25 20:02:11 kolache kernel: [295938.280503] EAX: c04fb9c4 EBX: c04fb9c4 ECX: 8b7d58ee EDX: 00002a2d
Sep 25 20:02:11 kolache kernel: [295938.280503] ESI: b80eeba0 EDI: 00000000 EBP: c3408000 ESP: c3409ed0
Sep 25 20:02:11 kolache kernel: [295938.280503]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:02:11 kolache kernel: [295938.280503] CR0: 8005003b CR2: b7f03340 CR3: 1710c000 CR4: 000006f0
Sep 25 20:02:11 kolache kernel: [295938.280503] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:02:11 kolache kernel: [295938.280503] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:02:11 kolache kernel: [295938.280503] Call Trace:
Sep 25 20:02:11 kolache kernel: [295938.280503]  [<c0147a31>] ? futex_wake+0x4d/0xbd
Sep 25 20:02:11 kolache kernel: [295938.280503]  [<c0148962>] ? do_futex+0x99/0x7bd
Sep 25 20:02:11 kolache kernel: [295938.280503]  [<c01203d4>] ? kmap_atomic_prot+0xdd/0x101
Sep 25 20:02:11 kolache kernel: [295938.280503]  [<c013f3c4>] ? ktime_get_ts+0x1d/0x3f
Sep 25 20:02:11 kolache kernel: [295938.280503]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:02:11 kolache kernel: [295938.280503]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:02:11 kolache kernel: [295938.280503]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:02:14 kolache kernel: [295941.504001] BUG: soft lockup - CPU#0 stuck for 61s! [mysqld:3979]
Sep 25 20:02:14 kolache kernel: [295941.504002] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:02:14 kolache kernel: [295941.504002] 
Sep 25 20:02:14 kolache kernel: [295941.504002] Pid: 3979, comm: mysqld Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:02:14 kolache kernel: [295941.504002] EIP: 0060:[<c03296e2>] EFLAGS: 00000212 CPU: 0
Sep 25 20:02:14 kolache kernel: [295941.504002] EIP is at _spin_lock+0x10/0x15
Sep 25 20:02:14 kolache kernel: [295941.504002] EAX: c04fc4f0 EBX: c04fc4f0 ECX: ab0d1d38 EDX: 0000eef0
Sep 25 20:02:14 kolache kernel: [295941.504002] ESI: c3477e8c EDI: c3477ebc EBP: 00000000 ESP: c3477e24
Sep 25 20:02:14 kolache kernel: [295941.504002]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:02:14 kolache kernel: [295941.504002] CR0: 80050033 CR2: b79a9cf8 CR3: 3641f000 CR4: 000006f0
Sep 25 20:02:14 kolache kernel: [295941.504002] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:02:14 kolache kernel: [295941.504002] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:02:14 kolache kernel: [295941.504002] Call Trace:
Sep 25 20:02:14 kolache kernel: [295941.504002]  [<c01475c0>] ? queue_lock+0x4c/0x51
Sep 25 20:02:14 kolache kernel: [295941.504002]  [<c01476ea>] ? futex_wait+0xa0/0x332
Sep 25 20:02:14 kolache kernel: [295941.504002]  [<c01216fd>] ? __wake_up_common+0x34/0x59
Sep 25 20:02:14 kolache kernel: [295941.504002]  [<c0121fcd>] ? __wake_up+0x29/0x39
Sep 25 20:02:14 kolache kernel: [295941.504002]  [<c01479da>] ? wake_futex+0x1f/0x29
Sep 25 20:02:14 kolache kernel: [295941.504002]  [<c0147cdb>] ? futex_requeue+0x23a/0x244
Sep 25 20:02:14 kolache kernel: [295941.504002]  [<c01277d1>] ? default_wake_function+0x0/0x8
Sep 25 20:02:14 kolache kernel: [295941.504002]  [<c014893d>] ? do_futex+0x74/0x7bd
Sep 25 20:02:14 kolache kernel: [295941.504002]  [<c0121654>] ? pick_next_task+0x1a/0x30
Sep 25 20:02:14 kolache kernel: [295941.504002]  [<c032826e>] ? __schedule+0x4f1/0x746
Sep 25 20:02:14 kolache kernel: [295941.504002]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:02:14 kolache kernel: [295941.504002]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:02:14 kolache kernel: [295941.504002]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:03:17 kolache kernel: [296003.780518] BUG: soft lockup - CPU#1 stuck for 61s! [automount:355]
Sep 25 20:03:17 kolache kernel: [296003.780521] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:03:17 kolache kernel: [296003.780521] 
Sep 25 20:03:17 kolache kernel: [296003.780521] Pid: 355, comm: automount Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:03:17 kolache kernel: [296003.780521] EIP: 0060:[<c03296e4>] EFLAGS: 00000206 CPU: 1
Sep 25 20:03:17 kolache kernel: [296003.780521] EIP is at _spin_lock+0x12/0x15
Sep 25 20:03:17 kolache kernel: [296003.780521] EAX: c04fb9c4 EBX: c04fb9c4 ECX: 8b7d58ee EDX: 00002a2d
Sep 25 20:03:17 kolache kernel: [296003.780521] ESI: b80eeba0 EDI: 00000000 EBP: c3408000 ESP: c3409ed0
Sep 25 20:03:17 kolache kernel: [296003.780521]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:03:17 kolache kernel: [296003.780521] CR0: 8005003b CR2: b7f03340 CR3: 1710c000 CR4: 000006f0
Sep 25 20:03:17 kolache kernel: [296003.780521] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:03:17 kolache kernel: [296003.780521] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:03:17 kolache kernel: [296003.780521] Call Trace:
Sep 25 20:03:17 kolache kernel: [296003.780521]  [<c0147a31>] ? futex_wake+0x4d/0xbd
Sep 25 20:03:17 kolache kernel: [296003.780521]  [<c0148962>] ? do_futex+0x99/0x7bd
Sep 25 20:03:17 kolache kernel: [296003.780521]  [<c01203d4>] ? kmap_atomic_prot+0xdd/0x101
Sep 25 20:03:17 kolache kernel: [296003.780521]  [<c013f3c4>] ? ktime_get_ts+0x1d/0x3f
Sep 25 20:03:17 kolache kernel: [296003.780521]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:03:17 kolache kernel: [296003.780521]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:03:17 kolache kernel: [296003.780521]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:03:20 kolache kernel: [296007.000000] BUG: soft lockup - CPU#0 stuck for 61s! [mysqld:3979]
Sep 25 20:03:20 kolache kernel: [296007.000002] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:03:20 kolache kernel: [296007.000002] 
Sep 25 20:03:20 kolache kernel: [296007.000002] Pid: 3979, comm: mysqld Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:03:20 kolache kernel: [296007.000002] EIP: 0060:[<c03296de>] EFLAGS: 00000212 CPU: 0
Sep 25 20:03:20 kolache kernel: [296007.000002] EIP is at _spin_lock+0xc/0x15
Sep 25 20:03:20 kolache kernel: [296007.000002] EAX: c04fc4f0 EBX: c04fc4f0 ECX: ab0d1d38 EDX: 0000eef0
Sep 25 20:03:20 kolache kernel: [296007.000002] ESI: c3477e8c EDI: c3477ebc EBP: 00000000 ESP: c3477e24
Sep 25 20:03:20 kolache kernel: [296007.000002]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:03:20 kolache kernel: [296007.000002] CR0: 80050033 CR2: b79a9cf8 CR3: 3641f000 CR4: 000006f0
Sep 25 20:03:20 kolache kernel: [296007.000002] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:03:20 kolache kernel: [296007.000002] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:03:20 kolache kernel: [296007.000002] Call Trace:
Sep 25 20:03:20 kolache kernel: [296007.000002]  [<c01475c0>] ? queue_lock+0x4c/0x51
Sep 25 20:03:20 kolache kernel: [296007.000002]  [<c01476ea>] ? futex_wait+0xa0/0x332
Sep 25 20:03:20 kolache kernel: [296007.000002]  [<c01216fd>] ? __wake_up_common+0x34/0x59
Sep 25 20:03:20 kolache kernel: [296007.000002]  [<c0121fcd>] ? __wake_up+0x29/0x39
Sep 25 20:03:20 kolache kernel: [296007.000002]  [<c01479da>] ? wake_futex+0x1f/0x29
Sep 25 20:03:20 kolache kernel: [296007.000002]  [<c0147cdb>] ? futex_requeue+0x23a/0x244
Sep 25 20:03:20 kolache kernel: [296007.000002]  [<c01277d1>] ? default_wake_function+0x0/0x8
Sep 25 20:03:20 kolache kernel: [296007.000002]  [<c014893d>] ? do_futex+0x74/0x7bd
Sep 25 20:03:20 kolache kernel: [296007.000002]  [<c0121654>] ? pick_next_task+0x1a/0x30
Sep 25 20:03:20 kolache kernel: [296007.000002]  [<c032826e>] ? __schedule+0x4f1/0x746
Sep 25 20:03:20 kolache kernel: [296007.000002]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:03:20 kolache kernel: [296007.000002]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:03:20 kolache kernel: [296007.000002]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:04:22 kolache kernel: [296069.276500] BUG: soft lockup - CPU#1 stuck for 61s! [automount:355]
Sep 25 20:04:22 kolache kernel: [296069.276503] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:04:22 kolache kernel: [296069.276503] 
Sep 25 20:04:22 kolache kernel: [296069.276503] Pid: 355, comm: automount Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:04:22 kolache kernel: [296069.276503] EIP: 0060:[<c03296e2>] EFLAGS: 00000206 CPU: 1
Sep 25 20:04:22 kolache kernel: [296069.276503] EIP is at _spin_lock+0x10/0x15
Sep 25 20:04:22 kolache kernel: [296069.276503] EAX: c04fb9c4 EBX: c04fb9c4 ECX: 8b7d58ee EDX: 00002a2d
Sep 25 20:04:22 kolache kernel: [296069.276503] ESI: b80eeba0 EDI: 00000000 EBP: c3408000 ESP: c3409ed0
Sep 25 20:04:22 kolache kernel: [296069.276503]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:04:22 kolache kernel: [296069.276503] CR0: 8005003b CR2: b7f03340 CR3: 1710c000 CR4: 000006f0
Sep 25 20:04:22 kolache kernel: [296069.276503] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:04:22 kolache kernel: [296069.276503] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:04:22 kolache kernel: [296069.276503] Call Trace:
Sep 25 20:04:22 kolache kernel: [296069.276503]  [<c0147a31>] ? futex_wake+0x4d/0xbd
Sep 25 20:04:22 kolache kernel: [296069.276503]  [<c0148962>] ? do_futex+0x99/0x7bd
Sep 25 20:04:22 kolache kernel: [296069.276503]  [<c01203d4>] ? kmap_atomic_prot+0xdd/0x101
Sep 25 20:04:22 kolache kernel: [296069.276503]  [<c013f3c4>] ? ktime_get_ts+0x1d/0x3f
Sep 25 20:04:22 kolache kernel: [296069.276503]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:04:22 kolache kernel: [296069.276503]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:04:22 kolache kernel: [296069.276503]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:04:25 kolache kernel: [296072.499999] BUG: soft lockup - CPU#0 stuck for 61s! [mysqld:3979]
Sep 25 20:04:25 kolache kernel: [296072.500002] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:04:25 kolache kernel: [296072.500002] 
Sep 25 20:04:25 kolache kernel: [296072.500002] Pid: 3979, comm: mysqld Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:04:25 kolache kernel: [296072.500002] EIP: 0060:[<c03296e2>] EFLAGS: 00000212 CPU: 0
Sep 25 20:04:25 kolache kernel: [296072.500002] EIP is at _spin_lock+0x10/0x15
Sep 25 20:04:25 kolache kernel: [296072.500002] EAX: c04fc4f0 EBX: c04fc4f0 ECX: ab0d1d38 EDX: 0000eef0
Sep 25 20:04:25 kolache kernel: [296072.500002] ESI: c3477e8c EDI: c3477ebc EBP: 00000000 ESP: c3477e24
Sep 25 20:04:25 kolache kernel: [296072.500002]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:04:25 kolache kernel: [296072.500002] CR0: 80050033 CR2: b79a9cf8 CR3: 3641f000 CR4: 000006f0
Sep 25 20:04:25 kolache kernel: [296072.500002] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:04:25 kolache kernel: [296072.500002] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:04:25 kolache kernel: [296072.500002] Call Trace:
Sep 25 20:04:25 kolache kernel: [296072.500002]  [<c01475c0>] ? queue_lock+0x4c/0x51
Sep 25 20:04:25 kolache kernel: [296072.500002]  [<c01476ea>] ? futex_wait+0xa0/0x332
Sep 25 20:04:25 kolache kernel: [296072.500002]  [<c01216fd>] ? __wake_up_common+0x34/0x59
Sep 25 20:04:25 kolache kernel: [296072.500002]  [<c0121fcd>] ? __wake_up+0x29/0x39
Sep 25 20:04:25 kolache kernel: [296072.500002]  [<c01479da>] ? wake_futex+0x1f/0x29
Sep 25 20:04:25 kolache kernel: [296072.500002]  [<c0147cdb>] ? futex_requeue+0x23a/0x244
Sep 25 20:04:25 kolache kernel: [296072.500002]  [<c01277d1>] ? default_wake_function+0x0/0x8
Sep 25 20:04:25 kolache kernel: [296072.500002]  [<c014893d>] ? do_futex+0x74/0x7bd
Sep 25 20:04:25 kolache kernel: [296072.500002]  [<c0121654>] ? pick_next_task+0x1a/0x30
Sep 25 20:04:25 kolache kernel: [296072.500002]  [<c032826e>] ? __schedule+0x4f1/0x746
Sep 25 20:04:25 kolache kernel: [296072.500002]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:04:25 kolache kernel: [296072.500002]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:04:25 kolache kernel: [296072.500002]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:05:28 kolache kernel: [296134.776519] BUG: soft lockup - CPU#1 stuck for 61s! [automount:355]
Sep 25 20:05:28 kolache kernel: [296134.776519] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:05:28 kolache kernel: [296134.776519] 
Sep 25 20:05:28 kolache kernel: [296134.776519] Pid: 355, comm: automount Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:05:28 kolache kernel: [296134.776519] EIP: 0060:[<c03296e2>] EFLAGS: 00000206 CPU: 1
Sep 25 20:05:28 kolache kernel: [296134.776519] EIP is at _spin_lock+0x10/0x15
Sep 25 20:05:28 kolache kernel: [296134.776519] EAX: c04fb9c4 EBX: c04fb9c4 ECX: 8b7d58ee EDX: 00002a2d
Sep 25 20:05:28 kolache kernel: [296134.776519] ESI: b80eeba0 EDI: 00000000 EBP: c3408000 ESP: c3409ed0
Sep 25 20:05:28 kolache kernel: [296134.776519]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:05:28 kolache kernel: [296134.776519] CR0: 8005003b CR2: b7f03340 CR3: 1710c000 CR4: 000006f0
Sep 25 20:05:28 kolache kernel: [296134.776519] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:05:28 kolache kernel: [296134.776519] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:05:28 kolache kernel: [296134.776519] Call Trace:
Sep 25 20:05:28 kolache kernel: [296134.776519]  [<c0147a31>] ? futex_wake+0x4d/0xbd
Sep 25 20:05:28 kolache kernel: [296134.776519]  [<c0148962>] ? do_futex+0x99/0x7bd
Sep 25 20:05:28 kolache kernel: [296134.776519]  [<c01203d4>] ? kmap_atomic_prot+0xdd/0x101
Sep 25 20:05:28 kolache kernel: [296134.776519]  [<c013f3c4>] ? ktime_get_ts+0x1d/0x3f
Sep 25 20:05:28 kolache kernel: [296134.776519]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:05:28 kolache kernel: [296134.776519]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:05:28 kolache kernel: [296134.776519]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:05:31 kolache kernel: [296137.996000] BUG: soft lockup - CPU#0 stuck for 61s! [mysqld:3979]
Sep 25 20:05:31 kolache kernel: [296137.996003] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:05:31 kolache kernel: [296137.996003] 
Sep 25 20:05:31 kolache kernel: [296137.996003] Pid: 3979, comm: mysqld Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:05:31 kolache kernel: [296137.996003] EIP: 0060:[<c03296e2>] EFLAGS: 00000212 CPU: 0
Sep 25 20:05:31 kolache kernel: [296137.996003] EIP is at _spin_lock+0x10/0x15
Sep 25 20:05:31 kolache kernel: [296137.996003] EAX: c04fc4f0 EBX: c04fc4f0 ECX: ab0d1d38 EDX: 0000eef0
Sep 25 20:05:31 kolache kernel: [296137.996003] ESI: c3477e8c EDI: c3477ebc EBP: 00000000 ESP: c3477e24
Sep 25 20:05:31 kolache kernel: [296137.996003]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:05:31 kolache kernel: [296137.996003] CR0: 80050033 CR2: b79a9cf8 CR3: 3641f000 CR4: 000006f0
Sep 25 20:05:31 kolache kernel: [296137.996003] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:05:31 kolache kernel: [296137.996003] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:05:31 kolache kernel: [296137.996003] Call Trace:
Sep 25 20:05:31 kolache kernel: [296137.996003]  [<c01475c0>] ? queue_lock+0x4c/0x51
Sep 25 20:05:31 kolache kernel: [296137.996003]  [<c01476ea>] ? futex_wait+0xa0/0x332
Sep 25 20:05:31 kolache kernel: [296137.996003]  [<c01216fd>] ? __wake_up_common+0x34/0x59
Sep 25 20:05:31 kolache kernel: [296137.996003]  [<c0121fcd>] ? __wake_up+0x29/0x39
Sep 25 20:05:31 kolache kernel: [296137.996003]  [<c01479da>] ? wake_futex+0x1f/0x29
Sep 25 20:05:31 kolache kernel: [296137.996003]  [<c0147cdb>] ? futex_requeue+0x23a/0x244
Sep 25 20:05:31 kolache kernel: [296137.996003]  [<c01277d1>] ? default_wake_function+0x0/0x8
Sep 25 20:05:31 kolache kernel: [296137.996003]  [<c014893d>] ? do_futex+0x74/0x7bd
Sep 25 20:05:31 kolache kernel: [296137.996003]  [<c0121654>] ? pick_next_task+0x1a/0x30
Sep 25 20:05:31 kolache kernel: [296137.996003]  [<c032826e>] ? __schedule+0x4f1/0x746
Sep 25 20:05:31 kolache kernel: [296137.996003]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:05:31 kolache kernel: [296137.996003]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:05:31 kolache kernel: [296137.996003]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:06:33 kolache kernel: [296200.272501] BUG: soft lockup - CPU#1 stuck for 61s! [automount:355]
Sep 25 20:06:33 kolache kernel: [296200.272503] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:06:33 kolache kernel: [296200.272503] 
Sep 25 20:06:33 kolache kernel: [296200.272503] Pid: 355, comm: automount Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:06:33 kolache kernel: [296200.272503] EIP: 0060:[<c03296e0>] EFLAGS: 00000206 CPU: 1
Sep 25 20:06:33 kolache kernel: [296200.272503] EIP is at _spin_lock+0xe/0x15
Sep 25 20:06:33 kolache kernel: [296200.272503] EAX: c04fb9c4 EBX: c04fb9c4 ECX: 8b7d58ee EDX: 00002a2d
Sep 25 20:06:33 kolache kernel: [296200.272503] ESI: b80eeba0 EDI: 00000000 EBP: c3408000 ESP: c3409ed0
Sep 25 20:06:33 kolache kernel: [296200.272503]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:06:33 kolache kernel: [296200.272503] CR0: 8005003b CR2: b7f03340 CR3: 1710c000 CR4: 000006f0
Sep 25 20:06:33 kolache kernel: [296200.272503] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:06:33 kolache kernel: [296200.272503] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:06:33 kolache kernel: [296200.272503] Call Trace:
Sep 25 20:06:33 kolache kernel: [296200.272503]  [<c0147a31>] ? futex_wake+0x4d/0xbd
Sep 25 20:06:33 kolache kernel: [296200.272503]  [<c0148962>] ? do_futex+0x99/0x7bd
Sep 25 20:06:33 kolache kernel: [296200.272503]  [<c01203d4>] ? kmap_atomic_prot+0xdd/0x101
Sep 25 20:06:33 kolache kernel: [296200.272503]  [<c013f3c4>] ? ktime_get_ts+0x1d/0x3f
Sep 25 20:06:33 kolache kernel: [296200.272503]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:06:33 kolache kernel: [296200.272503]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:06:33 kolache kernel: [296200.272503]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:06:36 kolache kernel: [296203.495999] BUG: soft lockup - CPU#0 stuck for 61s! [mysqld:3979]
Sep 25 20:06:36 kolache kernel: [296203.496002] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:06:36 kolache kernel: [296203.496002] 
Sep 25 20:06:36 kolache kernel: [296203.496002] Pid: 3979, comm: mysqld Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:06:36 kolache kernel: [296203.496002] EIP: 0060:[<c03296e2>] EFLAGS: 00000212 CPU: 0
Sep 25 20:06:36 kolache kernel: [296203.496002] EIP is at _spin_lock+0x10/0x15
Sep 25 20:06:36 kolache kernel: [296203.496002] EAX: c04fc4f0 EBX: c04fc4f0 ECX: ab0d1d38 EDX: 0000eef0
Sep 25 20:06:36 kolache kernel: [296203.496002] ESI: c3477e8c EDI: c3477ebc EBP: 00000000 ESP: c3477e24
Sep 25 20:06:36 kolache kernel: [296203.496002]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:06:36 kolache kernel: [296203.496002] CR0: 80050033 CR2: b79a9cf8 CR3: 3641f000 CR4: 000006f0
Sep 25 20:06:36 kolache kernel: [296203.496002] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:06:36 kolache kernel: [296203.496002] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:06:36 kolache kernel: [296203.496002] Call Trace:
Sep 25 20:06:36 kolache kernel: [296203.496002]  [<c01475c0>] ? queue_lock+0x4c/0x51
Sep 25 20:06:36 kolache kernel: [296203.496002]  [<c01476ea>] ? futex_wait+0xa0/0x332
Sep 25 20:06:36 kolache kernel: [296203.496002]  [<c01216fd>] ? __wake_up_common+0x34/0x59
Sep 25 20:06:36 kolache kernel: [296203.496002]  [<c0121fcd>] ? __wake_up+0x29/0x39
Sep 25 20:06:36 kolache kernel: [296203.496002]  [<c01479da>] ? wake_futex+0x1f/0x29
Sep 25 20:06:36 kolache kernel: [296203.496002]  [<c0147cdb>] ? futex_requeue+0x23a/0x244
Sep 25 20:06:36 kolache kernel: [296203.496002]  [<c01277d1>] ? default_wake_function+0x0/0x8
Sep 25 20:06:36 kolache kernel: [296203.496002]  [<c014893d>] ? do_futex+0x74/0x7bd
Sep 25 20:06:36 kolache kernel: [296203.496002]  [<c0121654>] ? pick_next_task+0x1a/0x30
Sep 25 20:06:36 kolache kernel: [296203.496002]  [<c032826e>] ? __schedule+0x4f1/0x746
Sep 25 20:06:36 kolache kernel: [296203.496002]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:06:36 kolache kernel: [296203.496002]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:06:36 kolache kernel: [296203.496002]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:07:39 kolache kernel: [296265.772501] BUG: soft lockup - CPU#1 stuck for 61s! [automount:355]
Sep 25 20:07:39 kolache kernel: [296265.772503] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:07:39 kolache kernel: [296265.772503] 
Sep 25 20:07:39 kolache kernel: [296265.772503] Pid: 355, comm: automount Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:07:39 kolache kernel: [296265.772503] EIP: 0060:[<c03296e0>] EFLAGS: 00000206 CPU: 1
Sep 25 20:07:39 kolache kernel: [296265.772503] EIP is at _spin_lock+0xe/0x15
Sep 25 20:07:39 kolache kernel: [296265.772503] EAX: c04fb9c4 EBX: c04fb9c4 ECX: 8b7d58ee EDX: 00002a2f
Sep 25 20:07:39 kolache kernel: [296265.772503] ESI: b80eeba0 EDI: 00000000 EBP: c3408000 ESP: c3409ed0
Sep 25 20:07:39 kolache kernel: [296265.772503]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:07:39 kolache kernel: [296265.772503] CR0: 8005003b CR2: b7f03340 CR3: 1710c000 CR4: 000006f0
Sep 25 20:07:39 kolache kernel: [296265.772503] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:07:39 kolache kernel: [296265.772503] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:07:39 kolache kernel: [296265.772503] Call Trace:
Sep 25 20:07:39 kolache kernel: [296265.772503]  [<c0147a31>] ? futex_wake+0x4d/0xbd
Sep 25 20:07:39 kolache kernel: [296265.772503]  [<c0148962>] ? do_futex+0x99/0x7bd
Sep 25 20:07:39 kolache kernel: [296265.772503]  [<c01203d4>] ? kmap_atomic_prot+0xdd/0x101
Sep 25 20:07:39 kolache kernel: [296265.772503]  [<c013f3c4>] ? ktime_get_ts+0x1d/0x3f
Sep 25 20:07:39 kolache kernel: [296265.772503]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:07:39 kolache kernel: [296265.772503]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:07:39 kolache kernel: [296265.772503]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:07:42 kolache kernel: [296268.992000] BUG: soft lockup - CPU#0 stuck for 61s! [mysqld:3979]
Sep 25 20:07:42 kolache kernel: [296268.993009] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:07:42 kolache kernel: [296268.993009] 
Sep 25 20:07:42 kolache kernel: [296268.993009] Pid: 3979, comm: mysqld Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:07:42 kolache kernel: [296268.993009] EIP: 0060:[<c03296e2>] EFLAGS: 00000216 CPU: 0
Sep 25 20:07:42 kolache kernel: [296268.993009] EIP is at _spin_lock+0x10/0x15
Sep 25 20:07:42 kolache kernel: [296268.993009] EAX: c04fc4f0 EBX: c04fc4f0 ECX: ab0d1d38 EDX: 0000eef8
Sep 25 20:07:42 kolache kernel: [296268.993009] ESI: c3477e8c EDI: c3477ebc EBP: 00000000 ESP: c3477e24
Sep 25 20:07:42 kolache kernel: [296268.993009]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:07:42 kolache kernel: [296268.993009] CR0: 80050033 CR2: b79a9cf8 CR3: 3641f000 CR4: 000006f0
Sep 25 20:07:42 kolache kernel: [296268.993009] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:07:42 kolache kernel: [296268.993009] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:07:42 kolache kernel: [296268.993009] Call Trace:
Sep 25 20:07:42 kolache kernel: [296268.993009]  [<c01475c0>] ? queue_lock+0x4c/0x51
Sep 25 20:07:42 kolache kernel: [296268.993009]  [<c01476ea>] ? futex_wait+0xa0/0x332
Sep 25 20:07:42 kolache kernel: [296268.993009]  [<c01216fd>] ? __wake_up_common+0x34/0x59
Sep 25 20:07:42 kolache kernel: [296268.993009]  [<c0121fcd>] ? __wake_up+0x29/0x39
Sep 25 20:07:42 kolache kernel: [296268.993009]  [<c01479da>] ? wake_futex+0x1f/0x29
Sep 25 20:07:42 kolache kernel: [296268.993009]  [<c0147cdb>] ? futex_requeue+0x23a/0x244
Sep 25 20:07:42 kolache kernel: [296268.993009]  [<c01277d1>] ? default_wake_function+0x0/0x8
Sep 25 20:07:42 kolache kernel: [296268.993009]  [<c014893d>] ? do_futex+0x74/0x7bd
Sep 25 20:07:42 kolache kernel: [296268.993009]  [<c0121654>] ? pick_next_task+0x1a/0x30
Sep 25 20:07:42 kolache kernel: [296268.993009]  [<c032826e>] ? __schedule+0x4f1/0x746
Sep 25 20:07:42 kolache kernel: [296268.993009]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:07:42 kolache kernel: [296268.993009]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:07:42 kolache kernel: [296268.993009]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:08:44 kolache kernel: [296331.272501] BUG: soft lockup - CPU#1 stuck for 61s! [automount:355]
Sep 25 20:08:44 kolache kernel: [296331.272503] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:08:44 kolache kernel: [296331.272503] 
Sep 25 20:08:44 kolache kernel: [296331.272503] Pid: 355, comm: automount Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:08:44 kolache kernel: [296331.272503] EIP: 0060:[<c03296e2>] EFLAGS: 00000206 CPU: 1
Sep 25 20:08:44 kolache kernel: [296331.272503] EIP is at _spin_lock+0x10/0x15
Sep 25 20:08:44 kolache kernel: [296331.272503] EAX: c04fb9c4 EBX: c04fb9c4 ECX: 8b7d58ee EDX: 00002a2f
Sep 25 20:08:44 kolache kernel: [296331.272503] ESI: b80eeba0 EDI: 00000000 EBP: c3408000 ESP: c3409ed0
Sep 25 20:08:44 kolache kernel: [296331.272503]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:08:44 kolache kernel: [296331.272503] CR0: 8005003b CR2: b7f03340 CR3: 1710c000 CR4: 000006f0
Sep 25 20:08:44 kolache kernel: [296331.272503] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:08:44 kolache kernel: [296331.272503] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:08:44 kolache kernel: [296331.272503] Call Trace:
Sep 25 20:08:44 kolache kernel: [296331.272503]  [<c0147a31>] ? futex_wake+0x4d/0xbd
Sep 25 20:08:44 kolache kernel: [296331.272503]  [<c0148962>] ? do_futex+0x99/0x7bd
Sep 25 20:08:44 kolache kernel: [296331.272503]  [<c01203d4>] ? kmap_atomic_prot+0xdd/0x101
Sep 25 20:08:44 kolache kernel: [296331.272503]  [<c013f3c4>] ? ktime_get_ts+0x1d/0x3f
Sep 25 20:08:44 kolache kernel: [296331.272503]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:08:44 kolache kernel: [296331.272503]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:08:44 kolache kernel: [296331.272503]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:08:47 kolache kernel: [296334.492000] BUG: soft lockup - CPU#0 stuck for 61s! [mysqld:3979]
Sep 25 20:08:47 kolache kernel: [296334.492002] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:08:47 kolache kernel: [296334.492002] 
Sep 25 20:08:47 kolache kernel: [296334.492002] Pid: 3979, comm: mysqld Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:08:47 kolache kernel: [296334.492002] EIP: 0060:[<c03296e2>] EFLAGS: 00000216 CPU: 0
Sep 25 20:08:47 kolache kernel: [296334.492002] EIP is at _spin_lock+0x10/0x15
Sep 25 20:08:47 kolache kernel: [296334.492002] EAX: c04fc4f0 EBX: c04fc4f0 ECX: ab0d1d38 EDX: 0000eef8
Sep 25 20:08:47 kolache kernel: [296334.492002] ESI: c3477e8c EDI: c3477ebc EBP: 00000000 ESP: c3477e24
Sep 25 20:08:47 kolache kernel: [296334.492002]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:08:47 kolache kernel: [296334.492002] CR0: 80050033 CR2: b79a9cf8 CR3: 3641f000 CR4: 000006f0
Sep 25 20:08:47 kolache kernel: [296334.492002] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:08:47 kolache kernel: [296334.492002] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:08:47 kolache kernel: [296334.492002] Call Trace:
Sep 25 20:08:47 kolache kernel: [296334.492002]  [<c01475c0>] ? queue_lock+0x4c/0x51
Sep 25 20:08:47 kolache kernel: [296334.492002]  [<c01476ea>] ? futex_wait+0xa0/0x332
Sep 25 20:08:47 kolache kernel: [296334.492002]  [<c01216fd>] ? __wake_up_common+0x34/0x59
Sep 25 20:08:47 kolache kernel: [296334.492002]  [<c0121fcd>] ? __wake_up+0x29/0x39
Sep 25 20:08:47 kolache kernel: [296334.492002]  [<c01479da>] ? wake_futex+0x1f/0x29
Sep 25 20:08:47 kolache kernel: [296334.492002]  [<c0147cdb>] ? futex_requeue+0x23a/0x244
Sep 25 20:08:47 kolache kernel: [296334.492002]  [<c01277d1>] ? default_wake_function+0x0/0x8
Sep 25 20:08:47 kolache kernel: [296334.492002]  [<c014893d>] ? do_futex+0x74/0x7bd
Sep 25 20:08:47 kolache kernel: [296334.492002]  [<c0121654>] ? pick_next_task+0x1a/0x30
Sep 25 20:08:47 kolache kernel: [296334.492002]  [<c032826e>] ? __schedule+0x4f1/0x746
Sep 25 20:08:47 kolache kernel: [296334.492002]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:08:47 kolache kernel: [296334.492002]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:08:47 kolache kernel: [296334.492002]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:09:50 kolache kernel: [296396.768521] BUG: soft lockup - CPU#1 stuck for 61s! [automount:355]
Sep 25 20:09:50 kolache kernel: [296396.768521] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:09:50 kolache kernel: [296396.768521] 
Sep 25 20:09:50 kolache kernel: [296396.768521] Pid: 355, comm: automount Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:09:50 kolache kernel: [296396.768521] EIP: 0060:[<c03296e2>] EFLAGS: 00000206 CPU: 1
Sep 25 20:09:50 kolache kernel: [296396.768521] EIP is at _spin_lock+0x10/0x15
Sep 25 20:09:50 kolache kernel: [296396.768521] EAX: c04fb9c4 EBX: c04fb9c4 ECX: 8b7d58ee EDX: 00002a2f
Sep 25 20:09:50 kolache kernel: [296396.768521] ESI: b80eeba0 EDI: 00000000 EBP: c3408000 ESP: c3409ed0
Sep 25 20:09:50 kolache kernel: [296396.768521]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:09:50 kolache kernel: [296396.768521] CR0: 8005003b CR2: b7f03340 CR3: 1710c000 CR4: 000006f0
Sep 25 20:09:50 kolache kernel: [296396.768521] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:09:50 kolache kernel: [296396.768521] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:09:50 kolache kernel: [296396.768521] Call Trace:
Sep 25 20:09:50 kolache kernel: [296396.768521]  [<c0147a31>] ? futex_wake+0x4d/0xbd
Sep 25 20:09:50 kolache kernel: [296396.768521]  [<c0148962>] ? do_futex+0x99/0x7bd
Sep 25 20:09:50 kolache kernel: [296396.768521]  [<c01203d4>] ? kmap_atomic_prot+0xdd/0x101
Sep 25 20:09:50 kolache kernel: [296396.768521]  [<c013f3c4>] ? ktime_get_ts+0x1d/0x3f
Sep 25 20:09:50 kolache kernel: [296396.768521]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:09:50 kolache kernel: [296396.768521]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:09:50 kolache kernel: [296396.768521]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:09:53 kolache kernel: [296399.992001] BUG: soft lockup - CPU#0 stuck for 61s! [mysqld:3979]
Sep 25 20:09:53 kolache kernel: [296399.992002] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:09:53 kolache kernel: [296399.992002] 
Sep 25 20:09:53 kolache kernel: [296399.992002] Pid: 3979, comm: mysqld Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:09:53 kolache kernel: [296399.992002] EIP: 0060:[<c03296e2>] EFLAGS: 00000216 CPU: 0
Sep 25 20:09:53 kolache kernel: [296399.992002] EIP is at _spin_lock+0x10/0x15
Sep 25 20:09:53 kolache kernel: [296399.992002] EAX: c04fc4f0 EBX: c04fc4f0 ECX: ab0d1d38 EDX: 0000eefa
Sep 25 20:09:53 kolache kernel: [296399.992002] ESI: c3477e8c EDI: c3477ebc EBP: 00000000 ESP: c3477e24
Sep 25 20:09:53 kolache kernel: [296399.992002]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:09:53 kolache kernel: [296399.992002] CR0: 80050033 CR2: b79a9cf8 CR3: 3641f000 CR4: 000006f0
Sep 25 20:09:53 kolache kernel: [296399.992002] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:09:53 kolache kernel: [296399.992002] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:09:53 kolache kernel: [296399.992002] Call Trace:
Sep 25 20:09:53 kolache kernel: [296399.992002]  [<c01475c0>] ? queue_lock+0x4c/0x51
Sep 25 20:09:53 kolache kernel: [296399.992002]  [<c01476ea>] ? futex_wait+0xa0/0x332
Sep 25 20:09:53 kolache kernel: [296399.992002]  [<c01216fd>] ? __wake_up_common+0x34/0x59
Sep 25 20:09:53 kolache kernel: [296399.992002]  [<c0121fcd>] ? __wake_up+0x29/0x39
Sep 25 20:09:53 kolache kernel: [296399.992002]  [<c01479da>] ? wake_futex+0x1f/0x29
Sep 25 20:09:53 kolache kernel: [296399.992002]  [<c0147cdb>] ? futex_requeue+0x23a/0x244
Sep 25 20:09:53 kolache kernel: [296399.992002]  [<c01277d1>] ? default_wake_function+0x0/0x8
Sep 25 20:09:53 kolache kernel: [296399.992002]  [<c014893d>] ? do_futex+0x74/0x7bd
Sep 25 20:09:53 kolache kernel: [296399.992002]  [<c0121654>] ? pick_next_task+0x1a/0x30
Sep 25 20:09:53 kolache kernel: [296399.992002]  [<c032826e>] ? __schedule+0x4f1/0x746
Sep 25 20:09:53 kolache kernel: [296399.992002]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:09:53 kolache kernel: [296399.992002]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:09:53 kolache kernel: [296399.992002]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:10:55 kolache kernel: [296462.268517] BUG: soft lockup - CPU#1 stuck for 61s! [automount:355]
Sep 25 20:10:55 kolache kernel: [296462.268526] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:10:55 kolache kernel: [296462.268526] 
Sep 25 20:10:55 kolache kernel: [296462.268526] Pid: 355, comm: automount Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:10:55 kolache kernel: [296462.268526] EIP: 0060:[<c03296e2>] EFLAGS: 00000206 CPU: 1
Sep 25 20:10:55 kolache kernel: [296462.268526] EIP is at _spin_lock+0x10/0x15
Sep 25 20:10:55 kolache kernel: [296462.268526] EAX: c04fb9c4 EBX: c04fb9c4 ECX: 8b7d58ee EDX: 00002a2f
Sep 25 20:10:55 kolache kernel: [296462.268526] ESI: b80eeba0 EDI: 00000000 EBP: c3408000 ESP: c3409ed0
Sep 25 20:10:55 kolache kernel: [296462.268526]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:10:55 kolache kernel: [296462.268526] CR0: 8005003b CR2: b7f03340 CR3: 1710c000 CR4: 000006f0
Sep 25 20:10:55 kolache kernel: [296462.268526] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:10:55 kolache kernel: [296462.268526] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:10:55 kolache kernel: [296462.268526] Call Trace:
Sep 25 20:10:55 kolache kernel: [296462.268526]  [<c0147a31>] ? futex_wake+0x4d/0xbd
Sep 25 20:10:55 kolache kernel: [296462.268526]  [<c0148962>] ? do_futex+0x99/0x7bd
Sep 25 20:10:55 kolache kernel: [296462.268526]  [<c01203d4>] ? kmap_atomic_prot+0xdd/0x101
Sep 25 20:10:55 kolache kernel: [296462.268526]  [<c013f3c4>] ? ktime_get_ts+0x1d/0x3f
Sep 25 20:10:55 kolache kernel: [296462.268526]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:10:55 kolache kernel: [296462.268526]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:10:55 kolache kernel: [296462.268526]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:10:58 kolache kernel: [296465.488000] BUG: soft lockup - CPU#0 stuck for 61s! [mysqld:3979]
Sep 25 20:10:58 kolache kernel: [296465.488003] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:10:58 kolache kernel: [296465.488003] 
Sep 25 20:10:58 kolache kernel: [296465.488003] Pid: 3979, comm: mysqld Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:10:58 kolache kernel: [296465.488003] EIP: 0060:[<c03296e2>] EFLAGS: 00000202 CPU: 0
Sep 25 20:10:58 kolache kernel: [296465.488003] EIP is at _spin_lock+0x10/0x15
Sep 25 20:10:58 kolache kernel: [296465.488003] EAX: c04fc4f0 EBX: c04fc4f0 ECX: ab0d1d38 EDX: 0000eefe
Sep 25 20:10:58 kolache kernel: [296465.488003] ESI: c3477e8c EDI: c3477ebc EBP: 00000000 ESP: c3477e24
Sep 25 20:10:58 kolache kernel: [296465.488003]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:10:58 kolache kernel: [296465.488003] CR0: 80050033 CR2: b79a9cf8 CR3: 3641f000 CR4: 000006f0
Sep 25 20:10:58 kolache kernel: [296465.488003] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:10:58 kolache kernel: [296465.488003] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:10:58 kolache kernel: [296465.488003] Call Trace:
Sep 25 20:10:58 kolache kernel: [296465.488003]  [<c01475c0>] ? queue_lock+0x4c/0x51
Sep 25 20:10:58 kolache kernel: [296465.488003]  [<c01476ea>] ? futex_wait+0xa0/0x332
Sep 25 20:10:58 kolache kernel: [296465.488003]  [<c01216fd>] ? __wake_up_common+0x34/0x59
Sep 25 20:10:58 kolache kernel: [296465.488003]  [<c0121fcd>] ? __wake_up+0x29/0x39
Sep 25 20:10:58 kolache kernel: [296465.488003]  [<c01479da>] ? wake_futex+0x1f/0x29
Sep 25 20:10:58 kolache kernel: [296465.488003]  [<c0147cdb>] ? futex_requeue+0x23a/0x244
Sep 25 20:10:58 kolache kernel: [296465.488003]  [<c01277d1>] ? default_wake_function+0x0/0x8
Sep 25 20:10:58 kolache kernel: [296465.488003]  [<c014893d>] ? do_futex+0x74/0x7bd
Sep 25 20:10:58 kolache kernel: [296465.488003]  [<c0121654>] ? pick_next_task+0x1a/0x30
Sep 25 20:10:58 kolache kernel: [296465.488003]  [<c032826e>] ? __schedule+0x4f1/0x746
Sep 25 20:10:58 kolache kernel: [296465.488003]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:10:58 kolache kernel: [296465.488003]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:10:58 kolache kernel: [296465.488003]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:12:01 kolache kernel: [296527.764501] BUG: soft lockup - CPU#1 stuck for 61s! [automount:355]
Sep 25 20:12:01 kolache kernel: [296527.764503] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:12:01 kolache kernel: [296527.764503] 
Sep 25 20:12:01 kolache kernel: [296527.764503] Pid: 355, comm: automount Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:12:01 kolache kernel: [296527.764503] EIP: 0060:[<c03296e2>] EFLAGS: 00000216 CPU: 1
Sep 25 20:12:01 kolache kernel: [296527.764503] EIP is at _spin_lock+0x10/0x15
Sep 25 20:12:01 kolache kernel: [296527.764503] EAX: c04fb9c4 EBX: c04fb9c4 ECX: 8b7d58ee EDX: 00002a33
Sep 25 20:12:01 kolache kernel: [296527.764503] ESI: b80eeba0 EDI: 00000000 EBP: c3408000 ESP: c3409ed0
Sep 25 20:12:01 kolache kernel: [296527.764503]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:12:01 kolache kernel: [296527.764503] CR0: 8005003b CR2: b7f03340 CR3: 1710c000 CR4: 000006f0
Sep 25 20:12:01 kolache kernel: [296527.764503] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:12:01 kolache kernel: [296527.764503] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:12:01 kolache kernel: [296527.764503] Call Trace:
Sep 25 20:12:01 kolache kernel: [296527.764503]  [<c0147a31>] ? futex_wake+0x4d/0xbd
Sep 25 20:12:01 kolache kernel: [296527.764503]  [<c0148962>] ? do_futex+0x99/0x7bd
Sep 25 20:12:01 kolache kernel: [296527.764503]  [<c01203d4>] ? kmap_atomic_prot+0xdd/0x101
Sep 25 20:12:01 kolache kernel: [296527.764503]  [<c013f3c4>] ? ktime_get_ts+0x1d/0x3f
Sep 25 20:12:01 kolache kernel: [296527.764503]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:12:01 kolache kernel: [296527.764503]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:12:01 kolache kernel: [296527.764503]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:12:04 kolache kernel: [296530.988000] BUG: soft lockup - CPU#0 stuck for 61s! [mysqld:3979]
Sep 25 20:12:04 kolache kernel: [296530.988004] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:12:04 kolache kernel: [296530.988004] 
Sep 25 20:12:04 kolache kernel: [296530.988004] Pid: 3979, comm: mysqld Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:12:04 kolache kernel: [296530.988004] EIP: 0060:[<c03296e2>] EFLAGS: 00000202 CPU: 0
Sep 25 20:12:04 kolache kernel: [296530.988004] EIP is at _spin_lock+0x10/0x15
Sep 25 20:12:04 kolache kernel: [296530.988004] EAX: c04fc4f0 EBX: c04fc4f0 ECX: ab0d1d38 EDX: 0000eefe
Sep 25 20:12:04 kolache kernel: [296530.988004] ESI: c3477e8c EDI: c3477ebc EBP: 00000000 ESP: c3477e24
Sep 25 20:12:04 kolache kernel: [296530.988004]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:12:04 kolache kernel: [296530.988004] CR0: 80050033 CR2: b79a9cf8 CR3: 3641f000 CR4: 000006f0
Sep 25 20:12:04 kolache kernel: [296530.988004] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:12:04 kolache kernel: [296530.988004] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:12:04 kolache kernel: [296530.988004] Call Trace:
Sep 25 20:12:04 kolache kernel: [296530.988004]  [<c01475c0>] ? queue_lock+0x4c/0x51
Sep 25 20:12:04 kolache kernel: [296530.988004]  [<c01476ea>] ? futex_wait+0xa0/0x332
Sep 25 20:12:04 kolache kernel: [296530.988004]  [<c01216fd>] ? __wake_up_common+0x34/0x59
Sep 25 20:12:04 kolache kernel: [296530.988004]  [<c0121fcd>] ? __wake_up+0x29/0x39
Sep 25 20:12:04 kolache kernel: [296530.988004]  [<c01479da>] ? wake_futex+0x1f/0x29
Sep 25 20:12:04 kolache kernel: [296530.988004]  [<c0147cdb>] ? futex_requeue+0x23a/0x244
Sep 25 20:12:04 kolache kernel: [296530.988004]  [<c01277d1>] ? default_wake_function+0x0/0x8
Sep 25 20:12:04 kolache kernel: [296530.988004]  [<c014893d>] ? do_futex+0x74/0x7bd
Sep 25 20:12:04 kolache kernel: [296530.988004]  [<c0121654>] ? pick_next_task+0x1a/0x30
Sep 25 20:12:04 kolache kernel: [296530.988004]  [<c032826e>] ? __schedule+0x4f1/0x746
Sep 25 20:12:04 kolache kernel: [296530.988004]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:12:04 kolache kernel: [296530.988004]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:12:04 kolache kernel: [296530.988004]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:13:06 kolache kernel: [296593.264500] BUG: soft lockup - CPU#1 stuck for 61s! [automount:355]
Sep 25 20:13:06 kolache kernel: [296593.264503] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:13:06 kolache kernel: [296593.264503] 
Sep 25 20:13:06 kolache kernel: [296593.264503] Pid: 355, comm: automount Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:13:06 kolache kernel: [296593.264503] EIP: 0060:[<c03296e2>] EFLAGS: 00000216 CPU: 1
Sep 25 20:13:06 kolache kernel: [296593.264503] EIP is at _spin_lock+0x10/0x15
Sep 25 20:13:06 kolache kernel: [296593.264503] EAX: c04fb9c4 EBX: c04fb9c4 ECX: 8b7d58ee EDX: 00002a33
Sep 25 20:13:06 kolache kernel: [296593.264503] ESI: b80eeba0 EDI: 00000000 EBP: c3408000 ESP: c3409ed0
Sep 25 20:13:06 kolache kernel: [296593.264503]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:13:06 kolache kernel: [296593.264503] CR0: 8005003b CR2: b7f03340 CR3: 1710c000 CR4: 000006f0
Sep 25 20:13:06 kolache kernel: [296593.264503] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:13:06 kolache kernel: [296593.264503] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:13:06 kolache kernel: [296593.264503] Call Trace:
Sep 25 20:13:06 kolache kernel: [296593.264503]  [<c0147a31>] ? futex_wake+0x4d/0xbd
Sep 25 20:13:06 kolache kernel: [296593.264503]  [<c0148962>] ? do_futex+0x99/0x7bd
Sep 25 20:13:06 kolache kernel: [296593.264503]  [<c01203d4>] ? kmap_atomic_prot+0xdd/0x101
Sep 25 20:13:06 kolache kernel: [296593.264503]  [<c013f3c4>] ? ktime_get_ts+0x1d/0x3f
Sep 25 20:13:06 kolache kernel: [296593.264503]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:13:06 kolache kernel: [296593.264503]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:13:06 kolache kernel: [296593.264503]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:13:09 kolache kernel: [296596.484000] BUG: soft lockup - CPU#0 stuck for 61s! [mysqld:3979]
Sep 25 20:13:09 kolache kernel: [296596.484002] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:13:09 kolache kernel: [296596.484002] 
Sep 25 20:13:09 kolache kernel: [296596.484002] Pid: 3979, comm: mysqld Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:13:09 kolache kernel: [296596.484002] EIP: 0060:[<c03296e2>] EFLAGS: 00000202 CPU: 0
Sep 25 20:13:09 kolache kernel: [296596.484002] EIP is at _spin_lock+0x10/0x15
Sep 25 20:13:09 kolache kernel: [296596.484002] EAX: c04fc4f0 EBX: c04fc4f0 ECX: ab0d1d38 EDX: 0000eefe
Sep 25 20:13:09 kolache kernel: [296596.484002] ESI: c3477e8c EDI: c3477ebc EBP: 00000000 ESP: c3477e24
Sep 25 20:13:09 kolache kernel: [296596.484002]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:13:09 kolache kernel: [296596.484002] CR0: 80050033 CR2: b79a9cf8 CR3: 3641f000 CR4: 000006f0
Sep 25 20:13:09 kolache kernel: [296596.484002] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:13:09 kolache kernel: [296596.484002] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:13:09 kolache kernel: [296596.484002] Call Trace:
Sep 25 20:13:09 kolache kernel: [296596.484002]  [<c01475c0>] ? queue_lock+0x4c/0x51
Sep 25 20:13:09 kolache kernel: [296596.484002]  [<c01476ea>] ? futex_wait+0xa0/0x332
Sep 25 20:13:09 kolache kernel: [296596.484002]  [<c01216fd>] ? __wake_up_common+0x34/0x59
Sep 25 20:13:09 kolache kernel: [296596.484002]  [<c0121fcd>] ? __wake_up+0x29/0x39
Sep 25 20:13:09 kolache kernel: [296596.484002]  [<c01479da>] ? wake_futex+0x1f/0x29
Sep 25 20:13:09 kolache kernel: [296596.484002]  [<c0147cdb>] ? futex_requeue+0x23a/0x244
Sep 25 20:13:09 kolache kernel: [296596.484002]  [<c01277d1>] ? default_wake_function+0x0/0x8
Sep 25 20:13:09 kolache kernel: [296596.484002]  [<c014893d>] ? do_futex+0x74/0x7bd
Sep 25 20:13:09 kolache kernel: [296596.484002]  [<c0121654>] ? pick_next_task+0x1a/0x30
Sep 25 20:13:09 kolache kernel: [296596.484002]  [<c032826e>] ? __schedule+0x4f1/0x746
Sep 25 20:13:09 kolache kernel: [296596.484002]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:13:09 kolache kernel: [296596.484002]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:13:09 kolache kernel: [296596.484002]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:14:12 kolache kernel: [296658.760501] BUG: soft lockup - CPU#1 stuck for 61s! [automount:355]
Sep 25 20:14:12 kolache kernel: [296658.760503] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:14:12 kolache kernel: [296658.760503] 
Sep 25 20:14:12 kolache kernel: [296658.760503] Pid: 355, comm: automount Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:14:12 kolache kernel: [296658.760503] EIP: 0060:[<c03296e2>] EFLAGS: 00000216 CPU: 1
Sep 25 20:14:12 kolache kernel: [296658.760503] EIP is at _spin_lock+0x10/0x15
Sep 25 20:14:12 kolache kernel: [296658.760503] EAX: c04fb9c4 EBX: c04fb9c4 ECX: 8b7d58ee EDX: 00002a33
Sep 25 20:14:12 kolache kernel: [296658.760503] ESI: b80eeba0 EDI: 00000000 EBP: c3408000 ESP: c3409ed0
Sep 25 20:14:12 kolache kernel: [296658.760503]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:14:12 kolache kernel: [296658.760503] CR0: 8005003b CR2: b7f03340 CR3: 1710c000 CR4: 000006f0
Sep 25 20:14:12 kolache kernel: [296658.760503] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:14:12 kolache kernel: [296658.760503] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:14:12 kolache kernel: [296658.760503] Call Trace:
Sep 25 20:14:12 kolache kernel: [296658.760503]  [<c0147a31>] ? futex_wake+0x4d/0xbd
Sep 25 20:14:12 kolache kernel: [296658.760503]  [<c0148962>] ? do_futex+0x99/0x7bd
Sep 25 20:14:12 kolache kernel: [296658.760503]  [<c01203d4>] ? kmap_atomic_prot+0xdd/0x101
Sep 25 20:14:12 kolache kernel: [296658.760503]  [<c013f3c4>] ? ktime_get_ts+0x1d/0x3f
Sep 25 20:14:12 kolache kernel: [296658.760503]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:14:12 kolache kernel: [296658.760503]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:14:12 kolache kernel: [296658.760503]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:14:15 kolache kernel: [296661.984001] BUG: soft lockup - CPU#0 stuck for 61s! [mysqld:3979]
Sep 25 20:14:15 kolache kernel: [296661.984003] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:14:15 kolache kernel: [296661.984003] 
Sep 25 20:14:15 kolache kernel: [296661.984003] Pid: 3979, comm: mysqld Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:14:15 kolache kernel: [296661.984003] EIP: 0060:[<c03296e2>] EFLAGS: 00000202 CPU: 0
Sep 25 20:14:15 kolache kernel: [296661.984003] EIP is at _spin_lock+0x10/0x15
Sep 25 20:14:15 kolache kernel: [296661.984003] EAX: c04fc4f0 EBX: c04fc4f0 ECX: ab0d1d38 EDX: 0000eefe
Sep 25 20:14:15 kolache kernel: [296661.984003] ESI: c3477e8c EDI: c3477ebc EBP: 00000000 ESP: c3477e24
Sep 25 20:14:15 kolache kernel: [296661.984003]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:14:15 kolache kernel: [296661.984003] CR0: 80050033 CR2: b79a9cf8 CR3: 3641f000 CR4: 000006f0
Sep 25 20:14:15 kolache kernel: [296661.984003] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:14:15 kolache kernel: [296661.984003] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:14:15 kolache kernel: [296661.984003] Call Trace:
Sep 25 20:14:15 kolache kernel: [296661.984003]  [<c01475c0>] ? queue_lock+0x4c/0x51
Sep 25 20:14:15 kolache kernel: [296661.984003]  [<c01476ea>] ? futex_wait+0xa0/0x332
Sep 25 20:14:15 kolache kernel: [296661.984003]  [<c01216fd>] ? __wake_up_common+0x34/0x59
Sep 25 20:14:15 kolache kernel: [296661.984003]  [<c0121fcd>] ? __wake_up+0x29/0x39
Sep 25 20:14:15 kolache kernel: [296661.984003]  [<c01479da>] ? wake_futex+0x1f/0x29
Sep 25 20:14:15 kolache kernel: [296661.984003]  [<c0147cdb>] ? futex_requeue+0x23a/0x244
Sep 25 20:14:15 kolache kernel: [296661.984003]  [<c01277d1>] ? default_wake_function+0x0/0x8
Sep 25 20:14:15 kolache kernel: [296661.984003]  [<c014893d>] ? do_futex+0x74/0x7bd
Sep 25 20:14:15 kolache kernel: [296661.984003]  [<c0121654>] ? pick_next_task+0x1a/0x30
Sep 25 20:14:15 kolache kernel: [296661.984003]  [<c032826e>] ? __schedule+0x4f1/0x746
Sep 25 20:14:15 kolache kernel: [296661.984003]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:14:15 kolache kernel: [296661.984003]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:14:15 kolache kernel: [296661.984003]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:15:17 kolache kernel: [296724.260501] BUG: soft lockup - CPU#1 stuck for 61s! [automount:355]
Sep 25 20:15:17 kolache kernel: [296724.260503] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:15:17 kolache kernel: [296724.260503] 
Sep 25 20:15:17 kolache kernel: [296724.260503] Pid: 355, comm: automount Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:15:17 kolache kernel: [296724.260503] EIP: 0060:[<c03296de>] EFLAGS: 00000216 CPU: 1
Sep 25 20:15:17 kolache kernel: [296724.260503] EIP is at _spin_lock+0xc/0x15
Sep 25 20:15:17 kolache kernel: [296724.260503] EAX: c04fb9c4 EBX: c04fb9c4 ECX: 8b7d58ee EDX: 00002a33
Sep 25 20:15:17 kolache kernel: [296724.260503] ESI: b80eeba0 EDI: 00000000 EBP: c3408000 ESP: c3409ed0
Sep 25 20:15:17 kolache kernel: [296724.260503]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:15:17 kolache kernel: [296724.260503] CR0: 8005003b CR2: b7f03340 CR3: 1710c000 CR4: 000006f0
Sep 25 20:15:17 kolache kernel: [296724.260503] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:15:17 kolache kernel: [296724.260503] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:15:17 kolache kernel: [296724.260503] Call Trace:
Sep 25 20:15:17 kolache kernel: [296724.260503]  [<c0147a31>] ? futex_wake+0x4d/0xbd
Sep 25 20:15:17 kolache kernel: [296724.260503]  [<c0148962>] ? do_futex+0x99/0x7bd
Sep 25 20:15:17 kolache kernel: [296724.260503]  [<c01203d4>] ? kmap_atomic_prot+0xdd/0x101
Sep 25 20:15:17 kolache kernel: [296724.260503]  [<c013f3c4>] ? ktime_get_ts+0x1d/0x3f
Sep 25 20:15:17 kolache kernel: [296724.260503]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:15:17 kolache kernel: [296724.260503]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:15:17 kolache kernel: [296724.260503]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:15:20 kolache kernel: [296727.479999] BUG: soft lockup - CPU#0 stuck for 61s! [mysqld:3979]
Sep 25 20:15:20 kolache kernel: [296727.480002] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:15:20 kolache kernel: [296727.480002] 
Sep 25 20:15:20 kolache kernel: [296727.480002] Pid: 3979, comm: mysqld Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:15:20 kolache kernel: [296727.480002] EIP: 0060:[<c03296e2>] EFLAGS: 00000202 CPU: 0
Sep 25 20:15:20 kolache kernel: [296727.480002] EIP is at _spin_lock+0x10/0x15
Sep 25 20:15:20 kolache kernel: [296727.480002] EAX: c04fc4f0 EBX: c04fc4f0 ECX: ab0d1d38 EDX: 0000eefe
Sep 25 20:15:20 kolache kernel: [296727.480002] ESI: c3477e8c EDI: c3477ebc EBP: 00000000 ESP: c3477e24
Sep 25 20:15:20 kolache kernel: [296727.480002]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:15:20 kolache kernel: [296727.480002] CR0: 80050033 CR2: b79a9cf8 CR3: 3641f000 CR4: 000006f0
Sep 25 20:15:20 kolache kernel: [296727.480002] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:15:20 kolache kernel: [296727.480002] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:15:20 kolache kernel: [296727.480002] Call Trace:
Sep 25 20:15:20 kolache kernel: [296727.480002]  [<c01475c0>] ? queue_lock+0x4c/0x51
Sep 25 20:15:20 kolache kernel: [296727.480002]  [<c01476ea>] ? futex_wait+0xa0/0x332
Sep 25 20:15:20 kolache kernel: [296727.480002]  [<c01216fd>] ? __wake_up_common+0x34/0x59
Sep 25 20:15:20 kolache kernel: [296727.480002]  [<c0121fcd>] ? __wake_up+0x29/0x39
Sep 25 20:15:20 kolache kernel: [296727.480002]  [<c01479da>] ? wake_futex+0x1f/0x29
Sep 25 20:15:20 kolache kernel: [296727.480002]  [<c0147cdb>] ? futex_requeue+0x23a/0x244
Sep 25 20:15:20 kolache kernel: [296727.480002]  [<c01277d1>] ? default_wake_function+0x0/0x8
Sep 25 20:15:20 kolache kernel: [296727.480002]  [<c014893d>] ? do_futex+0x74/0x7bd
Sep 25 20:15:20 kolache kernel: [296727.480002]  [<c0121654>] ? pick_next_task+0x1a/0x30
Sep 25 20:15:20 kolache kernel: [296727.480002]  [<c032826e>] ? __schedule+0x4f1/0x746
Sep 25 20:15:20 kolache kernel: [296727.480002]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:15:20 kolache kernel: [296727.480002]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:15:20 kolache kernel: [296727.480002]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:16:23 kolache kernel: [296789.756532] BUG: soft lockup - CPU#1 stuck for 61s! [automount:355]
Sep 25 20:16:23 kolache kernel: [296789.756532] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:16:23 kolache kernel: [296789.756532] 
Sep 25 20:16:23 kolache kernel: [296789.756532] Pid: 355, comm: automount Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:16:23 kolache kernel: [296789.756532] EIP: 0060:[<c03296e2>] EFLAGS: 00000212 CPU: 1
Sep 25 20:16:23 kolache kernel: [296789.756532] EIP is at _spin_lock+0x10/0x15
Sep 25 20:16:23 kolache kernel: [296789.756532] EAX: c04fb9c4 EBX: c04fb9c4 ECX: 8b7d58ee EDX: 00002a35
Sep 25 20:16:23 kolache kernel: [296789.756532] ESI: b80eeba0 EDI: 00000000 EBP: c3408000 ESP: c3409ed0
Sep 25 20:16:23 kolache kernel: [296789.756532]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:16:23 kolache kernel: [296789.756532] CR0: 8005003b CR2: b7f03340 CR3: 1710c000 CR4: 000006f0
Sep 25 20:16:23 kolache kernel: [296789.756532] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:16:23 kolache kernel: [296789.756532] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:16:23 kolache kernel: [296789.756532] Call Trace:
Sep 25 20:16:23 kolache kernel: [296789.756532]  [<c0147a31>] ? futex_wake+0x4d/0xbd
Sep 25 20:16:23 kolache kernel: [296789.756532]  [<c0148962>] ? do_futex+0x99/0x7bd
Sep 25 20:16:23 kolache kernel: [296789.756532]  [<c01203d4>] ? kmap_atomic_prot+0xdd/0x101
Sep 25 20:16:23 kolache kernel: [296789.756532]  [<c013f3c4>] ? ktime_get_ts+0x1d/0x3f
Sep 25 20:16:23 kolache kernel: [296789.756532]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:16:23 kolache kernel: [296789.756532]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:16:23 kolache kernel: [296789.756532]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:16:26 kolache kernel: [296792.980041] BUG: soft lockup - CPU#0 stuck for 61s! [mysqld:3979]
Sep 25 20:16:26 kolache kernel: [296792.980070] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:16:26 kolache kernel: [296792.980095] 
Sep 25 20:16:26 kolache kernel: [296792.980095] Pid: 3979, comm: mysqld Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:16:26 kolache kernel: [296792.980095] EIP: 0060:[<c03296de>] EFLAGS: 00000202 CPU: 0
Sep 25 20:16:26 kolache kernel: [296792.980095] EIP is at _spin_lock+0xc/0x15
Sep 25 20:16:26 kolache kernel: [296792.980095] EAX: c04fc4f0 EBX: c04fc4f0 ECX: ab0d1d38 EDX: 0000eefe
Sep 25 20:16:26 kolache kernel: [296792.980095] ESI: c3477e8c EDI: c3477ebc EBP: 00000000 ESP: c3477e24
Sep 25 20:16:26 kolache kernel: [296792.980095]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:16:26 kolache kernel: [296792.980095] CR0: 80050033 CR2: b79a9cf8 CR3: 3641f000 CR4: 000006f0
Sep 25 20:16:26 kolache kernel: [296792.980095] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:16:26 kolache kernel: [296792.980095] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:16:26 kolache kernel: [296792.980095] Call Trace:
Sep 25 20:16:26 kolache kernel: [296792.980095]  [<c01475c0>] ? queue_lock+0x4c/0x51
Sep 25 20:16:26 kolache kernel: [296792.980095]  [<c01476ea>] ? futex_wait+0xa0/0x332
Sep 25 20:16:26 kolache kernel: [296792.980095]  [<c01216fd>] ? __wake_up_common+0x34/0x59
Sep 25 20:16:26 kolache kernel: [296792.980095]  [<c0121fcd>] ? __wake_up+0x29/0x39
Sep 25 20:16:26 kolache kernel: [296792.980095]  [<c01479da>] ? wake_futex+0x1f/0x29
Sep 25 20:16:26 kolache kernel: [296792.980095]  [<c0147cdb>] ? futex_requeue+0x23a/0x244
Sep 25 20:16:26 kolache kernel: [296792.980095]  [<c01277d1>] ? default_wake_function+0x0/0x8
Sep 25 20:16:26 kolache kernel: [296792.980095]  [<c014893d>] ? do_futex+0x74/0x7bd
Sep 25 20:16:26 kolache kernel: [296792.980095]  [<c0121654>] ? pick_next_task+0x1a/0x30
Sep 25 20:16:26 kolache kernel: [296792.980095]  [<c032826e>] ? __schedule+0x4f1/0x746
Sep 25 20:16:26 kolache kernel: [296792.980095]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:16:26 kolache kernel: [296792.980095]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:16:26 kolache kernel: [296792.980095]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:17:28 kolache kernel: [296855.256504] BUG: soft lockup - CPU#1 stuck for 61s! [automount:355]
Sep 25 20:17:28 kolache kernel: [296855.256504] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:17:28 kolache kernel: [296855.256504] 
Sep 25 20:17:28 kolache kernel: [296855.256504] Pid: 355, comm: automount Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:17:28 kolache kernel: [296855.256504] EIP: 0060:[<c03296e4>] EFLAGS: 00000216 CPU: 1
Sep 25 20:17:28 kolache kernel: [296855.256504] EIP is at _spin_lock+0x12/0x15
Sep 25 20:17:28 kolache kernel: [296855.256504] EAX: c04fb9c4 EBX: c04fb9c4 ECX: 8b7d58ee EDX: 00002a55
Sep 25 20:17:28 kolache kernel: [296855.256504] ESI: b80eeba0 EDI: 00000000 EBP: c3408000 ESP: c3409ed0
Sep 25 20:17:28 kolache kernel: [296855.256504]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:17:28 kolache kernel: [296855.256504] CR0: 8005003b CR2: b7f03340 CR3: 1710c000 CR4: 000006f0
Sep 25 20:17:28 kolache kernel: [296855.256504] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:17:28 kolache kernel: [296855.256504] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:17:28 kolache kernel: [296855.256504] Call Trace:
Sep 25 20:17:28 kolache kernel: [296855.256504]  [<c0147a31>] ? futex_wake+0x4d/0xbd
Sep 25 20:17:28 kolache kernel: [296855.256504]  [<c0148962>] ? do_futex+0x99/0x7bd
Sep 25 20:17:28 kolache kernel: [296855.256504]  [<c01203d4>] ? kmap_atomic_prot+0xdd/0x101
Sep 25 20:17:28 kolache kernel: [296855.256504]  [<c013f3c4>] ? ktime_get_ts+0x1d/0x3f
Sep 25 20:17:28 kolache kernel: [296855.256504]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:17:28 kolache kernel: [296855.256504]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:17:28 kolache kernel: [296855.256504]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:17:31 kolache kernel: [296858.476003] BUG: soft lockup - CPU#0 stuck for 61s! [mysqld:3979]
Sep 25 20:17:31 kolache kernel: [296858.476003] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:17:31 kolache kernel: [296858.476003] 
Sep 25 20:17:31 kolache kernel: [296858.476003] Pid: 3979, comm: mysqld Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:17:31 kolache kernel: [296858.476003] EIP: 0060:[<c03296e2>] EFLAGS: 00000217 CPU: 0
Sep 25 20:17:31 kolache kernel: [296858.476003] EIP is at _spin_lock+0x10/0x15
Sep 25 20:17:31 kolache kernel: [296858.476003] EAX: c04fc4f0 EBX: c04fc4f0 ECX: ab0d1d38 EDX: 0000ee0b
Sep 25 20:17:31 kolache kernel: [296858.476003] ESI: c3477e8c EDI: c3477ebc EBP: 00000000 ESP: c3477e24
Sep 25 20:17:31 kolache kernel: [296858.476003]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:17:31 kolache kernel: [296858.476003] CR0: 80050033 CR2: b79a9cf8 CR3: 3641f000 CR4: 000006f0
Sep 25 20:17:31 kolache kernel: [296858.476003] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:17:31 kolache kernel: [296858.476003] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:17:31 kolache kernel: [296858.476003] Call Trace:
Sep 25 20:17:31 kolache kernel: [296858.476003]  [<c01475c0>] ? queue_lock+0x4c/0x51
Sep 25 20:17:31 kolache kernel: [296858.476003]  [<c01476ea>] ? futex_wait+0xa0/0x332
Sep 25 20:17:31 kolache kernel: [296858.476003]  [<c01216fd>] ? __wake_up_common+0x34/0x59
Sep 25 20:17:31 kolache kernel: [296858.476003]  [<c0121fcd>] ? __wake_up+0x29/0x39
Sep 25 20:17:31 kolache kernel: [296858.476003]  [<c01479da>] ? wake_futex+0x1f/0x29
Sep 25 20:17:31 kolache kernel: [296858.476003]  [<c0147cdb>] ? futex_requeue+0x23a/0x244
Sep 25 20:17:31 kolache kernel: [296858.476003]  [<c01277d1>] ? default_wake_function+0x0/0x8
Sep 25 20:17:31 kolache kernel: [296858.476003]  [<c014893d>] ? do_futex+0x74/0x7bd
Sep 25 20:17:31 kolache kernel: [296858.476003]  [<c0121654>] ? pick_next_task+0x1a/0x30
Sep 25 20:17:31 kolache kernel: [296858.476003]  [<c032826e>] ? __schedule+0x4f1/0x746
Sep 25 20:17:31 kolache kernel: [296858.476003]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:17:31 kolache kernel: [296858.476003]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:17:31 kolache kernel: [296858.476003]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:18:34 kolache kernel: [296920.756504] BUG: soft lockup - CPU#1 stuck for 61s! [automount:355]
Sep 25 20:18:34 kolache kernel: [296920.756504] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:18:34 kolache kernel: [296920.756504] 
Sep 25 20:18:34 kolache kernel: [296920.756504] Pid: 355, comm: automount Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:18:34 kolache kernel: [296920.756504] EIP: 0060:[<c03296e2>] EFLAGS: 00000216 CPU: 1
Sep 25 20:18:34 kolache kernel: [296920.756504] EIP is at _spin_lock+0x10/0x15
Sep 25 20:18:34 kolache kernel: [296920.756504] EAX: c04fb9c4 EBX: c04fb9c4 ECX: 8b7d58ee EDX: 00002a55
Sep 25 20:18:34 kolache kernel: [296920.756504] ESI: b80eeba0 EDI: 00000000 EBP: c3408000 ESP: c3409ed0
Sep 25 20:18:34 kolache kernel: [296920.756504]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:18:34 kolache kernel: [296920.756504] CR0: 8005003b CR2: b7f03340 CR3: 1710c000 CR4: 000006f0
Sep 25 20:18:34 kolache kernel: [296920.756504] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:18:34 kolache kernel: [296920.756504] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:18:34 kolache kernel: [296920.756504] Call Trace:
Sep 25 20:18:34 kolache kernel: [296920.756504]  [<c0147a31>] ? futex_wake+0x4d/0xbd
Sep 25 20:18:34 kolache kernel: [296920.756504]  [<c0148962>] ? do_futex+0x99/0x7bd
Sep 25 20:18:34 kolache kernel: [296920.756504]  [<c01203d4>] ? kmap_atomic_prot+0xdd/0x101
Sep 25 20:18:34 kolache kernel: [296920.756504]  [<c013f3c4>] ? ktime_get_ts+0x1d/0x3f
Sep 25 20:18:34 kolache kernel: [296920.756504]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:18:34 kolache kernel: [296920.756504]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:18:34 kolache kernel: [296920.756504]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:18:37 kolache kernel: [296923.976003] BUG: soft lockup - CPU#0 stuck for 61s! [mysqld:3979]
Sep 25 20:18:37 kolache kernel: [296923.976004] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:18:37 kolache kernel: [296923.976004] 
Sep 25 20:18:37 kolache kernel: [296923.976004] Pid: 3979, comm: mysqld Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:18:37 kolache kernel: [296923.976004] EIP: 0060:[<c03296e2>] EFLAGS: 00000217 CPU: 0
Sep 25 20:18:37 kolache kernel: [296923.976004] EIP is at _spin_lock+0x10/0x15
Sep 25 20:18:37 kolache kernel: [296923.976004] EAX: c04fc4f0 EBX: c04fc4f0 ECX: ab0d1d38 EDX: 0000ee0b
Sep 25 20:18:37 kolache kernel: [296923.976004] ESI: c3477e8c EDI: c3477ebc EBP: 00000000 ESP: c3477e24
Sep 25 20:18:37 kolache kernel: [296923.976004]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:18:37 kolache kernel: [296923.976004] CR0: 80050033 CR2: b79a9cf8 CR3: 3641f000 CR4: 000006f0
Sep 25 20:18:37 kolache kernel: [296923.976004] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:18:37 kolache kernel: [296923.976004] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:18:37 kolache kernel: [296923.976004] Call Trace:
Sep 25 20:18:37 kolache kernel: [296923.976004]  [<c01475c0>] ? queue_lock+0x4c/0x51
Sep 25 20:18:37 kolache kernel: [296923.976004]  [<c01476ea>] ? futex_wait+0xa0/0x332
Sep 25 20:18:37 kolache kernel: [296923.976004]  [<c01216fd>] ? __wake_up_common+0x34/0x59
Sep 25 20:18:37 kolache kernel: [296923.976004]  [<c0121fcd>] ? __wake_up+0x29/0x39
Sep 25 20:18:37 kolache kernel: [296923.976004]  [<c01479da>] ? wake_futex+0x1f/0x29
Sep 25 20:18:37 kolache kernel: [296923.976004]  [<c0147cdb>] ? futex_requeue+0x23a/0x244
Sep 25 20:18:37 kolache kernel: [296923.976004]  [<c01277d1>] ? default_wake_function+0x0/0x8
Sep 25 20:18:37 kolache kernel: [296923.976004]  [<c014893d>] ? do_futex+0x74/0x7bd
Sep 25 20:18:37 kolache kernel: [296923.976004]  [<c0121654>] ? pick_next_task+0x1a/0x30
Sep 25 20:18:37 kolache kernel: [296923.976004]  [<c032826e>] ? __schedule+0x4f1/0x746
Sep 25 20:18:37 kolache kernel: [296923.976004]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:18:37 kolache kernel: [296923.976004]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:18:37 kolache kernel: [296923.976004]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:19:39 kolache kernel: [296986.252504] BUG: soft lockup - CPU#1 stuck for 61s! [automount:355]
Sep 25 20:19:39 kolache kernel: [296986.252504] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:19:39 kolache kernel: [296986.252504] 
Sep 25 20:19:39 kolache kernel: [296986.252504] Pid: 355, comm: automount Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:19:39 kolache kernel: [296986.252504] EIP: 0060:[<c03296e2>] EFLAGS: 00000216 CPU: 1
Sep 25 20:19:39 kolache kernel: [296986.252504] EIP is at _spin_lock+0x10/0x15
Sep 25 20:19:39 kolache kernel: [296986.252504] EAX: c04fb9c4 EBX: c04fb9c4 ECX: 8b7d58ee EDX: 00002a55
Sep 25 20:19:39 kolache kernel: [296986.252504] ESI: b80eeba0 EDI: 00000000 EBP: c3408000 ESP: c3409ed0
Sep 25 20:19:39 kolache kernel: [296986.252504]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:19:39 kolache kernel: [296986.252504] CR0: 8005003b CR2: b7f03340 CR3: 1710c000 CR4: 000006f0
Sep 25 20:19:39 kolache kernel: [296986.252504] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:19:39 kolache kernel: [296986.252504] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:19:39 kolache kernel: [296986.252504] Call Trace:
Sep 25 20:19:39 kolache kernel: [296986.252504]  [<c0147a31>] ? futex_wake+0x4d/0xbd
Sep 25 20:19:39 kolache kernel: [296986.252504]  [<c0148962>] ? do_futex+0x99/0x7bd
Sep 25 20:19:39 kolache kernel: [296986.252504]  [<c01203d4>] ? kmap_atomic_prot+0xdd/0x101
Sep 25 20:19:39 kolache kernel: [296986.252504]  [<c013f3c4>] ? ktime_get_ts+0x1d/0x3f
Sep 25 20:19:39 kolache kernel: [296986.252504]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:19:39 kolache kernel: [296986.252504]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:19:39 kolache kernel: [296986.252504]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:19:42 kolache kernel: [296989.476004] BUG: soft lockup - CPU#0 stuck for 61s! [mysqld:3979]
Sep 25 20:19:42 kolache kernel: [296989.476004] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:19:42 kolache kernel: [296989.476004] 
Sep 25 20:19:42 kolache kernel: [296989.476004] Pid: 3979, comm: mysqld Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:19:42 kolache kernel: [296989.476004] EIP: 0060:[<c03296e0>] EFLAGS: 00000217 CPU: 0
Sep 25 20:19:42 kolache kernel: [296989.476004] EIP is at _spin_lock+0xe/0x15
Sep 25 20:19:42 kolache kernel: [296989.476004] EAX: c04fc4f0 EBX: c04fc4f0 ECX: ab0d1d38 EDX: 0000ee0b
Sep 25 20:19:42 kolache kernel: [296989.476004] ESI: c3477e8c EDI: c3477ebc EBP: 00000000 ESP: c3477e24
Sep 25 20:19:42 kolache kernel: [296989.476004]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:19:42 kolache kernel: [296989.476004] CR0: 80050033 CR2: b79a9cf8 CR3: 3641f000 CR4: 000006f0
Sep 25 20:19:42 kolache kernel: [296989.476004] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:19:42 kolache kernel: [296989.476004] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:19:42 kolache kernel: [296989.476004] Call Trace:
Sep 25 20:19:42 kolache kernel: [296989.476004]  [<c01475c0>] ? queue_lock+0x4c/0x51
Sep 25 20:19:42 kolache kernel: [296989.476004]  [<c01476ea>] ? futex_wait+0xa0/0x332
Sep 25 20:19:42 kolache kernel: [296989.476004]  [<c01216fd>] ? __wake_up_common+0x34/0x59
Sep 25 20:19:42 kolache kernel: [296989.476004]  [<c0121fcd>] ? __wake_up+0x29/0x39
Sep 25 20:19:42 kolache kernel: [296989.476004]  [<c01479da>] ? wake_futex+0x1f/0x29
Sep 25 20:19:42 kolache kernel: [296989.476004]  [<c0147cdb>] ? futex_requeue+0x23a/0x244
Sep 25 20:19:42 kolache kernel: [296989.476004]  [<c01277d1>] ? default_wake_function+0x0/0x8
Sep 25 20:19:42 kolache kernel: [296989.476004]  [<c014893d>] ? do_futex+0x74/0x7bd
Sep 25 20:19:42 kolache kernel: [296989.476004]  [<c0121654>] ? pick_next_task+0x1a/0x30
Sep 25 20:19:42 kolache kernel: [296989.476004]  [<c032826e>] ? __schedule+0x4f1/0x746
Sep 25 20:19:42 kolache kernel: [296989.476004]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:19:42 kolache kernel: [296989.476004]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:19:42 kolache kernel: [296989.476004]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:20:45 kolache kernel: [297051.752504] BUG: soft lockup - CPU#1 stuck for 61s! [automount:355]
Sep 25 20:20:45 kolache kernel: [297051.752504] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:20:45 kolache kernel: [297051.752504] 
Sep 25 20:20:45 kolache kernel: [297051.752504] Pid: 355, comm: automount Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:20:45 kolache kernel: [297051.752504] EIP: 0060:[<c03296e2>] EFLAGS: 00000216 CPU: 1
Sep 25 20:20:45 kolache kernel: [297051.752504] EIP is at _spin_lock+0x10/0x15
Sep 25 20:20:45 kolache kernel: [297051.752504] EAX: c04fb9c4 EBX: c04fb9c4 ECX: 8b7d58ee EDX: 00002a55
Sep 25 20:20:45 kolache kernel: [297051.752504] ESI: b80eeba0 EDI: 00000000 EBP: c3408000 ESP: c3409ed0
Sep 25 20:20:45 kolache kernel: [297051.752504]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:20:45 kolache kernel: [297051.752504] CR0: 8005003b CR2: b7f03340 CR3: 1710c000 CR4: 000006f0
Sep 25 20:20:45 kolache kernel: [297051.752504] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:20:45 kolache kernel: [297051.752504] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:20:45 kolache kernel: [297051.752504] Call Trace:
Sep 25 20:20:45 kolache kernel: [297051.752504]  [<c0147a31>] ? futex_wake+0x4d/0xbd
Sep 25 20:20:45 kolache kernel: [297051.752504]  [<c0148962>] ? do_futex+0x99/0x7bd
Sep 25 20:20:45 kolache kernel: [297051.752504]  [<c01203d4>] ? kmap_atomic_prot+0xdd/0x101
Sep 25 20:20:45 kolache kernel: [297051.752504]  [<c013f3c4>] ? ktime_get_ts+0x1d/0x3f
Sep 25 20:20:45 kolache kernel: [297051.752504]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:20:45 kolache kernel: [297051.752504]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:20:45 kolache kernel: [297051.752504]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:20:48 kolache kernel: [297054.972003] BUG: soft lockup - CPU#0 stuck for 61s! [mysqld:3979]
Sep 25 20:20:48 kolache kernel: [297054.972003] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:20:48 kolache kernel: [297054.972003] 
Sep 25 20:20:48 kolache kernel: [297054.972003] Pid: 3979, comm: mysqld Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:20:48 kolache kernel: [297054.972003] EIP: 0060:[<c03296e2>] EFLAGS: 00000217 CPU: 0
Sep 25 20:20:48 kolache kernel: [297054.972003] EIP is at _spin_lock+0x10/0x15
Sep 25 20:20:48 kolache kernel: [297054.972003] EAX: c04fc4f0 EBX: c04fc4f0 ECX: ab0d1d38 EDX: 0000ee0b
Sep 25 20:20:48 kolache kernel: [297054.972003] ESI: c3477e8c EDI: c3477ebc EBP: 00000000 ESP: c3477e24
Sep 25 20:20:48 kolache kernel: [297054.972003]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:20:48 kolache kernel: [297054.972003] CR0: 80050033 CR2: b79a9cf8 CR3: 3641f000 CR4: 000006f0
Sep 25 20:20:48 kolache kernel: [297054.972003] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:20:48 kolache kernel: [297054.972003] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:20:48 kolache kernel: [297054.972003] Call Trace:
Sep 25 20:20:48 kolache kernel: [297054.972003]  [<c01475c0>] ? queue_lock+0x4c/0x51
Sep 25 20:20:48 kolache kernel: [297054.972003]  [<c01476ea>] ? futex_wait+0xa0/0x332
Sep 25 20:20:48 kolache kernel: [297054.972003]  [<c01216fd>] ? __wake_up_common+0x34/0x59
Sep 25 20:20:48 kolache kernel: [297054.972003]  [<c0121fcd>] ? __wake_up+0x29/0x39
Sep 25 20:20:48 kolache kernel: [297054.972003]  [<c01479da>] ? wake_futex+0x1f/0x29
Sep 25 20:20:48 kolache kernel: [297054.972003]  [<c0147cdb>] ? futex_requeue+0x23a/0x244
Sep 25 20:20:48 kolache kernel: [297054.972003]  [<c01277d1>] ? default_wake_function+0x0/0x8
Sep 25 20:20:48 kolache kernel: [297054.972003]  [<c014893d>] ? do_futex+0x74/0x7bd
Sep 25 20:20:48 kolache kernel: [297054.972003]  [<c0121654>] ? pick_next_task+0x1a/0x30
Sep 25 20:20:48 kolache kernel: [297054.972003]  [<c032826e>] ? __schedule+0x4f1/0x746
Sep 25 20:20:48 kolache kernel: [297054.972003]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:20:48 kolache kernel: [297054.972003]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:20:48 kolache kernel: [297054.972003]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:21:50 kolache kernel: [297117.248504] BUG: soft lockup - CPU#1 stuck for 61s! [automount:355]
Sep 25 20:21:50 kolache kernel: [297117.248504] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:21:50 kolache kernel: [297117.248504] 
Sep 25 20:21:50 kolache kernel: [297117.248504] Pid: 355, comm: automount Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:21:50 kolache kernel: [297117.248504] EIP: 0060:[<c03296e2>] EFLAGS: 00000216 CPU: 1
Sep 25 20:21:50 kolache kernel: [297117.248504] EIP is at _spin_lock+0x10/0x15
Sep 25 20:21:50 kolache kernel: [297117.248504] EAX: c04fb9c4 EBX: c04fb9c4 ECX: 8b7d58ee EDX: 00002a55
Sep 25 20:21:50 kolache kernel: [297117.248504] ESI: b80eeba0 EDI: 00000000 EBP: c3408000 ESP: c3409ed0
Sep 25 20:21:50 kolache kernel: [297117.248504]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:21:50 kolache kernel: [297117.248504] CR0: 8005003b CR2: b7f03340 CR3: 1710c000 CR4: 000006f0
Sep 25 20:21:50 kolache kernel: [297117.248504] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:21:50 kolache kernel: [297117.248504] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:21:50 kolache kernel: [297117.248504] Call Trace:
Sep 25 20:21:50 kolache kernel: [297117.248504]  [<c0147a31>] ? futex_wake+0x4d/0xbd
Sep 25 20:21:50 kolache kernel: [297117.248504]  [<c0148962>] ? do_futex+0x99/0x7bd
Sep 25 20:21:50 kolache kernel: [297117.248504]  [<c01203d4>] ? kmap_atomic_prot+0xdd/0x101
Sep 25 20:21:50 kolache kernel: [297117.248504]  [<c013f3c4>] ? ktime_get_ts+0x1d/0x3f
Sep 25 20:21:50 kolache kernel: [297117.248504]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:21:50 kolache kernel: [297117.248504]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:21:50 kolache kernel: [297117.248504]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:21:53 kolache kernel: [297120.472003] BUG: soft lockup - CPU#0 stuck for 61s! [mysqld:3979]
Sep 25 20:21:53 kolache kernel: [297120.472004] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:21:53 kolache kernel: [297120.472004] 
Sep 25 20:21:53 kolache kernel: [297120.472004] Pid: 3979, comm: mysqld Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:21:53 kolache kernel: [297120.472004] EIP: 0060:[<c03296e4>] EFLAGS: 00000217 CPU: 0
Sep 25 20:21:53 kolache kernel: [297120.472004] EIP is at _spin_lock+0x12/0x15
Sep 25 20:21:53 kolache kernel: [297120.472004] EAX: c04fc4f0 EBX: c04fc4f0 ECX: ab0d1d38 EDX: 0000ee0b
Sep 25 20:21:53 kolache kernel: [297120.472004] ESI: c3477e8c EDI: c3477ebc EBP: 00000000 ESP: c3477e24
Sep 25 20:21:53 kolache kernel: [297120.472004]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:21:53 kolache kernel: [297120.472004] CR0: 80050033 CR2: b79a9cf8 CR3: 3641f000 CR4: 000006f0
Sep 25 20:21:53 kolache kernel: [297120.472004] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:21:53 kolache kernel: [297120.472004] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:21:53 kolache kernel: [297120.472004] Call Trace:
Sep 25 20:21:53 kolache kernel: [297120.472004]  [<c01475c0>] ? queue_lock+0x4c/0x51
Sep 25 20:21:53 kolache kernel: [297120.472004]  [<c01476ea>] ? futex_wait+0xa0/0x332
Sep 25 20:21:53 kolache kernel: [297120.472004]  [<c01216fd>] ? __wake_up_common+0x34/0x59
Sep 25 20:21:53 kolache kernel: [297120.472004]  [<c0121fcd>] ? __wake_up+0x29/0x39
Sep 25 20:21:53 kolache kernel: [297120.472004]  [<c01479da>] ? wake_futex+0x1f/0x29
Sep 25 20:21:53 kolache kernel: [297120.472004]  [<c0147cdb>] ? futex_requeue+0x23a/0x244
Sep 25 20:21:53 kolache kernel: [297120.472004]  [<c01277d1>] ? default_wake_function+0x0/0x8
Sep 25 20:21:53 kolache kernel: [297120.472004]  [<c014893d>] ? do_futex+0x74/0x7bd
Sep 25 20:21:53 kolache kernel: [297120.472004]  [<c0121654>] ? pick_next_task+0x1a/0x30
Sep 25 20:21:53 kolache kernel: [297120.472004]  [<c032826e>] ? __schedule+0x4f1/0x746
Sep 25 20:21:53 kolache kernel: [297120.472004]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:21:53 kolache kernel: [297120.472004]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:21:53 kolache kernel: [297120.472004]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:22:56 kolache kernel: [297182.748521] BUG: soft lockup - CPU#1 stuck for 61s! [automount:355]
Sep 25 20:22:56 kolache kernel: [297182.748522] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:22:56 kolache kernel: [297182.748522] 
Sep 25 20:22:56 kolache kernel: [297182.748522] Pid: 355, comm: automount Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:22:56 kolache kernel: [297182.748522] EIP: 0060:[<c03296e2>] EFLAGS: 00000216 CPU: 1
Sep 25 20:22:56 kolache kernel: [297182.748522] EIP is at _spin_lock+0x10/0x15
Sep 25 20:22:56 kolache kernel: [297182.748522] EAX: c04fb9c4 EBX: c04fb9c4 ECX: 8b7d58ee EDX: 00002a55
Sep 25 20:22:56 kolache kernel: [297182.748522] ESI: b80eeba0 EDI: 00000000 EBP: c3408000 ESP: c3409ed0
Sep 25 20:22:56 kolache kernel: [297182.748522]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:22:56 kolache kernel: [297182.748522] CR0: 8005003b CR2: b7f03340 CR3: 1710c000 CR4: 000006f0
Sep 25 20:22:56 kolache kernel: [297182.748522] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:22:56 kolache kernel: [297182.748522] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:22:56 kolache kernel: [297182.748522] Call Trace:
Sep 25 20:22:56 kolache kernel: [297182.748522]  [<c0147a31>] ? futex_wake+0x4d/0xbd
Sep 25 20:22:56 kolache kernel: [297182.748522]  [<c0148962>] ? do_futex+0x99/0x7bd
Sep 25 20:22:56 kolache kernel: [297182.748522]  [<c01203d4>] ? kmap_atomic_prot+0xdd/0x101
Sep 25 20:22:56 kolache kernel: [297182.748522]  [<c013f3c4>] ? ktime_get_ts+0x1d/0x3f
Sep 25 20:22:56 kolache kernel: [297182.748522]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:22:56 kolache kernel: [297182.748522]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:22:56 kolache kernel: [297182.748522]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:22:59 kolache kernel: [297185.968004] BUG: soft lockup - CPU#0 stuck for 61s! [mysqld:3979]
Sep 25 20:22:59 kolache kernel: [297185.968004] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:22:59 kolache kernel: [297185.968004] 
Sep 25 20:22:59 kolache kernel: [297185.968004] Pid: 3979, comm: mysqld Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:22:59 kolache kernel: [297185.968004] EIP: 0060:[<c03296e2>] EFLAGS: 00000217 CPU: 0
Sep 25 20:22:59 kolache kernel: [297185.968004] EIP is at _spin_lock+0x10/0x15
Sep 25 20:22:59 kolache kernel: [297185.968004] EAX: c04fc4f0 EBX: c04fc4f0 ECX: ab0d1d38 EDX: 0000ee0b
Sep 25 20:22:59 kolache kernel: [297185.968004] ESI: c3477e8c EDI: c3477ebc EBP: 00000000 ESP: c3477e24
Sep 25 20:22:59 kolache kernel: [297185.968004]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:22:59 kolache kernel: [297185.968004] CR0: 80050033 CR2: b79a9cf8 CR3: 3641f000 CR4: 000006f0
Sep 25 20:22:59 kolache kernel: [297185.968004] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:22:59 kolache kernel: [297185.968004] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:22:59 kolache kernel: [297185.968004] Call Trace:
Sep 25 20:22:59 kolache kernel: [297185.968004]  [<c01475c0>] ? queue_lock+0x4c/0x51
Sep 25 20:22:59 kolache kernel: [297185.968004]  [<c01476ea>] ? futex_wait+0xa0/0x332
Sep 25 20:22:59 kolache kernel: [297185.968004]  [<c01216fd>] ? __wake_up_common+0x34/0x59
Sep 25 20:22:59 kolache kernel: [297185.968004]  [<c0121fcd>] ? __wake_up+0x29/0x39
Sep 25 20:22:59 kolache kernel: [297185.968004]  [<c01479da>] ? wake_futex+0x1f/0x29
Sep 25 20:22:59 kolache kernel: [297185.968004]  [<c0147cdb>] ? futex_requeue+0x23a/0x244
Sep 25 20:22:59 kolache kernel: [297185.968004]  [<c01277d1>] ? default_wake_function+0x0/0x8
Sep 25 20:22:59 kolache kernel: [297185.968004]  [<c014893d>] ? do_futex+0x74/0x7bd
Sep 25 20:22:59 kolache kernel: [297185.968004]  [<c0121654>] ? pick_next_task+0x1a/0x30
Sep 25 20:22:59 kolache kernel: [297185.968004]  [<c032826e>] ? __schedule+0x4f1/0x746
Sep 25 20:22:59 kolache kernel: [297185.968004]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:22:59 kolache kernel: [297185.968004]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:22:59 kolache kernel: [297185.968004]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:24:01 kolache kernel: [297248.244519] BUG: soft lockup - CPU#1 stuck for 61s! [automount:355]
Sep 25 20:24:01 kolache kernel: [297248.244519] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:24:01 kolache kernel: [297248.244519] 
Sep 25 20:24:01 kolache kernel: [297248.244519] Pid: 355, comm: automount Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:24:01 kolache kernel: [297248.244519] EIP: 0060:[<c03296e2>] EFLAGS: 00000216 CPU: 1
Sep 25 20:24:01 kolache kernel: [297248.244519] EIP is at _spin_lock+0x10/0x15
Sep 25 20:24:01 kolache kernel: [297248.244519] EAX: c04fb9c4 EBX: c04fb9c4 ECX: 8b7d58ee EDX: 00002a55
Sep 25 20:24:01 kolache kernel: [297248.244519] ESI: b80eeba0 EDI: 00000000 EBP: c3408000 ESP: c3409ed0
Sep 25 20:24:01 kolache kernel: [297248.244519]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:24:01 kolache kernel: [297248.244519] CR0: 8005003b CR2: b7f03340 CR3: 1710c000 CR4: 000006f0
Sep 25 20:24:01 kolache kernel: [297248.244519] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:24:01 kolache kernel: [297248.244519] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:24:01 kolache kernel: [297248.244519] Call Trace:
Sep 25 20:24:01 kolache kernel: [297248.244519]  [<c0147a31>] ? futex_wake+0x4d/0xbd
Sep 25 20:24:01 kolache kernel: [297248.244519]  [<c0148962>] ? do_futex+0x99/0x7bd
Sep 25 20:24:01 kolache kernel: [297248.244519]  [<c01203d4>] ? kmap_atomic_prot+0xdd/0x101
Sep 25 20:24:01 kolache kernel: [297248.244519]  [<c013f3c4>] ? ktime_get_ts+0x1d/0x3f
Sep 25 20:24:01 kolache kernel: [297248.244519]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:24:01 kolache kernel: [297248.244519]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:24:01 kolache kernel: [297248.244519]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:24:04 kolache kernel: [297251.468002] BUG: soft lockup - CPU#0 stuck for 61s! [mysqld:3979]
Sep 25 20:24:04 kolache kernel: [297251.468003] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:24:04 kolache kernel: [297251.468003] 
Sep 25 20:24:04 kolache kernel: [297251.468003] Pid: 3979, comm: mysqld Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:24:04 kolache kernel: [297251.468003] EIP: 0060:[<c03296e4>] EFLAGS: 00000217 CPU: 0
Sep 25 20:24:04 kolache kernel: [297251.468003] EIP is at _spin_lock+0x12/0x15
Sep 25 20:24:04 kolache kernel: [297251.468003] EAX: c04fc4f0 EBX: c04fc4f0 ECX: ab0d1d38 EDX: 0000ee0b
Sep 25 20:24:04 kolache kernel: [297251.468003] ESI: c3477e8c EDI: c3477ebc EBP: 00000000 ESP: c3477e24
Sep 25 20:24:04 kolache kernel: [297251.468003]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:24:04 kolache kernel: [297251.468003] CR0: 80050033 CR2: b79a9cf8 CR3: 3641f000 CR4: 000006f0
Sep 25 20:24:04 kolache kernel: [297251.468003] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:24:04 kolache kernel: [297251.468003] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:24:04 kolache kernel: [297251.468003] Call Trace:
Sep 25 20:24:04 kolache kernel: [297251.468003]  [<c01475c0>] ? queue_lock+0x4c/0x51
Sep 25 20:24:04 kolache kernel: [297251.468003]  [<c01476ea>] ? futex_wait+0xa0/0x332
Sep 25 20:24:04 kolache kernel: [297251.468003]  [<c01216fd>] ? __wake_up_common+0x34/0x59
Sep 25 20:24:04 kolache kernel: [297251.468003]  [<c0121fcd>] ? __wake_up+0x29/0x39
Sep 25 20:24:04 kolache kernel: [297251.468003]  [<c01479da>] ? wake_futex+0x1f/0x29
Sep 25 20:24:04 kolache kernel: [297251.468003]  [<c0147cdb>] ? futex_requeue+0x23a/0x244
Sep 25 20:24:04 kolache kernel: [297251.468003]  [<c01277d1>] ? default_wake_function+0x0/0x8
Sep 25 20:24:04 kolache kernel: [297251.468003]  [<c014893d>] ? do_futex+0x74/0x7bd
Sep 25 20:24:04 kolache kernel: [297251.468003]  [<c0121654>] ? pick_next_task+0x1a/0x30
Sep 25 20:24:04 kolache kernel: [297251.468003]  [<c032826e>] ? __schedule+0x4f1/0x746
Sep 25 20:24:04 kolache kernel: [297251.468003]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:24:04 kolache kernel: [297251.468003]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:24:04 kolache kernel: [297251.468003]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:25:07 kolache kernel: [297313.744517] BUG: soft lockup - CPU#1 stuck for 61s! [automount:355]
Sep 25 20:25:07 kolache kernel: [297313.744523] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:25:07 kolache kernel: [297313.744523] 
Sep 25 20:25:07 kolache kernel: [297313.744523] Pid: 355, comm: automount Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:25:07 kolache kernel: [297313.744523] EIP: 0060:[<c03296e2>] EFLAGS: 00000216 CPU: 1
Sep 25 20:25:07 kolache kernel: [297313.744523] EIP is at _spin_lock+0x10/0x15
Sep 25 20:25:07 kolache kernel: [297313.744523] EAX: c04fb9c4 EBX: c04fb9c4 ECX: 8b7d58ee EDX: 00002a55
Sep 25 20:25:07 kolache kernel: [297313.744523] ESI: b80eeba0 EDI: 00000000 EBP: c3408000 ESP: c3409ed0
Sep 25 20:25:07 kolache kernel: [297313.744523]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:25:07 kolache kernel: [297313.744523] CR0: 8005003b CR2: b7f03340 CR3: 1710c000 CR4: 000006f0
Sep 25 20:25:07 kolache kernel: [297313.744523] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:25:07 kolache kernel: [297313.744523] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:25:07 kolache kernel: [297313.744523] Call Trace:
Sep 25 20:25:07 kolache kernel: [297313.744523]  [<c0147a31>] ? futex_wake+0x4d/0xbd
Sep 25 20:25:07 kolache kernel: [297313.744523]  [<c0148962>] ? do_futex+0x99/0x7bd
Sep 25 20:25:07 kolache kernel: [297313.744523]  [<c01203d4>] ? kmap_atomic_prot+0xdd/0x101
Sep 25 20:25:07 kolache kernel: [297313.744523]  [<c013f3c4>] ? ktime_get_ts+0x1d/0x3f
Sep 25 20:25:07 kolache kernel: [297313.744523]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:25:07 kolache kernel: [297313.744523]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:25:07 kolache kernel: [297313.744523]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:25:10 kolache kernel: [297316.964003] BUG: soft lockup - CPU#0 stuck for 61s! [mysqld:3979]
Sep 25 20:25:10 kolache kernel: [297316.964005] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:25:10 kolache kernel: [297316.964005] 
Sep 25 20:25:10 kolache kernel: [297316.964005] Pid: 3979, comm: mysqld Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:25:10 kolache kernel: [297316.964005] EIP: 0060:[<c03296e2>] EFLAGS: 00000217 CPU: 0
Sep 25 20:25:10 kolache kernel: [297316.964005] EIP is at _spin_lock+0x10/0x15
Sep 25 20:25:10 kolache kernel: [297316.964005] EAX: c04fc4f0 EBX: c04fc4f0 ECX: ab0d1d38 EDX: 0000ee0b
Sep 25 20:25:10 kolache kernel: [297316.964005] ESI: c3477e8c EDI: c3477ebc EBP: 00000000 ESP: c3477e24
Sep 25 20:25:10 kolache kernel: [297316.964005]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:25:10 kolache kernel: [297316.964005] CR0: 80050033 CR2: b79a9cf8 CR3: 3641f000 CR4: 000006f0
Sep 25 20:25:10 kolache kernel: [297316.964005] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:25:10 kolache kernel: [297316.964005] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:25:10 kolache kernel: [297316.964005] Call Trace:
Sep 25 20:25:10 kolache kernel: [297316.964005]  [<c01475c0>] ? queue_lock+0x4c/0x51
Sep 25 20:25:10 kolache kernel: [297316.964005]  [<c01476ea>] ? futex_wait+0xa0/0x332
Sep 25 20:25:10 kolache kernel: [297316.964005]  [<c01216fd>] ? __wake_up_common+0x34/0x59
Sep 25 20:25:10 kolache kernel: [297316.964005]  [<c0121fcd>] ? __wake_up+0x29/0x39
Sep 25 20:25:10 kolache kernel: [297316.964005]  [<c01479da>] ? wake_futex+0x1f/0x29
Sep 25 20:25:10 kolache kernel: [297316.964005]  [<c0147cdb>] ? futex_requeue+0x23a/0x244
Sep 25 20:25:10 kolache kernel: [297316.964005]  [<c01277d1>] ? default_wake_function+0x0/0x8
Sep 25 20:25:10 kolache kernel: [297316.964005]  [<c014893d>] ? do_futex+0x74/0x7bd
Sep 25 20:25:10 kolache kernel: [297316.964005]  [<c0121654>] ? pick_next_task+0x1a/0x30
Sep 25 20:25:10 kolache kernel: [297316.964005]  [<c032826e>] ? __schedule+0x4f1/0x746
Sep 25 20:25:10 kolache kernel: [297316.964005]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:25:10 kolache kernel: [297316.964005]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:25:10 kolache kernel: [297316.964005]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:26:12 kolache kernel: [297379.244517] BUG: soft lockup - CPU#1 stuck for 61s! [automount:355]
Sep 25 20:26:12 kolache kernel: [297379.244523] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:26:12 kolache kernel: [297379.244523] 
Sep 25 20:26:12 kolache kernel: [297379.244523] Pid: 355, comm: automount Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:26:12 kolache kernel: [297379.244523] EIP: 0060:[<c03296e2>] EFLAGS: 00000216 CPU: 1
Sep 25 20:26:12 kolache kernel: [297379.244523] EIP is at _spin_lock+0x10/0x15
Sep 25 20:26:12 kolache kernel: [297379.244523] EAX: c04fb9c4 EBX: c04fb9c4 ECX: 8b7d58ee EDX: 00002a55
Sep 25 20:26:12 kolache kernel: [297379.244523] ESI: b80eeba0 EDI: 00000000 EBP: c3408000 ESP: c3409ed0
Sep 25 20:26:12 kolache kernel: [297379.244523]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:26:12 kolache kernel: [297379.244523] CR0: 8005003b CR2: b7f03340 CR3: 1710c000 CR4: 000006f0
Sep 25 20:26:12 kolache kernel: [297379.244523] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:26:12 kolache kernel: [297379.244523] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:26:12 kolache kernel: [297379.244523] Call Trace:
Sep 25 20:26:12 kolache kernel: [297379.244523]  [<c0147a31>] ? futex_wake+0x4d/0xbd
Sep 25 20:26:12 kolache kernel: [297379.244523]  [<c0148962>] ? do_futex+0x99/0x7bd
Sep 25 20:26:12 kolache kernel: [297379.244523]  [<c01203d4>] ? kmap_atomic_prot+0xdd/0x101
Sep 25 20:26:12 kolache kernel: [297379.244523]  [<c013f3c4>] ? ktime_get_ts+0x1d/0x3f
Sep 25 20:26:12 kolache kernel: [297379.244523]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:26:12 kolache kernel: [297379.244523]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:26:12 kolache kernel: [297379.244523]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:26:15 kolache kernel: [297382.464003] BUG: soft lockup - CPU#0 stuck for 61s! [mysqld:3979]
Sep 25 20:26:15 kolache kernel: [297382.464003] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:26:15 kolache kernel: [297382.464003] 
Sep 25 20:26:15 kolache kernel: [297382.464003] Pid: 3979, comm: mysqld Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:26:15 kolache kernel: [297382.464003] EIP: 0060:[<c03296e4>] EFLAGS: 00000217 CPU: 0
Sep 25 20:26:15 kolache kernel: [297382.464003] EIP is at _spin_lock+0x12/0x15
Sep 25 20:26:15 kolache kernel: [297382.464003] EAX: c04fc4f0 EBX: c04fc4f0 ECX: ab0d1d38 EDX: 0000ee0b
Sep 25 20:26:15 kolache kernel: [297382.464003] ESI: c3477e8c EDI: c3477ebc EBP: 00000000 ESP: c3477e24
Sep 25 20:26:15 kolache kernel: [297382.464003]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:26:15 kolache kernel: [297382.464003] CR0: 80050033 CR2: b79a9cf8 CR3: 3641f000 CR4: 000006f0
Sep 25 20:26:15 kolache kernel: [297382.464003] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:26:15 kolache kernel: [297382.464003] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:26:15 kolache kernel: [297382.464003] Call Trace:
Sep 25 20:26:15 kolache kernel: [297382.464003]  [<c01475c0>] ? queue_lock+0x4c/0x51
Sep 25 20:26:15 kolache kernel: [297382.464003]  [<c01476ea>] ? futex_wait+0xa0/0x332
Sep 25 20:26:15 kolache kernel: [297382.464003]  [<c01216fd>] ? __wake_up_common+0x34/0x59
Sep 25 20:26:15 kolache kernel: [297382.464003]  [<c0121fcd>] ? __wake_up+0x29/0x39
Sep 25 20:26:15 kolache kernel: [297382.464003]  [<c01479da>] ? wake_futex+0x1f/0x29
Sep 25 20:26:15 kolache kernel: [297382.464003]  [<c0147cdb>] ? futex_requeue+0x23a/0x244
Sep 25 20:26:15 kolache kernel: [297382.464003]  [<c01277d1>] ? default_wake_function+0x0/0x8
Sep 25 20:26:15 kolache kernel: [297382.464003]  [<c014893d>] ? do_futex+0x74/0x7bd
Sep 25 20:26:15 kolache kernel: [297382.464003]  [<c0121654>] ? pick_next_task+0x1a/0x30
Sep 25 20:26:15 kolache kernel: [297382.464003]  [<c032826e>] ? __schedule+0x4f1/0x746
Sep 25 20:26:15 kolache kernel: [297382.464003]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:26:15 kolache kernel: [297382.464003]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:26:15 kolache kernel: [297382.464003]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:27:18 kolache kernel: [297444.740504] BUG: soft lockup - CPU#1 stuck for 61s! [automount:355]
Sep 25 20:27:18 kolache kernel: [297444.740504] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:27:18 kolache kernel: [297444.740504] 
Sep 25 20:27:18 kolache kernel: [297444.740504] Pid: 355, comm: automount Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:27:18 kolache kernel: [297444.740504] EIP: 0060:[<c03296e2>] EFLAGS: 00000216 CPU: 1
Sep 25 20:27:18 kolache kernel: [297444.740504] EIP is at _spin_lock+0x10/0x15
Sep 25 20:27:18 kolache kernel: [297444.740504] EAX: c04fb9c4 EBX: c04fb9c4 ECX: 8b7d58ee EDX: 00002a55
Sep 25 20:27:18 kolache kernel: [297444.740504] ESI: b80eeba0 EDI: 00000000 EBP: c3408000 ESP: c3409ed0
Sep 25 20:27:18 kolache kernel: [297444.740504]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:27:18 kolache kernel: [297444.740504] CR0: 8005003b CR2: b7f03340 CR3: 1710c000 CR4: 000006f0
Sep 25 20:27:18 kolache kernel: [297444.740504] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:27:18 kolache kernel: [297444.740504] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:27:18 kolache kernel: [297444.740504] Call Trace:
Sep 25 20:27:18 kolache kernel: [297444.740504]  [<c0147a31>] ? futex_wake+0x4d/0xbd
Sep 25 20:27:18 kolache kernel: [297444.740504]  [<c0148962>] ? do_futex+0x99/0x7bd
Sep 25 20:27:18 kolache kernel: [297444.740504]  [<c01203d4>] ? kmap_atomic_prot+0xdd/0x101
Sep 25 20:27:18 kolache kernel: [297444.740504]  [<c013f3c4>] ? ktime_get_ts+0x1d/0x3f
Sep 25 20:27:18 kolache kernel: [297444.740504]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:27:18 kolache kernel: [297444.740504]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:27:18 kolache kernel: [297444.740504]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:27:21 kolache kernel: [297447.964003] BUG: soft lockup - CPU#0 stuck for 61s! [mysqld:3979]
Sep 25 20:27:21 kolache kernel: [297447.964004] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:27:21 kolache kernel: [297447.964004] 
Sep 25 20:27:21 kolache kernel: [297447.964004] Pid: 3979, comm: mysqld Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:27:21 kolache kernel: [297447.964004] EIP: 0060:[<c03296e2>] EFLAGS: 00000217 CPU: 0
Sep 25 20:27:21 kolache kernel: [297447.964004] EIP is at _spin_lock+0x10/0x15
Sep 25 20:27:21 kolache kernel: [297447.964004] EAX: c04fc4f0 EBX: c04fc4f0 ECX: ab0d1d38 EDX: 0000ee0b
Sep 25 20:27:21 kolache kernel: [297447.964004] ESI: c3477e8c EDI: c3477ebc EBP: 00000000 ESP: c3477e24
Sep 25 20:27:21 kolache kernel: [297447.964004]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:27:21 kolache kernel: [297447.964004] CR0: 80050033 CR2: b79a9cf8 CR3: 3641f000 CR4: 000006f0
Sep 25 20:27:21 kolache kernel: [297447.964004] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:27:21 kolache kernel: [297447.964004] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:27:21 kolache kernel: [297447.964004] Call Trace:
Sep 25 20:27:21 kolache kernel: [297447.964004]  [<c01475c0>] ? queue_lock+0x4c/0x51
Sep 25 20:27:21 kolache kernel: [297447.964004]  [<c01476ea>] ? futex_wait+0xa0/0x332
Sep 25 20:27:21 kolache kernel: [297447.964004]  [<c01216fd>] ? __wake_up_common+0x34/0x59
Sep 25 20:27:21 kolache kernel: [297447.964004]  [<c0121fcd>] ? __wake_up+0x29/0x39
Sep 25 20:27:21 kolache kernel: [297447.964004]  [<c01479da>] ? wake_futex+0x1f/0x29
Sep 25 20:27:21 kolache kernel: [297447.964004]  [<c0147cdb>] ? futex_requeue+0x23a/0x244
Sep 25 20:27:21 kolache kernel: [297447.964004]  [<c01277d1>] ? default_wake_function+0x0/0x8
Sep 25 20:27:21 kolache kernel: [297447.964004]  [<c014893d>] ? do_futex+0x74/0x7bd
Sep 25 20:27:21 kolache kernel: [297447.964004]  [<c0121654>] ? pick_next_task+0x1a/0x30
Sep 25 20:27:21 kolache kernel: [297447.964004]  [<c032826e>] ? __schedule+0x4f1/0x746
Sep 25 20:27:21 kolache kernel: [297447.964004]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:27:21 kolache kernel: [297447.964004]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:27:21 kolache kernel: [297447.964004]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:28:23 kolache kernel: [297510.240504] BUG: soft lockup - CPU#1 stuck for 61s! [automount:355]
Sep 25 20:28:23 kolache kernel: [297510.240504] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:28:23 kolache kernel: [297510.240504] 
Sep 25 20:28:23 kolache kernel: [297510.240504] Pid: 355, comm: automount Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:28:23 kolache kernel: [297510.240504] EIP: 0060:[<c03296e2>] EFLAGS: 00000212 CPU: 1
Sep 25 20:28:23 kolache kernel: [297510.240504] EIP is at _spin_lock+0x10/0x15
Sep 25 20:28:23 kolache kernel: [297510.240504] EAX: c04fb9c4 EBX: c04fb9c4 ECX: 8b7d58ee EDX: 00002a56
Sep 25 20:28:23 kolache kernel: [297510.240504] ESI: b80eeba0 EDI: 00000000 EBP: c3408000 ESP: c3409ed0
Sep 25 20:28:23 kolache kernel: [297510.240504]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:28:23 kolache kernel: [297510.240504] CR0: 8005003b CR2: b7f03340 CR3: 1710c000 CR4: 000006f0
Sep 25 20:28:23 kolache kernel: [297510.240504] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:28:23 kolache kernel: [297510.240504] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:28:23 kolache kernel: [297510.240504] Call Trace:
Sep 25 20:28:23 kolache kernel: [297510.240504]  [<c0147a31>] ? futex_wake+0x4d/0xbd
Sep 25 20:28:23 kolache kernel: [297510.240504]  [<c0148962>] ? do_futex+0x99/0x7bd
Sep 25 20:28:23 kolache kernel: [297510.240504]  [<c01203d4>] ? kmap_atomic_prot+0xdd/0x101
Sep 25 20:28:23 kolache kernel: [297510.240504]  [<c013f3c4>] ? ktime_get_ts+0x1d/0x3f
Sep 25 20:28:23 kolache kernel: [297510.240504]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:28:23 kolache kernel: [297510.240504]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:28:23 kolache kernel: [297510.240504]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:28:26 kolache kernel: [297513.460003] BUG: soft lockup - CPU#0 stuck for 61s! [mysqld:3979]
Sep 25 20:28:26 kolache kernel: [297513.460003] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:28:26 kolache kernel: [297513.460003] 
Sep 25 20:28:26 kolache kernel: [297513.460003] Pid: 3979, comm: mysqld Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:28:26 kolache kernel: [297513.460003] EIP: 0060:[<c03296e2>] EFLAGS: 00000217 CPU: 0
Sep 25 20:28:26 kolache kernel: [297513.460003] EIP is at _spin_lock+0x10/0x15
Sep 25 20:28:26 kolache kernel: [297513.460003] EAX: c04fc4f0 EBX: c04fc4f0 ECX: ab0d1d38 EDX: 0000ee0b
Sep 25 20:28:26 kolache kernel: [297513.460003] ESI: c3477e8c EDI: c3477ebc EBP: 00000000 ESP: c3477e24
Sep 25 20:28:26 kolache kernel: [297513.460003]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:28:26 kolache kernel: [297513.460003] CR0: 80050033 CR2: b79a9cf8 CR3: 3641f000 CR4: 000006f0
Sep 25 20:28:26 kolache kernel: [297513.460003] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:28:26 kolache kernel: [297513.460003] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:28:26 kolache kernel: [297513.460003] Call Trace:
Sep 25 20:28:26 kolache kernel: [297513.460003]  [<c01475c0>] ? queue_lock+0x4c/0x51
Sep 25 20:28:26 kolache kernel: [297513.460003]  [<c01476ea>] ? futex_wait+0xa0/0x332
Sep 25 20:28:26 kolache kernel: [297513.460003]  [<c01216fd>] ? __wake_up_common+0x34/0x59
Sep 25 20:28:26 kolache kernel: [297513.460003]  [<c0121fcd>] ? __wake_up+0x29/0x39
Sep 25 20:28:26 kolache kernel: [297513.460003]  [<c01479da>] ? wake_futex+0x1f/0x29
Sep 25 20:28:26 kolache kernel: [297513.460003]  [<c0147cdb>] ? futex_requeue+0x23a/0x244
Sep 25 20:28:26 kolache kernel: [297513.460003]  [<c01277d1>] ? default_wake_function+0x0/0x8
Sep 25 20:28:26 kolache kernel: [297513.460003]  [<c014893d>] ? do_futex+0x74/0x7bd
Sep 25 20:28:26 kolache kernel: [297513.460003]  [<c0121654>] ? pick_next_task+0x1a/0x30
Sep 25 20:28:26 kolache kernel: [297513.460003]  [<c032826e>] ? __schedule+0x4f1/0x746
Sep 25 20:28:26 kolache kernel: [297513.460003]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:28:26 kolache kernel: [297513.460003]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:28:26 kolache kernel: [297513.460003]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:29:29 kolache kernel: [297575.736523] BUG: soft lockup - CPU#1 stuck for 61s! [automount:355]
Sep 25 20:29:29 kolache kernel: [297575.736527] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:29:29 kolache kernel: [297575.736527] 
Sep 25 20:29:29 kolache kernel: [297575.736527] Pid: 355, comm: automount Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:29:29 kolache kernel: [297575.736527] EIP: 0060:[<c03296de>] EFLAGS: 00000212 CPU: 1
Sep 25 20:29:29 kolache kernel: [297575.736527] EIP is at _spin_lock+0xc/0x15
Sep 25 20:29:29 kolache kernel: [297575.736527] EAX: c04fb9c4 EBX: c04fb9c4 ECX: 8b7d58ee EDX: 00002a56
Sep 25 20:29:29 kolache kernel: [297575.736527] ESI: b80eeba0 EDI: 00000000 EBP: c3408000 ESP: c3409ed0
Sep 25 20:29:29 kolache kernel: [297575.736527]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:29:29 kolache kernel: [297575.736527] CR0: 8005003b CR2: b7f03340 CR3: 1710c000 CR4: 000006f0
Sep 25 20:29:29 kolache kernel: [297575.736527] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:29:29 kolache kernel: [297575.736527] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:29:29 kolache kernel: [297575.736527] Call Trace:
Sep 25 20:29:29 kolache kernel: [297575.736527]  [<c0147a31>] ? futex_wake+0x4d/0xbd
Sep 25 20:29:29 kolache kernel: [297575.736527]  [<c0148962>] ? do_futex+0x99/0x7bd
Sep 25 20:29:29 kolache kernel: [297575.736527]  [<c01203d4>] ? kmap_atomic_prot+0xdd/0x101
Sep 25 20:29:29 kolache kernel: [297575.736527]  [<c013f3c4>] ? ktime_get_ts+0x1d/0x3f
Sep 25 20:29:29 kolache kernel: [297575.736527]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:29:29 kolache kernel: [297575.736527]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:29:29 kolache kernel: [297575.736527]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:29:32 kolache kernel: [297578.960002] BUG: soft lockup - CPU#0 stuck for 61s! [mysqld:3979]
Sep 25 20:29:32 kolache kernel: [297578.960003] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:29:32 kolache kernel: [297578.960003] 
Sep 25 20:29:32 kolache kernel: [297578.960003] Pid: 3979, comm: mysqld Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:29:32 kolache kernel: [297578.960003] EIP: 0060:[<c03296e2>] EFLAGS: 00000217 CPU: 0
Sep 25 20:29:32 kolache kernel: [297578.960003] EIP is at _spin_lock+0x10/0x15
Sep 25 20:29:32 kolache kernel: [297578.960003] EAX: c04fc4f0 EBX: c04fc4f0 ECX: ab0d1d38 EDX: 0000ee0b
Sep 25 20:29:32 kolache kernel: [297578.960003] ESI: c3477e8c EDI: c3477ebc EBP: 00000000 ESP: c3477e24
Sep 25 20:29:32 kolache kernel: [297578.960003]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:29:32 kolache kernel: [297578.960003] CR0: 80050033 CR2: b79a9cf8 CR3: 3641f000 CR4: 000006f0
Sep 25 20:29:32 kolache kernel: [297578.960003] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:29:32 kolache kernel: [297578.960003] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:29:32 kolache kernel: [297578.960003] Call Trace:
Sep 25 20:29:32 kolache kernel: [297578.960003]  [<c01475c0>] ? queue_lock+0x4c/0x51
Sep 25 20:29:32 kolache kernel: [297578.960003]  [<c01476ea>] ? futex_wait+0xa0/0x332
Sep 25 20:29:32 kolache kernel: [297578.960003]  [<c01216fd>] ? __wake_up_common+0x34/0x59
Sep 25 20:29:32 kolache kernel: [297578.960003]  [<c0121fcd>] ? __wake_up+0x29/0x39
Sep 25 20:29:32 kolache kernel: [297578.960003]  [<c01479da>] ? wake_futex+0x1f/0x29
Sep 25 20:29:32 kolache kernel: [297578.960003]  [<c0147cdb>] ? futex_requeue+0x23a/0x244
Sep 25 20:29:32 kolache kernel: [297578.960003]  [<c01277d1>] ? default_wake_function+0x0/0x8
Sep 25 20:29:32 kolache kernel: [297578.960003]  [<c014893d>] ? do_futex+0x74/0x7bd
Sep 25 20:29:32 kolache kernel: [297578.960003]  [<c0121654>] ? pick_next_task+0x1a/0x30
Sep 25 20:29:32 kolache kernel: [297578.960003]  [<c032826e>] ? __schedule+0x4f1/0x746
Sep 25 20:29:32 kolache kernel: [297578.960003]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:29:32 kolache kernel: [297578.960003]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:29:32 kolache kernel: [297578.960003]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:30:34 kolache kernel: [297641.236521] BUG: soft lockup - CPU#1 stuck for 61s! [automount:355]
Sep 25 20:30:34 kolache kernel: [297641.236522] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:30:34 kolache kernel: [297641.236522] 
Sep 25 20:30:34 kolache kernel: [297641.236522] Pid: 355, comm: automount Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:30:34 kolache kernel: [297641.236522] EIP: 0060:[<c03296e2>] EFLAGS: 00000212 CPU: 1
Sep 25 20:30:34 kolache kernel: [297641.236522] EIP is at _spin_lock+0x10/0x15
Sep 25 20:30:34 kolache kernel: [297641.236522] EAX: c04fb9c4 EBX: c04fb9c4 ECX: 8b7d58ee EDX: 00002a56
Sep 25 20:30:34 kolache kernel: [297641.236522] ESI: b80eeba0 EDI: 00000000 EBP: c3408000 ESP: c3409ed0
Sep 25 20:30:34 kolache kernel: [297641.236522]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:30:34 kolache kernel: [297641.236522] CR0: 8005003b CR2: b7f03340 CR3: 1710c000 CR4: 000006f0
Sep 25 20:30:34 kolache kernel: [297641.236522] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:30:34 kolache kernel: [297641.236522] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:30:34 kolache kernel: [297641.236522] Call Trace:
Sep 25 20:30:34 kolache kernel: [297641.236522]  [<c0147a31>] ? futex_wake+0x4d/0xbd
Sep 25 20:30:34 kolache kernel: [297641.236522]  [<c0148962>] ? do_futex+0x99/0x7bd
Sep 25 20:30:34 kolache kernel: [297641.236522]  [<c01203d4>] ? kmap_atomic_prot+0xdd/0x101
Sep 25 20:30:34 kolache kernel: [297641.236522]  [<c013f3c4>] ? ktime_get_ts+0x1d/0x3f
Sep 25 20:30:34 kolache kernel: [297641.236522]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:30:34 kolache kernel: [297641.236522]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:30:34 kolache kernel: [297641.236522]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:30:37 kolache kernel: [297644.456002] BUG: soft lockup - CPU#0 stuck for 61s! [mysqld:3979]
Sep 25 20:30:37 kolache kernel: [297644.456003] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:30:37 kolache kernel: [297644.456003] 
Sep 25 20:30:37 kolache kernel: [297644.456003] Pid: 3979, comm: mysqld Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:30:37 kolache kernel: [297644.456003] EIP: 0060:[<c03296e2>] EFLAGS: 00000217 CPU: 0
Sep 25 20:30:37 kolache kernel: [297644.456003] EIP is at _spin_lock+0x10/0x15
Sep 25 20:30:37 kolache kernel: [297644.456003] EAX: c04fc4f0 EBX: c04fc4f0 ECX: ab0d1d38 EDX: 0000ee0b
Sep 25 20:30:37 kolache kernel: [297644.456003] ESI: c3477e8c EDI: c3477ebc EBP: 00000000 ESP: c3477e24
Sep 25 20:30:37 kolache kernel: [297644.456003]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:30:37 kolache kernel: [297644.456003] CR0: 80050033 CR2: b79a9cf8 CR3: 3641f000 CR4: 000006f0
Sep 25 20:30:37 kolache kernel: [297644.456003] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:30:37 kolache kernel: [297644.456003] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:30:37 kolache kernel: [297644.456003] Call Trace:
Sep 25 20:30:37 kolache kernel: [297644.456003]  [<c01475c0>] ? queue_lock+0x4c/0x51
Sep 25 20:30:37 kolache kernel: [297644.456003]  [<c01476ea>] ? futex_wait+0xa0/0x332
Sep 25 20:30:37 kolache kernel: [297644.456003]  [<c01216fd>] ? __wake_up_common+0x34/0x59
Sep 25 20:30:37 kolache kernel: [297644.456003]  [<c0121fcd>] ? __wake_up+0x29/0x39
Sep 25 20:30:37 kolache kernel: [297644.456003]  [<c01479da>] ? wake_futex+0x1f/0x29
Sep 25 20:30:37 kolache kernel: [297644.456003]  [<c0147cdb>] ? futex_requeue+0x23a/0x244
Sep 25 20:30:37 kolache kernel: [297644.456003]  [<c01277d1>] ? default_wake_function+0x0/0x8
Sep 25 20:30:37 kolache kernel: [297644.456003]  [<c014893d>] ? do_futex+0x74/0x7bd
Sep 25 20:30:37 kolache kernel: [297644.456003]  [<c0121654>] ? pick_next_task+0x1a/0x30
Sep 25 20:30:37 kolache kernel: [297644.456003]  [<c032826e>] ? __schedule+0x4f1/0x746
Sep 25 20:30:37 kolache kernel: [297644.456003]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:30:37 kolache kernel: [297644.456003]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:30:37 kolache kernel: [297644.456003]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:31:40 kolache kernel: [297706.732504] BUG: soft lockup - CPU#1 stuck for 61s! [automount:355]
Sep 25 20:31:40 kolache kernel: [297706.732504] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:31:40 kolache kernel: [297706.732504] 
Sep 25 20:31:40 kolache kernel: [297706.732504] Pid: 355, comm: automount Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:31:40 kolache kernel: [297706.732504] EIP: 0060:[<c03296e2>] EFLAGS: 00000212 CPU: 1
Sep 25 20:31:40 kolache kernel: [297706.732504] EIP is at _spin_lock+0x10/0x15
Sep 25 20:31:40 kolache kernel: [297706.732504] EAX: c04fb9c4 EBX: c04fb9c4 ECX: 8b7d58ee EDX: 00002a56
Sep 25 20:31:40 kolache kernel: [297706.732504] ESI: b80eeba0 EDI: 00000000 EBP: c3408000 ESP: c3409ed0
Sep 25 20:31:40 kolache kernel: [297706.732504]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:31:40 kolache kernel: [297706.732504] CR0: 8005003b CR2: b7f03340 CR3: 1710c000 CR4: 000006f0
Sep 25 20:31:40 kolache kernel: [297706.732504] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:31:40 kolache kernel: [297706.732504] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:31:40 kolache kernel: [297706.732504] Call Trace:
Sep 25 20:31:40 kolache kernel: [297706.732504]  [<c0147a31>] ? futex_wake+0x4d/0xbd
Sep 25 20:31:40 kolache kernel: [297706.732504]  [<c0148962>] ? do_futex+0x99/0x7bd
Sep 25 20:31:40 kolache kernel: [297706.732504]  [<c01203d4>] ? kmap_atomic_prot+0xdd/0x101
Sep 25 20:31:40 kolache kernel: [297706.732504]  [<c013f3c4>] ? ktime_get_ts+0x1d/0x3f
Sep 25 20:31:40 kolache kernel: [297706.732504]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:31:40 kolache kernel: [297706.732504]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:31:40 kolache kernel: [297706.732504]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:31:43 kolache kernel: [297709.956003] BUG: soft lockup - CPU#0 stuck for 61s! [mysqld:3979]
Sep 25 20:31:43 kolache kernel: [297709.956004] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:31:43 kolache kernel: [297709.956004] 
Sep 25 20:31:43 kolache kernel: [297709.956004] Pid: 3979, comm: mysqld Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:31:43 kolache kernel: [297709.956004] EIP: 0060:[<c03296e2>] EFLAGS: 00000217 CPU: 0
Sep 25 20:31:43 kolache kernel: [297709.956004] EIP is at _spin_lock+0x10/0x15
Sep 25 20:31:43 kolache kernel: [297709.956004] EAX: c04fc4f0 EBX: c04fc4f0 ECX: ab0d1d38 EDX: 0000ee0b
Sep 25 20:31:43 kolache kernel: [297709.956004] ESI: c3477e8c EDI: c3477ebc EBP: 00000000 ESP: c3477e24
Sep 25 20:31:43 kolache kernel: [297709.956004]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:31:43 kolache kernel: [297709.956004] CR0: 80050033 CR2: b79a9cf8 CR3: 3641f000 CR4: 000006f0
Sep 25 20:31:43 kolache kernel: [297709.956004] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:31:43 kolache kernel: [297709.956004] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:31:43 kolache kernel: [297709.956004] Call Trace:
Sep 25 20:31:43 kolache kernel: [297709.956004]  [<c01475c0>] ? queue_lock+0x4c/0x51
Sep 25 20:31:43 kolache kernel: [297709.956004]  [<c01476ea>] ? futex_wait+0xa0/0x332
Sep 25 20:31:43 kolache kernel: [297709.956004]  [<c01216fd>] ? __wake_up_common+0x34/0x59
Sep 25 20:31:43 kolache kernel: [297709.956004]  [<c0121fcd>] ? __wake_up+0x29/0x39
Sep 25 20:31:43 kolache kernel: [297709.956004]  [<c01479da>] ? wake_futex+0x1f/0x29
Sep 25 20:31:43 kolache kernel: [297709.956004]  [<c0147cdb>] ? futex_requeue+0x23a/0x244
Sep 25 20:31:43 kolache kernel: [297709.956004]  [<c01277d1>] ? default_wake_function+0x0/0x8
Sep 25 20:31:43 kolache kernel: [297709.956004]  [<c014893d>] ? do_futex+0x74/0x7bd
Sep 25 20:31:43 kolache kernel: [297709.956004]  [<c0121654>] ? pick_next_task+0x1a/0x30
Sep 25 20:31:43 kolache kernel: [297709.956004]  [<c032826e>] ? __schedule+0x4f1/0x746
Sep 25 20:31:43 kolache kernel: [297709.956004]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:31:43 kolache kernel: [297709.956004]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:31:43 kolache kernel: [297709.956004]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:32:45 kolache kernel: [297772.232504] BUG: soft lockup - CPU#1 stuck for 61s! [automount:355]
Sep 25 20:32:45 kolache kernel: [297772.232504] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:32:45 kolache kernel: [297772.232504] 
Sep 25 20:32:45 kolache kernel: [297772.232504] Pid: 355, comm: automount Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:32:45 kolache kernel: [297772.232504] EIP: 0060:[<c03296e2>] EFLAGS: 00000212 CPU: 1
Sep 25 20:32:45 kolache kernel: [297772.232504] EIP is at _spin_lock+0x10/0x15
Sep 25 20:32:45 kolache kernel: [297772.232504] EAX: c04fb9c4 EBX: c04fb9c4 ECX: 8b7d58ee EDX: 00002a56
Sep 25 20:32:45 kolache kernel: [297772.232504] ESI: b80eeba0 EDI: 00000000 EBP: c3408000 ESP: c3409ed0
Sep 25 20:32:45 kolache kernel: [297772.232504]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:32:45 kolache kernel: [297772.232504] CR0: 8005003b CR2: b7f03340 CR3: 1710c000 CR4: 000006f0
Sep 25 20:32:45 kolache kernel: [297772.232504] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:32:45 kolache kernel: [297772.232504] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:32:45 kolache kernel: [297772.232504] Call Trace:
Sep 25 20:32:45 kolache kernel: [297772.232504]  [<c0147a31>] ? futex_wake+0x4d/0xbd
Sep 25 20:32:45 kolache kernel: [297772.232504]  [<c0148962>] ? do_futex+0x99/0x7bd
Sep 25 20:32:45 kolache kernel: [297772.232504]  [<c01203d4>] ? kmap_atomic_prot+0xdd/0x101
Sep 25 20:32:45 kolache kernel: [297772.232504]  [<c013f3c4>] ? ktime_get_ts+0x1d/0x3f
Sep 25 20:32:45 kolache kernel: [297772.232504]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:32:45 kolache kernel: [297772.232504]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:32:45 kolache kernel: [297772.232504]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:32:48 kolache kernel: [297775.452002] BUG: soft lockup - CPU#0 stuck for 61s! [mysqld:3979]
Sep 25 20:32:48 kolache kernel: [297775.452003] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:32:48 kolache kernel: [297775.452003] 
Sep 25 20:32:48 kolache kernel: [297775.452003] Pid: 3979, comm: mysqld Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:32:48 kolache kernel: [297775.452003] EIP: 0060:[<c03296de>] EFLAGS: 00000217 CPU: 0
Sep 25 20:32:48 kolache kernel: [297775.452003] EIP is at _spin_lock+0xc/0x15
Sep 25 20:32:48 kolache kernel: [297775.452003] EAX: c04fc4f0 EBX: c04fc4f0 ECX: ab0d1d38 EDX: 0000ee0b
Sep 25 20:32:48 kolache kernel: [297775.452003] ESI: c3477e8c EDI: c3477ebc EBP: 00000000 ESP: c3477e24
Sep 25 20:32:48 kolache kernel: [297775.452003]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:32:48 kolache kernel: [297775.452003] CR0: 80050033 CR2: b79a9cf8 CR3: 3641f000 CR4: 000006f0
Sep 25 20:32:48 kolache kernel: [297775.452003] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:32:48 kolache kernel: [297775.452003] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:32:48 kolache kernel: [297775.452003] Call Trace:
Sep 25 20:32:48 kolache kernel: [297775.452003]  [<c01475c0>] ? queue_lock+0x4c/0x51
Sep 25 20:32:48 kolache kernel: [297775.452003]  [<c01476ea>] ? futex_wait+0xa0/0x332
Sep 25 20:32:48 kolache kernel: [297775.452003]  [<c01216fd>] ? __wake_up_common+0x34/0x59
Sep 25 20:32:48 kolache kernel: [297775.452003]  [<c0121fcd>] ? __wake_up+0x29/0x39
Sep 25 20:32:48 kolache kernel: [297775.452003]  [<c01479da>] ? wake_futex+0x1f/0x29
Sep 25 20:32:48 kolache kernel: [297775.452003]  [<c0147cdb>] ? futex_requeue+0x23a/0x244
Sep 25 20:32:48 kolache kernel: [297775.452003]  [<c01277d1>] ? default_wake_function+0x0/0x8
Sep 25 20:32:48 kolache kernel: [297775.452003]  [<c014893d>] ? do_futex+0x74/0x7bd
Sep 25 20:32:48 kolache kernel: [297775.452003]  [<c0121654>] ? pick_next_task+0x1a/0x30
Sep 25 20:32:48 kolache kernel: [297775.452003]  [<c032826e>] ? __schedule+0x4f1/0x746
Sep 25 20:32:48 kolache kernel: [297775.452003]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:32:48 kolache kernel: [297775.452003]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:32:48 kolache kernel: [297775.452003]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:33:51 kolache kernel: [297837.728504] BUG: soft lockup - CPU#1 stuck for 61s! [automount:355]
Sep 25 20:33:51 kolache kernel: [297837.728504] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:33:51 kolache kernel: [297837.728504] 
Sep 25 20:33:51 kolache kernel: [297837.728504] Pid: 355, comm: automount Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:33:51 kolache kernel: [297837.728504] EIP: 0060:[<c03296e2>] EFLAGS: 00000212 CPU: 1
Sep 25 20:33:51 kolache kernel: [297837.728504] EIP is at _spin_lock+0x10/0x15
Sep 25 20:33:51 kolache kernel: [297837.728504] EAX: c04fb9c4 EBX: c04fb9c4 ECX: 8b7d58ee EDX: 00002a56
Sep 25 20:33:51 kolache kernel: [297837.728504] ESI: b80eeba0 EDI: 00000000 EBP: c3408000 ESP: c3409ed0
Sep 25 20:33:51 kolache kernel: [297837.728504]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:33:51 kolache kernel: [297837.728504] CR0: 8005003b CR2: b7f03340 CR3: 1710c000 CR4: 000006f0
Sep 25 20:33:51 kolache kernel: [297837.728504] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:33:51 kolache kernel: [297837.728504] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:33:51 kolache kernel: [297837.728504] Call Trace:
Sep 25 20:33:51 kolache kernel: [297837.728504]  [<c0147a31>] ? futex_wake+0x4d/0xbd
Sep 25 20:33:51 kolache kernel: [297837.728504]  [<c0148962>] ? do_futex+0x99/0x7bd
Sep 25 20:33:51 kolache kernel: [297837.728504]  [<c01203d4>] ? kmap_atomic_prot+0xdd/0x101
Sep 25 20:33:51 kolache kernel: [297837.728504]  [<c013f3c4>] ? ktime_get_ts+0x1d/0x3f
Sep 25 20:33:51 kolache kernel: [297837.728504]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:33:51 kolache kernel: [297837.728504]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:33:51 kolache kernel: [297837.728504]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:33:54 kolache kernel: [297840.952001] BUG: soft lockup - CPU#0 stuck for 61s! [mysqld:3979]
Sep 25 20:33:54 kolache kernel: [297840.952003] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:33:54 kolache kernel: [297840.952003] 
Sep 25 20:33:54 kolache kernel: [297840.952003] Pid: 3979, comm: mysqld Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:33:54 kolache kernel: [297840.952003] EIP: 0060:[<c03296e2>] EFLAGS: 00000217 CPU: 0
Sep 25 20:33:54 kolache kernel: [297840.952003] EIP is at _spin_lock+0x10/0x15
Sep 25 20:33:54 kolache kernel: [297840.952003] EAX: c04fc4f0 EBX: c04fc4f0 ECX: ab0d1d38 EDX: 0000ee0b
Sep 25 20:33:54 kolache kernel: [297840.952003] ESI: c3477e8c EDI: c3477ebc EBP: 00000000 ESP: c3477e24
Sep 25 20:33:54 kolache kernel: [297840.952003]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:33:54 kolache kernel: [297840.952003] CR0: 80050033 CR2: b79a9cf8 CR3: 3641f000 CR4: 000006f0
Sep 25 20:33:54 kolache kernel: [297840.952003] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:33:54 kolache kernel: [297840.952003] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:33:54 kolache kernel: [297840.952003] Call Trace:
Sep 25 20:33:54 kolache kernel: [297840.952003]  [<c01475c0>] ? queue_lock+0x4c/0x51
Sep 25 20:33:54 kolache kernel: [297840.952003]  [<c01476ea>] ? futex_wait+0xa0/0x332
Sep 25 20:33:54 kolache kernel: [297840.952003]  [<c01216fd>] ? __wake_up_common+0x34/0x59
Sep 25 20:33:54 kolache kernel: [297840.952003]  [<c0121fcd>] ? __wake_up+0x29/0x39
Sep 25 20:33:54 kolache kernel: [297840.952003]  [<c01479da>] ? wake_futex+0x1f/0x29
Sep 25 20:33:54 kolache kernel: [297840.952003]  [<c0147cdb>] ? futex_requeue+0x23a/0x244
Sep 25 20:33:54 kolache kernel: [297840.952003]  [<c01277d1>] ? default_wake_function+0x0/0x8
Sep 25 20:33:54 kolache kernel: [297840.952003]  [<c014893d>] ? do_futex+0x74/0x7bd
Sep 25 20:33:54 kolache kernel: [297840.952003]  [<c0121654>] ? pick_next_task+0x1a/0x30
Sep 25 20:33:54 kolache kernel: [297840.952003]  [<c032826e>] ? __schedule+0x4f1/0x746
Sep 25 20:33:54 kolache kernel: [297840.952003]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:33:54 kolache kernel: [297840.952003]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:33:54 kolache kernel: [297840.952003]  [<c0107554>] ? sysenter_do_call+0x12/0x28
Sep 25 20:34:56 kolache kernel: [297903.228503] BUG: soft lockup - CPU#1 stuck for 61s! [automount:355]
Sep 25 20:34:56 kolache kernel: [297903.228504] Modules linked in: ppdev lp autofs4 nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc nls_utf8 cifs nls_base ext4 jbd2 crc16 loop snd_pcsp shpchp intel_rng snd_pcm e7xxx_edac rng_core snd_timer pci_hotplug dcdbas button psmouse edac_core processor snd soundcore serio_raw snd_page_alloc parport_pc evdev parport ext3 jbd mbcache osst st ch sg sd_mod crc_t10dif ide_cd_mod cdrom ata_generic libata ide_pci_generic uhci_hcd ehci_hcd piix mptspi mptscsih megaraid_mbox aic7xxx cciss e1000 mptbase scsi_transport_spi ide_core megaraid_mm scsi_mod usbcore floppy thermal fan thermal_sys [last unloaded: scsi_wait_scan]
Sep 25 20:34:56 kolache kernel: [297903.228504] 
Sep 25 20:34:56 kolache kernel: [297903.228504] Pid: 355, comm: automount Not tainted (2.6.30-2-686-bigmem #1) PowerEdge 2600             
Sep 25 20:34:56 kolache kernel: [297903.228504] EIP: 0060:[<c03296e2>] EFLAGS: 00000212 CPU: 1
Sep 25 20:34:56 kolache kernel: [297903.228504] EIP is at _spin_lock+0x10/0x15
Sep 25 20:34:56 kolache kernel: [297903.228504] EAX: c04fb9c4 EBX: c04fb9c4 ECX: 8b7d58ee EDX: 00002a56
Sep 25 20:34:56 kolache kernel: [297903.228504] ESI: b80eeba0 EDI: 00000000 EBP: c3408000 ESP: c3409ed0
Sep 25 20:34:56 kolache kernel: [297903.228504]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
Sep 25 20:34:56 kolache kernel: [297903.228504] CR0: 8005003b CR2: b7f03340 CR3: 1710c000 CR4: 000006f0
Sep 25 20:34:56 kolache kernel: [297903.228504] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
Sep 25 20:34:56 kolache kernel: [297903.228504] DR6: ffff0ff0 DR7: 00000400
Sep 25 20:34:56 kolache kernel: [297903.228504] Call Trace:
Sep 25 20:34:56 kolache kernel: [297903.228504]  [<c0147a31>] ? futex_wake+0x4d/0xbd
Sep 25 20:34:56 kolache kernel: [297903.228504]  [<c0148962>] ? do_futex+0x99/0x7bd
Sep 25 20:34:56 kolache kernel: [297903.228504]  [<c01203d4>] ? kmap_atomic_prot+0xdd/0x101
Sep 25 20:34:56 kolache kernel: [297903.228504]  [<c013f3c4>] ? ktime_get_ts+0x1d/0x3f
Sep 25 20:34:56 kolache kernel: [297903.228504]  [<c0149172>] ? sys_futex+0xec/0x101
Sep 25 20:34:56 kolache kernel: [297903.228504]  [<c015eda1>] ? audit_syscall_entry+0x103/0x125
Sep 25 20:34:56 kolache kernel: [297903.228504]  [<c0107554>] ? sysenter_do_call+0x12/0x28

-- Package-specific info:
** Version:
Linux version 2.6.30-2-686-bigmem (Debian 2.6.30-7) (waldi@debian.org) (gcc version 4.3.4 (Debian 4.3.4-2) ) #1 SMP Wed Sep 16 17:37:49 UTC 2009

** Command line:
BOOT_IMAGE=/vmlinuz-2.6.30-2-686-bigmem root=UUID=962cb1a0-ddc5-4afe-b3fd-8e97da90598a ro quiet

** Not tainted

** Kernel log:
[   47.592049] EXT3 FS on sda5, internal journal
[   47.592053] EXT3-fs: recovery complete.
[   47.594632] EXT3-fs: mounted filesystem with writeback data mode.
[   48.271888] kjournald starting.  Commit interval 5 seconds
[   48.271907] EXT3-fs warning: maximal mount count reached, running e2fsck is recommended
[   48.272403] EXT3 FS on sda6, internal journal
[   48.272408] EXT3-fs: recovery complete.
[   48.272756] EXT3-fs: mounted filesystem with writeback data mode.
[   52.188705] kjournald starting.  Commit interval 5 seconds
[   52.188726] EXT3-fs warning: maximal mount count reached, running e2fsck is recommended
[   52.189625] EXT3 FS on sda7, internal journal
[   52.189630] EXT3-fs: recovery complete.
[   52.190109] EXT3-fs: mounted filesystem with writeback data mode.
[   54.219142] kjournald starting.  Commit interval 5 seconds
[   54.219163] EXT3-fs warning: maximal mount count reached, running e2fsck is recommended
[   54.273155] EXT3 FS on sda8, internal journal
[   54.273160] EXT3-fs: recovery complete.
[   54.273832] EXT3-fs: mounted filesystem with writeback data mode.
[   55.951261] kjournald starting.  Commit interval 5 seconds
[   55.951283] EXT3-fs warning: maximal mount count reached, running e2fsck is recommended
[   55.953558] EXT3 FS on sda9, internal journal
[   55.953563] EXT3-fs: recovery complete.
[   55.955007] EXT3-fs: mounted filesystem with writeback data mode.
[   56.277450] kjournald starting.  Commit interval 5 seconds
[   56.277469] EXT3-fs warning: maximal mount count reached, running e2fsck is recommended
[   56.282642] EXT3 FS on sda10, internal journal
[   56.282642] EXT3-fs: recovery complete.
[   56.480315] EXT3-fs: mounted filesystem with writeback data mode.
[   60.721022] kjournald starting.  Commit interval 5 seconds
[   60.721047] EXT3-fs warning: checktime reached, running e2fsck is recommended
[   60.725977] EXT3 FS on sda11, internal journal
[   60.725981] EXT3-fs: recovery complete.
[   60.729544] EXT3-fs: mounted filesystem with writeback data mode.
[   64.959245] kjournald starting.  Commit interval 5 seconds
[   64.959272] EXT3-fs warning: maximal mount count reached, running e2fsck is recommended
[   64.960004] EXT3 FS on sda12, internal journal
[   64.960024] EXT3-fs: recovery complete.
[   64.962769] EXT3-fs: mounted filesystem with writeback data mode.
[   66.012294] kjournald starting.  Commit interval 5 seconds
[   66.012313] EXT3-fs warning: checktime reached, running e2fsck is recommended
[   66.019325] EXT3 FS on sda13, internal journal
[   66.019329] EXT3-fs: recovery complete.
[   66.020234] EXT3-fs: mounted filesystem with writeback data mode.
[   67.081370] kjournald starting.  Commit interval 5 seconds
[   67.081398] EXT3-fs warning: maximal mount count reached, running e2fsck is recommended
[   67.084921] EXT3 FS on sda14, internal journal
[   67.084926] EXT3-fs: recovery complete.
[   67.086642] EXT3-fs: mounted filesystem with writeback data mode.
[   70.180629] kjournald starting.  Commit interval 5 seconds
[   70.181645] EXT3 FS on sda15, internal journal
[   70.181652] EXT3-fs: recovery complete.
[   70.181899] EXT3-fs: mounted filesystem with writeback data mode.
[   72.828239] kjournald starting.  Commit interval 5 seconds
[   72.829076] EXT3 FS on sda16, internal journal
[   72.829081] EXT3-fs: recovery complete.
[   72.830912] EXT3-fs: mounted filesystem with writeback data mode.
[   77.455874] kjournald starting.  Commit interval 5 seconds
[   77.455904] EXT3-fs warning: maximal mount count reached, running e2fsck is recommended
[   77.457320] EXT3 FS on sdb1, internal journal
[   77.457326] EXT3-fs: recovery complete.
[   77.461319] EXT3-fs: mounted filesystem with writeback data mode.
[   82.417153] kjournald starting.  Commit interval 5 seconds
[   82.417177] EXT3-fs warning: maximal mount count reached, running e2fsck is recommended
[   82.418578] EXT3 FS on sdb2, internal journal
[   82.418583] EXT3-fs: recovery complete.
[   82.418856] EXT3-fs: mounted filesystem with writeback data mode.
[   82.562475] kjournald starting.  Commit interval 5 seconds
[   82.562492] EXT3-fs warning: checktime reached, running e2fsck is recommended
[   82.563187] EXT3 FS on cciss/c0d0p1, internal journal
[   82.563194] EXT3-fs: recovery complete.
[   82.563273] EXT3-fs: mounted filesystem with writeback data mode.
[   82.702721] EXT4-fs: barriers enabled
[  109.279395] kjournald2 starting: pid 2538, dev cciss!c0d1p1:8, commit interval 5 seconds
[  109.301814] EXT4 FS on cciss!c0d1p1, internal journal on cciss!c0d1p1:8
[  109.301819] EXT4-fs: delayed allocation enabled
[  109.301822] EXT4-fs: file extents enabled
[  109.317435] EXT4-fs: mballoc enabled
[  109.317471] EXT4-fs: recovery complete.
[  109.317673] EXT4-fs: mounted filesystem cciss!c0d1p1 with writeback data mode
[  109.375906] kjournald starting.  Commit interval 5 seconds
[  109.375923] EXT3-fs warning: checktime reached, running e2fsck is recommended
[  109.376807] EXT3 FS on cciss/c0d2p1, internal journal
[  109.376814] EXT3-fs: recovery complete.
[  109.376968] EXT3-fs: mounted filesystem with writeback data mode.
[  110.723025] ADDRCONF(NETDEV_UP): eth0: link is not ready
[  110.724378] e1000: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
[  110.724738] ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[  114.179977] RPC: Registered udp transport module.
[  114.179981] RPC: Registered tcp transport module.
[  114.203505] Slow work thread pool: Starting up
[  114.203927] Slow work thread pool: Ready
[  114.204043] FS-Cache: Loaded
[  114.243369] FS-Cache: Netfs 'nfs' registered for caching
[  114.270511] Installing knfsd (copyright (C) 1996 okir@monad.swb.de).
[  116.797036] lp0: using parport0 (interrupt-driven).
[  116.807167] ppdev: user-space parallel port driver
[  121.272022] eth0: no IPv6 routers present
[  129.298094] svc: failed to register lockdv1 RPC service (errno 97).
[  129.298987] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
[  129.304067] NFSD: starting 90-second grace period

** Loaded modules:
Module                  Size  Used by
autofs4                20540  4 
ppdev                   6348  0 
lp                      8012  0 
nfsd                  204868  9 
exportfs                3792  1 nfsd
nfs                   221564  0 
lockd                  57968  2 nfsd,nfs
fscache                34432  1 nfs
nfs_acl                 2640  2 nfsd,nfs
auth_rpcgss            31416  2 nfsd,nfs
sunrpc                163796  30 nfsd,nfs,lockd,nfs_acl,auth_rpcgss
nls_utf8                1488  1 
cifs                  249640  2 
nls_base                6416  2 nls_utf8,cifs
ext4                  197212  1 
jbd2                   50148  1 ext4
crc16                   1760  1 ext4
loop                   13320  0 
snd_pcsp                8416  0 
psmouse                37528  0 
snd_pcm                62552  1 snd_pcsp
intel_rng               4320  0 
snd_timer              17436  1 snd_pcm
serio_raw               4560  0 
rng_core                3672  1 intel_rng
parport_pc             22464  1 
button                  5060  0 
processor              34568  0 
snd                    49060  3 snd_pcsp,snd_pcm,snd_timer
parport                31144  3 ppdev,lp,parport_pc
e7xxx_edac              4780  0 
shpchp                 26696  0 
soundcore               6184  1 snd
pci_hotplug            24400  1 shpchp
dcdbas                  6780  0 
snd_page_alloc          8252  1 snd_pcm
edac_core              35128  1 e7xxx_edac
evdev                   8028  2 
ext3                  107164  23 
jbd                    41032  1 ext3
mbcache                 6924  2 ext4,ext3
osst                   44100  0 
st                     31128  0 
ch                     12060  0 
sg                     20312  0 
sd_mod                 28740  30 
crc_t10dif              1632  1 sd_mod
ide_cd_mod             24484  0 
cdrom                  30328  1 ide_cd_mod
ata_generic             4340  0 
libata                151204  1 ata_generic
ide_pci_generic         3632  0 
uhci_hcd               19212  0 
ehci_hcd               30204  0 
megaraid_mbox          25648  18 
megaraid_mm             8124  1 megaraid_mbox
piix                    5680  0 
mptspi                 13388  7 
mptscsih               21680  1 mptspi
mptbase                54248  2 mptspi,mptscsih
usbcore               126396  3 uhci_hcd,ehci_hcd
aic7xxx               105252  1 
cciss                  77384  6 
scsi_transport_spi     18544  2 mptspi,aic7xxx
e1000                 102404  0 
ide_core               88004  3 ide_cd_mod,ide_pci_generic,piix
scsi_mod              131792  12 osst,st,ch,sg,sd_mod,libata,megaraid_mbox,mptspi,mptscsih,aic7xxx,cciss,scsi_transport_spi
floppy                 46236  0 
thermal                12580  0 
fan                     4044  0 
thermal_sys            13140  3 processor,thermal,fan

** PCI devices:
00:00.0 Host bridge [0600]: Intel Corporation E7500 Memory Controller Hub [8086:2540] (rev 03)
	Subsystem: Dell Device [1028:0123]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B+ ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

00:02.0 PCI bridge [0604]: Intel Corporation E7500/E7501 Hub Interface B PCI-to-PCI Bridge [8086:2543] (rev 03) (prog-if 00 [Normal decode])
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap- 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 64
	Bus: primary=00, secondary=01, subordinate=03, sec-latency=0
	I/O behind bridge: 0000d000-0000efff
	Memory behind bridge: fdb00000-fe0fffff
	Prefetchable memory behind bridge: f8000000-f80fffff
	Secondary status: 66MHz+ FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- <SERR- <PERR-
	BridgeCtl: Parity+ SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-

00:03.0 PCI bridge [0604]: Intel Corporation E7500/E7501 Hub Interface C PCI-to-PCI Bridge [8086:2545] (rev 03) (prog-if 00 [Normal decode])
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap- 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 64
	Bus: primary=00, secondary=04, subordinate=06, sec-latency=0
	I/O behind bridge: 0000c000-0000cfff
	Memory behind bridge: fd700000-fdafffff
	Secondary status: 66MHz+ FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- <SERR- <PERR-
	BridgeCtl: Parity+ SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-

00:04.0 PCI bridge [0604]: Intel Corporation E7500/E7501 Hub Interface D PCI-to-PCI Bridge [8086:2547] (rev 03) (prog-if 00 [Normal decode])
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap- 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 64
	Bus: primary=00, secondary=07, subordinate=0a, sec-latency=0
	I/O behind bridge: 0000b000-0000bfff
	Memory behind bridge: fd100000-fd6fffff
	Prefetchable memory behind bridge: f9000000-faffffff
	Secondary status: 66MHz+ FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- <SERR- <PERR-
	BridgeCtl: Parity+ SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-

00:1d.0 USB Controller [0c03]: Intel Corporation 82801CA/CAM USB Controller #1 [8086:2482] (rev 02) (prog-if 00 [UHCI])
	Subsystem: Dell Device [1028:0123]
	Control: I/O+ Mem- BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0
	Interrupt: pin A routed to IRQ 16
	Region 4: I/O ports at 9ce0 [size=32]
	Kernel driver in use: uhci_hcd

00:1e.0 PCI bridge [0604]: Intel Corporation 82801 PCI Bridge [8086:244e] (rev 42) (prog-if 00 [Normal decode])
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B+ ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0
	Bus: primary=00, secondary=0b, subordinate=0b, sec-latency=32
	I/O behind bridge: 0000a000-0000afff
	Memory behind bridge: fb000000-fcffffff
	Prefetchable memory behind bridge: f8100000-f81fffff
	Secondary status: 66MHz- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- <SERR- <PERR-
	BridgeCtl: Parity+ SERR+ NoISA- VGA+ MAbort- >Reset- FastB2B-
		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-

00:1f.0 ISA bridge [0601]: Intel Corporation 82801CA LPC Interface Controller [8086:2480] (rev 02)
	Control: I/O+ Mem+ BusMaster+ SpecCycle+ MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

00:1f.1 IDE interface [0101]: Intel Corporation 82801CA Ultra ATA Storage Controller [8086:248b] (rev 02) (prog-if 8a [Master SecP PriP])
	Subsystem: Dell Device [1028:0123]
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0
	Interrupt: pin A routed to IRQ 0
	Region 0: I/O ports at 01f0 [size=8]
	Region 1: I/O ports at 03f4 [size=1]
	Region 2: I/O ports at 0170 [size=8]
	Region 3: I/O ports at 0374 [size=1]
	Region 4: I/O ports at fc00 [size=16]
	Region 5: Memory at f8200000 (32-bit, non-prefetchable) [size=1K]
	Kernel driver in use: PIIX_IDE

01:1c.0 PIC [0800]: Intel Corporation 82870P2 P64H2 I/OxAPIC [8086:1461] (rev 04) (prog-if 20 [IO(X)-APIC])
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap+ 66MHz+ UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0
	Region 0: Memory at fdbff000 (32-bit, non-prefetchable) [size=4K]
	Capabilities: [50] PCI-X non-bridge device
		Command: DPERE- ERO- RBC=512 OST=1
		Status: Dev=01:1c.0 64bit+ 133MHz+ SCD- USC- DC=simple DMMRBC=512 DMOST=1 DMCRS=8 RSCEM- 266MHz- 533MHz-

01:1d.0 PCI bridge [0604]: Intel Corporation 82870P2 P64H2 Hub PCI Bridge [8086:1460] (rev 04) (prog-if 00 [Normal decode])
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap+ 66MHz+ UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 32, Cache Line Size: 64 bytes
	Bus: primary=01, secondary=02, subordinate=02, sec-latency=32
	I/O behind bridge: 0000e000-0000efff
	Memory behind bridge: fdf00000-fe0fffff
	Prefetchable memory behind bridge: 00000000f8000000-00000000f80fffff
	Secondary status: 66MHz+ FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- <SERR- <PERR-
	BridgeCtl: Parity+ SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
	Capabilities: [50] PCI-X bridge device
		Secondary Status: 64bit+ 133MHz+ SCD- USC- SCO- SRD- Freq=conv
		Status: Dev=01:1d.0 64bit+ 133MHz+ SCD- USC- SCO- SRD-
		Upstream: Capacity=65535 CommitmentLimit=0
		Downstream: Capacity=65535 CommitmentLimit=0

01:1e.0 PIC [0800]: Intel Corporation 82870P2 P64H2 I/OxAPIC [8086:1461] (rev 04) (prog-if 20 [IO(X)-APIC])
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap+ 66MHz+ UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0
	Region 0: Memory at fdbfe000 (32-bit, non-prefetchable) [size=4K]
	Capabilities: [50] PCI-X non-bridge device
		Command: DPERE- ERO- RBC=512 OST=1
		Status: Dev=01:1e.0 64bit+ 133MHz+ SCD- USC- DC=simple DMMRBC=512 DMOST=1 DMCRS=8 RSCEM- 266MHz- 533MHz-

01:1f.0 PCI bridge [0604]: Intel Corporation 82870P2 P64H2 Hub PCI Bridge [8086:1460] (rev 04) (prog-if 00 [Normal decode])
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap+ 66MHz+ UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 64, Cache Line Size: 64 bytes
	Bus: primary=01, secondary=03, subordinate=03, sec-latency=64
	I/O behind bridge: 0000d000-0000dfff
	Memory behind bridge: fdd00000-fdefffff
	Secondary status: 66MHz+ FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- <SERR- <PERR-
	BridgeCtl: Parity+ SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
	Capabilities: [50] PCI-X bridge device
		Secondary Status: 64bit+ 133MHz+ SCD- USC- SCO- SRD- Freq=133MHz
		Status: Dev=01:1f.0 64bit+ 133MHz+ SCD- USC- SCO- SRD-
		Upstream: Capacity=65535 CommitmentLimit=0
		Downstream: Capacity=65535 CommitmentLimit=0

02:02.0 SCSI storage controller [0100]: Adaptec AHA-3960D / AIC-7899A U160/m [9005:00c0] (rev 01)
	Subsystem: Adaptec AHA-3960D U160/m [9005:f620]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap+ 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 32 (10000ns min, 6250ns max), Cache Line Size: 64 bytes
	Interrupt: pin A routed to IRQ 24
	BIST result: 00
	Region 0: I/O ports at ec00 [disabled] [size=256]
	Region 1: Memory at fdfff000 (64-bit, non-prefetchable) [size=4K]
	Expansion ROM at fe000000 [disabled] [size=128K]
	Capabilities: [dc] Power Management version 2
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
	Kernel driver in use: aic7xxx

02:02.1 SCSI storage controller [0100]: Adaptec AHA-3960D / AIC-7899A U160/m [9005:00c0] (rev 01)
	Subsystem: Adaptec AHA-3960D U160/m [9005:f620]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap+ 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 32 (10000ns min, 6250ns max), Cache Line Size: 64 bytes
	Interrupt: pin B routed to IRQ 25
	BIST result: 00
	Region 0: I/O ports at e800 [disabled] [size=256]
	Region 1: Memory at fdffe000 (64-bit, non-prefetchable) [size=4K]
	Expansion ROM at f8000000 [disabled] [size=128K]
	Capabilities: [dc] Power Management version 2
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
	Kernel driver in use: aic7xxx

03:01.0 Ethernet controller [0200]: Intel Corporation 82544GC Gigabit Ethernet Controller (LOM) [8086:100d] (rev 02)
	Subsystem: Dell PRO/1000 XT Network Connection [1028:0123]
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap+ 66MHz+ UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 64 (63750ns min), Cache Line Size: 64 bytes
	Interrupt: pin A routed to IRQ 28
	Region 0: Memory at fdde0000 (64-bit, non-prefetchable) [size=128K]
	Region 2: Memory at fddc0000 (64-bit, non-prefetchable) [size=128K]
	Region 4: I/O ports at dce0 [size=32]
	Expansion ROM at fde00000 [disabled] [size=128K]
	Capabilities: [dc] Power Management version 2
		Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=1 PME-
	Capabilities: [e4] PCI-X non-bridge device
		Command: DPERE- ERO+ RBC=512 OST=1
		Status: Dev=03:01.0 64bit+ 133MHz+ SCD- USC- DC=simple DMMRBC=2048 DMOST=1 DMCRS=16 RSCEM- 266MHz- 533MHz-
	Capabilities: [f0] MSI: Enable- Count=1/1 Maskable- 64bit+
		Address: 0000000000000000  Data: 0000
	Kernel driver in use: e1000

04:1c.0 PIC [0800]: Intel Corporation 82870P2 P64H2 I/OxAPIC [8086:1461] (rev 04) (prog-if 20 [IO(X)-APIC])
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap+ 66MHz+ UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0
	Region 0: Memory at fd7ff000 (32-bit, non-prefetchable) [size=4K]
	Capabilities: [50] PCI-X non-bridge device
		Command: DPERE- ERO- RBC=512 OST=1
		Status: Dev=04:1c.0 64bit+ 133MHz+ SCD- USC- DC=simple DMMRBC=512 DMOST=1 DMCRS=8 RSCEM- 266MHz- 533MHz-

04:1d.0 PCI bridge [0604]: Intel Corporation 82870P2 P64H2 Hub PCI Bridge [8086:1460] (rev 04) (prog-if 00 [Normal decode])
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap+ 66MHz+ UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 64, Cache Line Size: 64 bytes
	Bus: primary=04, secondary=05, subordinate=05, sec-latency=64
	I/O behind bridge: 0000c000-0000cfff
	Memory behind bridge: fd900000-fdafffff
	Secondary status: 66MHz+ FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- <SERR- <PERR-
	BridgeCtl: Parity+ SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
	Capabilities: [50] PCI-X bridge device
		Secondary Status: 64bit+ 133MHz+ SCD- USC- SCO- SRD- Freq=100MHz
		Status: Dev=04:1d.0 64bit+ 133MHz+ SCD- USC- SCO- SRD-
		Upstream: Capacity=65535 CommitmentLimit=0
		Downstream: Capacity=65535 CommitmentLimit=0

04:1e.0 PIC [0800]: Intel Corporation 82870P2 P64H2 I/OxAPIC [8086:1461] (rev 04) (prog-if 20 [IO(X)-APIC])
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap+ 66MHz+ UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0
	Region 0: Memory at fd7fe000 (32-bit, non-prefetchable) [size=4K]
	Capabilities: [50] PCI-X non-bridge device
		Command: DPERE- ERO- RBC=512 OST=1
		Status: Dev=04:1e.0 64bit+ 133MHz+ SCD- USC- DC=simple DMMRBC=512 DMOST=1 DMCRS=8 RSCEM- 266MHz- 533MHz-

04:1f.0 PCI bridge [0604]: Intel Corporation 82870P2 P64H2 Hub PCI Bridge [8086:1460] (rev 04) (prog-if 00 [Normal decode])
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap+ 66MHz+ UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 64, Cache Line Size: 64 bytes
	Bus: primary=04, secondary=06, subordinate=06, sec-latency=64
	Secondary status: 66MHz+ FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort+ <SERR- <PERR-
	BridgeCtl: Parity+ SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
	Capabilities: [50] PCI-X bridge device
		Secondary Status: 64bit+ 133MHz+ SCD- USC- SCO- SRD- Freq=133MHz
		Status: Dev=04:1f.0 64bit+ 133MHz+ SCD- USC- SCO- SRD-
		Upstream: Capacity=65535 CommitmentLimit=0
		Downstream: Capacity=65535 CommitmentLimit=0

05:04.0 RAID bus controller [0104]: Hewlett-Packard Company Smart Array P600 [103c:3220]
	Subsystem: Hewlett-Packard Company 3 Gb/s SAS RAID [103c:3225]
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap+ 66MHz+ UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 64, Cache Line Size: 64 bytes
	Interrupt: pin A routed to IRQ 64
	Region 0: Memory at fd9fe000 (64-bit, non-prefetchable) [size=8K]
	Region 2: I/O ports at cc00 [size=256]
	Region 3: Memory at fd980000 (64-bit, non-prefetchable) [size=256K]
	Expansion ROM at fda00000 [disabled] [size=256K]
	Capabilities: [d0] Power Management version 2
		Flags: PMEClk- DSI- D1+ D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [dc] PCI-X non-bridge device
		Command: DPERE- ERO+ RBC=512 OST=4
		Status: Dev=05:04.0 64bit+ 133MHz+ SCD- USC- DC=simple DMMRBC=2048 DMOST=4 DMCRS=16 RSCEM- 266MHz+ 533MHz-
	Capabilities: [48] Vital Product Data
		Not readable
	Kernel driver in use: cciss

07:1c.0 PIC [0800]: Intel Corporation 82870P2 P64H2 I/OxAPIC [8086:1461] (rev 04) (prog-if 20 [IO(X)-APIC])
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap+ 66MHz+ UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0
	Region 0: Memory at fd1ff000 (32-bit, non-prefetchable) [size=4K]
	Capabilities: [50] PCI-X non-bridge device
		Command: DPERE- ERO- RBC=512 OST=1
		Status: Dev=07:1c.0 64bit+ 133MHz+ SCD- USC- DC=simple DMMRBC=512 DMOST=1 DMCRS=8 RSCEM- 266MHz- 533MHz-

07:1d.0 PCI bridge [0604]: Intel Corporation 82870P2 P64H2 Hub PCI Bridge [8086:1460] (rev 04) (prog-if 00 [Normal decode])
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap+ 66MHz+ UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 32, Cache Line Size: 64 bytes
	Bus: primary=07, secondary=08, subordinate=09, sec-latency=32
	I/O behind bridge: 0000b000-0000bfff
	Memory behind bridge: fd400000-fd6fffff
	Prefetchable memory behind bridge: 00000000fa000000-00000000faffffff
	Secondary status: 66MHz+ FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- <SERR- <PERR-
	BridgeCtl: Parity+ SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
	Capabilities: [50] PCI-X bridge device
		Secondary Status: 64bit+ 133MHz+ SCD- USC- SCO- SRD- Freq=conv
		Status: Dev=07:1d.0 64bit+ 133MHz+ SCD- USC- SCO- SRD-
		Upstream: Capacity=65535 CommitmentLimit=0
		Downstream: Capacity=65535 CommitmentLimit=0

07:1e.0 PIC [0800]: Intel Corporation 82870P2 P64H2 I/OxAPIC [8086:1461] (rev 04) (prog-if 20 [IO(X)-APIC])
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap+ 66MHz+ UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0
	Region 0: Memory at fd1fe000 (32-bit, non-prefetchable) [size=4K]
	Capabilities: [50] PCI-X non-bridge device
		Command: DPERE- ERO- RBC=512 OST=1
		Status: Dev=07:1e.0 64bit+ 133MHz+ SCD- USC- DC=simple DMMRBC=512 DMOST=1 DMCRS=8 RSCEM- 266MHz- 533MHz-

07:1f.0 PCI bridge [0604]: Intel Corporation 82870P2 P64H2 Hub PCI Bridge [8086:1460] (rev 04) (prog-if 00 [Normal decode])
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap+ 66MHz+ UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 32, Cache Line Size: 64 bytes
	Bus: primary=07, secondary=0a, subordinate=0a, sec-latency=32
	Memory behind bridge: fd300000-fd3fffff
	Prefetchable memory behind bridge: 00000000f9f00000-00000000f9ffffff
	Secondary status: 66MHz+ FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort+ <SERR- <PERR-
	BridgeCtl: Parity+ SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
	Capabilities: [50] PCI-X bridge device
		Secondary Status: 64bit+ 133MHz+ SCD- USC- SCO- SRD- Freq=conv
		Status: Dev=07:1f.0 64bit+ 133MHz+ SCD- USC- SCO- SRD-
		Upstream: Capacity=65535 CommitmentLimit=0
		Downstream: Capacity=65535 CommitmentLimit=0

08:08.0 PCI bridge [0604]: Intel Corporation 80303 I/O Processor PCI-to-PCI Bridge [8086:0309] (rev 01) (prog-if 00 [Normal decode])
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap+ 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=slow >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 32, Cache Line Size: 64 bytes
	Bus: primary=08, secondary=09, subordinate=09, sec-latency=32
	I/O behind bridge: 0000b000-0000bfff
	Memory behind bridge: fd500000-fd6fffff
	Prefetchable memory behind bridge: fa000000-fa0fffff
	Secondary status: 66MHz+ FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- <SERR- <PERR-
	BridgeCtl: Parity- SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
	Capabilities: [68] Power Management version 2
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-

09:0d.0 SCSI storage controller [0100]: LSI Logic / Symbios Logic 53c1030 PCI-X Fusion-MPT Dual Ultra320 SCSI [1000:0030] (rev 07)
	Subsystem: Dell LSI Logic 1020/1030 [1028:0123]
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap+ 66MHz+ UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 72 (4250ns min, 4500ns max), Cache Line Size: 64 bytes
	Interrupt: pin A routed to IRQ 65
	Region 0: I/O ports at bc00 [size=256]
	Region 1: Memory at fd5f0000 (64-bit, non-prefetchable) [size=64K]
	Region 3: Memory at fd5e0000 (64-bit, non-prefetchable) [size=64K]
	Expansion ROM at fd600000 [disabled] [size=1M]
	Capabilities: [50] Power Management version 2
		Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [58] MSI: Enable- Count=1/1 Maskable- 64bit+
		Address: 0000000000000000  Data: 0000
	Kernel driver in use: mptspi

09:0d.1 SCSI storage controller [0100]: LSI Logic / Symbios Logic 53c1030 PCI-X Fusion-MPT Dual Ultra320 SCSI [1000:0030] (rev 07)
	Subsystem: Dell LSI Logic 1020/1030 [1028:0123]
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap+ 66MHz+ UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 72 (4250ns min, 4500ns max), Cache Line Size: 64 bytes
	Interrupt: pin B routed to IRQ 67
	Region 0: I/O ports at b800 [size=256]
	Region 1: Memory at fd5d0000 (64-bit, non-prefetchable) [size=64K]
	Region 3: Memory at fd5c0000 (64-bit, non-prefetchable) [size=64K]
	Expansion ROM at fa000000 [disabled] [size=1M]
	Capabilities: [50] Power Management version 2
		Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [58] MSI: Enable- Count=1/1 Maskable- 64bit+
		Address: 0000000000000000  Data: 0000
	Kernel driver in use: mptspi

0a:07.0 RAID bus controller [0104]: LSI Logic / Symbios Logic MegaRAID [1000:1960] (rev 01)
	Subsystem: Dell MegaRAID 518 DELL PERC 4/DC RAID Controller [1028:0518]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap+ 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=slow >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 32, Cache Line Size: 64 bytes
	Interrupt: pin A routed to IRQ 66
	Region 0: Memory at f9ff0000 (32-bit, prefetchable) [size=64K]
	Expansion ROM at fd300000 [disabled] [size=64K]
	Capabilities: [80] Power Management version 2
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
	Kernel driver in use: megaraid

0b:04.0 VGA compatible controller [0300]: ATI Technologies Inc Rage XL [1002:4752] (rev 27) (prog-if 00 [VGA controller])
	Subsystem: Dell Device [1028:0123]
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop+ ParErr- Stepping+ SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 32 (2000ns min), Cache Line Size: 64 bytes
	Region 0: Memory at fb000000 (32-bit, non-prefetchable) [size=16M]
	Region 1: I/O ports at ac00 [size=256]
	Region 2: Memory at fceff000 (32-bit, non-prefetchable) [size=4K]
	[virtual] Expansion ROM at f8100000 [disabled] [size=128K]
	Capabilities: [5c] Power Management version 2
		Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-



-- System Information:
Debian Release: squeeze/sid
  APT prefers unstable
  APT policy: (500, 'unstable'), (500, 'stable')
Architecture: i386 (i686)

Kernel: Linux 2.6.30-2-686-bigmem (SMP w/4 CPU cores)
Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8)
Shell: /bin/sh linked to /bin/dash

Versions of packages linux-image-2.6.30-2-686-bigmem depends on:
ii  debconf [debconf-2.0]         1.5.27     Debian configuration management sy
ii  initramfs-tools [linux-initra 0.93.4     tools for generating an initramfs
ii  module-init-tools             3.10-3     tools for managing Linux kernel mo

Versions of packages linux-image-2.6.30-2-686-bigmem recommends:
ii  libc6-i686                    2.9-26     GNU C Library: Shared libraries [i

Versions of packages linux-image-2.6.30-2-686-bigmem suggests:
pn  grub | lilo                   <none>     (no description available)
pn  linux-doc-2.6.30              <none>     (no description available)

-- debconf information:
  linux-image-2.6.30-2-686-bigmem/postinst/old-system-map-link-2.6.30-2-686-bigmem: true
  linux-image-2.6.30-2-686-bigmem/preinst/abort-install-2.6.30-2-686-bigmem:
  shared/kernel-image/really-run-bootloader: true
  linux-image-2.6.30-2-686-bigmem/postinst/old-dir-initrd-link-2.6.30-2-686-bigmem: true
  linux-image-2.6.30-2-686-bigmem/preinst/elilo-initrd-2.6.30-2-686-bigmem: true
  linux-image-2.6.30-2-686-bigmem/preinst/failed-to-move-modules-2.6.30-2-686-bigmem:
  linux-image-2.6.30-2-686-bigmem/preinst/lilo-initrd-2.6.30-2-686-bigmem: true
  linux-image-2.6.30-2-686-bigmem/prerm/removing-running-kernel-2.6.30-2-686-bigmem: true
  linux-image-2.6.30-2-686-bigmem/preinst/initrd-2.6.30-2-686-bigmem:
  linux-image-2.6.30-2-686-bigmem/postinst/kimage-is-a-directory:
  linux-image-2.6.30-2-686-bigmem/postinst/depmod-error-2.6.30-2-686-bigmem: false
  linux-image-2.6.30-2-686-bigmem/prerm/would-invalidate-boot-loader-2.6.30-2-686-bigmem: true
  linux-image-2.6.30-2-686-bigmem/preinst/abort-overwrite-2.6.30-2-686-bigmem:
  linux-image-2.6.30-2-686-bigmem/postinst/old-initrd-link-2.6.30-2-686-bigmem: true
  linux-image-2.6.30-2-686-bigmem/postinst/depmod-error-initrd-2.6.30-2-686-bigmem: false
  linux-image-2.6.30-2-686-bigmem/postinst/bootloader-error-2.6.30-2-686-bigmem:
  linux-image-2.6.30-2-686-bigmem/preinst/overwriting-modules-2.6.30-2-686-bigmem: true
  linux-image-2.6.30-2-686-bigmem/postinst/create-kimage-link-2.6.30-2-686-bigmem: true
  linux-image-2.6.30-2-686-bigmem/preinst/bootloader-initrd-2.6.30-2-686-bigmem: true
  linux-image-2.6.30-2-686-bigmem/postinst/bootloader-test-error-2.6.30-2-686-bigmem:
  linux-image-2.6.30-2-686-bigmem/preinst/lilo-has-ramdisk:



Reply to: