Bug#617302: crash on lvconvert while moving mirrors between pvs
Package: linux-image
Version: 2.6.32-5-xen-amd64
While moveing lv-mimages from one pv (dev/md3) to other pvs my system showed some kernel bug.
Finally it is hanging on lvconvert.
xenserver1:~# uname -a
Linux xenserver1 2.6.32-5-xen-amd64 #1 SMP Wed Jan 12 05:46:49 UTC 2011 x86_64 GNU/Linux
I used:
lvconvert -m 2 vg1/mirror-disk /dev/sdl1
lvconvert -m 1 vg1/mirror-disk /dev/md3
lvs and xm didn't respond any more. The domUs and the hvm are still running.
xenserver1:~# lvconvert -m 1 vg1/mirror-disk /dev/md3
^C^C^Z (no response)
xenserver1:~# xm
^C^C^Z^Z^Z^Z^C^Z^C^Z (no response)
xenserver1:~# lvs
^C CTRL-c detected: giving up waiting for lock
/var/lock/lvm/V_vg1: flock failed: Interrupted system call
Can't get lock for vg1
Skipping volume group vg1
LV VG Attr LSize Origin Snap% Move Log Copy% Convert
crypt vg2 -wi-ao 10.00t
xenserver1:~# lsscsi
[2:0:0:0] disk ATA ST31000340AS SD25 /dev/sda
[3:0:0:0] disk ATA ST31000340AS SD25 /dev/sdb
[4:0:0:0] disk ATA ST31000340AS SD25 /dev/sdc
[5:0:0:0] disk ATA ST31000340AS SD1A /dev/sdd
[6:0:0:0] cd/dvd TSSTcorp CDDVDW SH-S203D SB00 /dev/sr0
[8:0:0:0] disk IFT A16U-G1A3 342J /dev/sde
[8:0:0:1] disk IFT A16U-G1A3 342J /dev/sdf
[8:0:0:2] disk IFT A16U-G1A3 342J /dev/sdg
[8:0:0:3] disk IFT A16U-G1A3 342J /dev/sdh
[8:0:0:4] disk IFT A16U-G1A3 342J /dev/sdi
[8:0:0:5] disk IFT A16U-G1A3 342J /dev/sdj
[9:0:2:0] enclosu IFT A16U-G2421-1 347R -
[9:0:2:1] disk IFT A16U-G2421-1 347R /dev/sdk
[9:0:2:2] disk IFT A16U-G2421-1 347R /dev/sdl
[9:0:3:0] enclosu IFT A16U-G2430 373K -
[9:0:3:1] disk IFT A16U-G2430 373K /dev/sdm
xenserver1:~# pvs -o lv_name,seg_size,lv_all
LV SSize LV UUID LV Attr Maj Min Rahead KMaj KMin KRahead LSize #Seg Origin OSize Snap% Copy% Move Convert LV Tags Log Modules
1.00t -1 -1 0 -1 -1 -1 0 0 0
[asterisk-disk.old_mimage_2] 24.00g DvH5wj-3Fq4-ISiZ-mDKv-Yt0w-Yolj-U1xqd1 [asterisk-disk.old_mimage_2] iwi-ao -1 -1 auto 253 21 128.00k 24.00g 1 0
[otrs-disk_mimage_3] 4.00g 82iCdq-eiva-R3b9-Kvjm-kI4f-SDwF-NZmIZn [otrs-disk_mimage_3] iwi-ao -1 -1 auto 253 15 128.00k 4.00g 1 0
[mail-disk_mimage_2] 4.00g hOk3Fd-Blei-ZSVC-uS2W-u8gu-ypH0-WLoy8N [mail-disk_mimage_2] iwi-ao -1 -1 auto 253 28 128.00k 4.00g 1 0
[wws2-disk_mimage_1] 4.00g OzbcVZ-hkjQ-Ng6l-J41b-5SVr-6kNa-tf8nbh [wws2-disk_mimage_1] iwi-ao -1 -1 auto 253 33 128.00k 4.00g 1 0
[mirror-disk_mimage_1] 4.00g SAszzI-zDUu-M76P-5bup-F3sY-Zavu-8Tfxqb [mirror-disk_mimage_1] iwi-ao -1 -1 auto 253 39 128.00k 4.00g 1 0
[WWS-disk_mimage_2] 4.10g O3UcH2-629o-wkd9-qzks-TykO-VpQl-CYZ9TU [WWS-disk_mimage_2] iwi-ao -1 -1 auto 253 9 128.00k 4.10g 1 0
9.87t -1 -1 0 -1 -1 -1 0 0 0
rescue 694.93g wvdMu5-wkBp-dCOZ-JSoP-afv0-feZ2-C0Vz5w rescue -wi-a- -1 -1 auto 253 23 128.00k 694.93g 1 0
mirror-swap 15.88g SegIav-NTVZ-nFFU-naub-sqBB-epjl-zmNHEH mirror-swap -wi-ao -1 -1 auto 253 36 128.00k 16.00g 2 0
66.45g -1 -1 0 -1 -1 -1 0 0 0
[asterisk-disk.old_mimage_0] 24.00g Qg8Kfv-ZlZM-rwIm-Hejq-JeKK-GzLZ-9AcJ7l [asterisk-disk.old_mimage_0] iwi-ao -1 -1 auto 253 19 128.00k 24.00g 1 0
[mail-disk_mimage_1] 4.00g 6e6XzQ-wFOx-rMKd-Bw0v-XUql-09Vf-qovJnK [mail-disk_mimage_1] iwi-ao -1 -1 auto 253 27 128.00k 4.00g 1 0
[otrs-disk_mimage_2] 4.00g lPkVnh-QwzM-jczK-FA1P-Gcwd-XQbe-G6bEZP [otrs-disk_mimage_2] iwi-ao -1 -1 auto 253 14 128.00k 4.00g 1 0
[Mailsrv-disk_mimage_2] 4.00g 1dU0y7-OPCd-7Lup-uuxc-o2RU-IWF6-NFJ4zW [Mailsrv-disk_mimage_2] iwi-ao -1 -1 auto 253 3 128.00k 4.00g 1 0
[wws2-disk_mlog] 4.00m lYx50O-wQox-lenD-uC37-joAD-86S5-KekWa1 [wws2-disk_mlog] lwi-ao -1 -1 auto 253 31 128.00k 4.00m 1 0
[mirror-disk_mlog] 4.00m l7cmrr-CSZr-HdPD-VEHS-x5UY-9D4s-icawc3 [mirror-disk_mlog] lwi-ao -1 -1 auto 253 37 128.00k 4.00m 1 0
[WWS-disk_mlog] 4.00m J2XFDS-0A1x-O1QT-8RLn-8nrC-A9x0-MOgqet [WWS-disk_mlog] lwi-ao -1 -1 auto 253 6 128.00k 4.00m 1 0
9.27g -1 -1 0 -1 -1 -1 0 0 0
[otrs-disk_mlog] 4.00m GHHv6M-cesJ-Lj1G-yYDd-TkAi-3h7C-3AN4PU [otrs-disk_mlog] lwi-ao -1 -1 auto 253 13 128.00k 4.00m 1 0
[Mailsrv-disk_mlog] 4.00m K05xDx-sVkV-LDJz-g7Ha-Arhg-9s1f-8jkqKu [Mailsrv-disk_mlog] lwi-ao -1 -1 auto 253 1 128.00k 4.00m 1 0
543.68g -1 -1 0 -1 -1 -1 0 0 0
[WWS-disk_mimage_1] 4.10g aqKIUX-97M8-eN3j-TwCZ-aPtv-UwPE-4JKClV [WWS-disk_mimage_1] iwi-ao -1 -1 auto 253 8 128.00k 4.10g 1 0
[mail-disk_mimage_0] 4.00g ofLRPb-tOaz-YauS-zYI2-U7sC-Q8z1-iSklyL [mail-disk_mimage_0] iwi-ao -1 -1 auto 253 26 128.00k 4.00g 1 0
[asterisk-disk.old_mimage_1] 24.00g a8u6Bs-gcDs-r0Al-l65o-R28Z-rA9e-oRg30y [asterisk-disk.old_mimage_1] iwi-ao -1 -1 auto 253 20 128.00k 24.00g 1 0
asterisk-swap 128.00m ZJj1pn-dVbV-lU62-vtOt-9eVi-fxOE-GVl4eI asterisk-swap -wi-a- -1 -1 auto 253 42 128.00k 128.00m 1 0
asterisk-disk 4.00g Mbo1LD-WqtT-lTkN-uVpz-45zY-xEmm-NybYpM asterisk-disk -wi-a- -1 -1 auto 253 43 128.00k 4.00g 1 0
351.59g -1 -1 0 -1 -1 -1 0 0 0
[Mailsrv-disk_mimage_0] 4.00g jQHax0-r4qU-hFDA-HcZK-jvY5-AKHr-lowlWw [Mailsrv-disk_mimage_0] iwi-ao -1 -1 auto 253 2 128.00k 4.00g 1 0
Mailsrv-swap 132.00m BlhkAt-kQ0n-DJQC-AYji-xSME-d30d-aeyfX5 Mailsrv-swap -wi-a- -1 -1 auto 253 5 128.00k 132.00m 1 0
[WWS-disk_mimage_0] 4.10g jJPKS8-F8th-65cL-jycS-rFgT-Lcd1-CfPIh1 [WWS-disk_mimage_0] iwi-ao -1 -1 auto 253 7 128.00k 4.10g 1 0
WWS-swap 128.00m CFIn0b-NBEA-ddk2-yt5p-1vPD-tXN8-s09aMs WWS-swap -wi-ao -1 -1 auto 253 11 128.00k 128.00m 1 0
otrs-swap 1.00g posJlS-GmqF-oWrA-bjkc-rCv5-iyKg-MzmzvM otrs-swap -wi-ao -1 -1 auto 253 12 128.00k 1.00g 1 0
asterisk-swap.old 128.00m h38hSK-1TSo-98cn-Cj9X-wXnn-yUl2-K7hBHc asterisk-swap.old -wi-a- -1 -1 auto 253 17 128.00k 128.00m 1 0
mail-swap 128.00m knMF9K-lUR8-pO3h-rP0k-g617-yqZe-9BvNnj mail-swap -wi-ao -1 -1 auto 253 24 128.00k 128.00m 1 0
pfsense-disk 4.00g UE7vQ4-Ymm2-gc43-2Up2-6hZa-lrBx-uw4qVm pfsense-disk -wi-ao -1 -1 auto 253 44 128.00k 4.00g 1 0
8.11g -1 -1 0 -1 -1 -1 0 0 0
wws2-swap 128.00m H1zxb9-NfUs-TcLs-1qlf-ThFc-rH1V-SRaqL5 wws2-swap -wi-ao -1 -1 auto 253 30 128.00k 128.00m 1 0
[wws2-disk_mimage_0] 4.00g o06VYy-ck7W-FdpM-eREL-HnfK-l1vE-dcmxmP [wws2-disk_mimage_0] iwi-ao -1 -1 auto 253 32 128.00k 4.00g 1 0
mirror-swap 128.00m SegIav-NTVZ-nFFU-naub-sqBB-epjl-zmNHEH mirror-swap -wi-ao -1 -1 auto 253 36 128.00k 16.00g 2 0
[mirror-disk_mimage_0] 4.00g grFPdL-KaNI-gz6R-W7i6-3lEg-lNrp-mVEUxX [mirror-disk_mimage_0] iwi-ao -1 -1 auto 253 38 128.00k 4.00g 1 0
[asterisk-disk.old_mlog] 4.00m x2DHPH-Yh0h-T7v9-P01f-QEkE-oGbW-UjErIq [asterisk-disk.old_mlog] lwi-ao -1 -1 auto 253 18 128.00k 4.00m 1 0
[mail-disk_mlog] 4.00m LwMnE0-rfky-ZSIq-69sg-5s2b-vBIr-tlNhDN [mail-disk_mlog] lwi-ao -1 -1 auto 253 25 128.00k 4.00m 1 0
pool_mirror 671.67g DzAX9w-qP6c-FX0a-1erA-oc6U-kvOf-9ZkQ6I pool_mirror -wi-ao -1 -1 auto 253 41 128.00k 3.00t 3 0
229.87g -1 -1 0 -1 -1 -1 0 0 0
pool_mirror 352.33g DzAX9w-qP6c-FX0a-1erA-oc6U-kvOf-9ZkQ6I pool_mirror -wi-ao -1 -1 auto 253 41 128.00k 3.00t 3 0
pool_single 100.00g LYM1g2-7nV1-ZsTj-B5tq-gA3R-ew2q-r6Ka3G pool_single -wi-ao -1 -1 auto 253 35 128.00k 1.10t 2 0
370.21g -1 -1 0 -1 -1 -1 0 0 0
pool_single 1.00t LYM1g2-7nV1-ZsTj-B5tq-gA3R-ew2q-r6Ka3G pool_single -wi-ao -1 -1 auto 253 35 128.00k 1.10t 2 0
pool_mirror 2.00t DzAX9w-qP6c-FX0a-1erA-oc6U-kvOf-9ZkQ6I pool_mirror -wi-ao -1 -1 auto 253 41 128.00k 3.00t 3 0
2.46t -1 -1 0 -1 -1 -1 0 0 0
[otrs-disk_mimage_4] 4.00g 6p1YuI-ZDZQ-Rmwj-rgJJ-ZX4H-PrPj-40eWFW [otrs-disk_mimage_4] iwi-ao -1 -1 auto 253 47 128.00k 4.00g 1 0
[mail-disk_mimage_3] 4.00g vnGdXM-nUVE-cNh2-o1kK-Mnqy-H9jM-0tevtG [mail-disk_mimage_3] iwi-ao -1 -1 auto 253 48 128.00k 4.00g 1 0
[wws2-disk_mimage_2] 4.00g Kr1KGt-56ob-R73p-jUfG-hdRu-9If8-ZzHaKv [wws2-disk_mimage_2] iwi-ao -1 -1 auto 253 49 128.00k 4.00g 1 0
[mirror-disk_mimage_2] 4.00g hfN4aq-emaz-Vtev-mM7C-xiMz-B5p7-R8iB2p [mirror-disk_mimage_2] iwi-ao -1 -1 auto 253 50 128.00k 4.00g 1 0
4.08t -1 -1 0 -1 -1 -1 0 0 0
crypt 10.00t kIfRye-hn0Z-qxvD-eJlW-sy0t-6UfK-Ny24uS crypt -wi-ao -1 -1 auto 253 0 128.00k 10.00t 1 0
15.47t -1 -1 0 -1 -1 -1 0 0 0
xenserver1:~# cat /proc/mdstat
Personalities : [linear] [raid1]
md3 : active linear sde1[0] sdj1[5] sdi1[4] sdh1[3] sdg1[2] sdf1[1]
11717688576 blocks 64k rounding
md2 : active raid1 sdd3[0] sda3[1]
97659008 blocks [2/2] [UU]
md1 : active raid1 sdd2[0] sda2[1]
15623104 blocks [2/2] [UU]
md0 : active raid1 sdd1[0] sda1[1]
979840 blocks [2/2] [UU]
unused devices: <none>
xenserver1:~# mount
/dev/md2 on / type ext3 (rw,errors=remount-ro)
tmpfs on /lib/init/rw type tmpfs (rw,nosuid,mode=0755)
proc on /proc type proc (rw,noexec,nosuid,nodev)
sysfs on /sys type sysfs (rw,noexec,nosuid,nodev)
udev on /dev type tmpfs (rw,mode=0755)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,noexec,nosuid,gid=5,mode=620)
/dev/md0 on /boot type ext3 (rw)
/dev/mapper/vg1-pool_mirror on /mnt/pool_mirror type ext3 (rw)
/dev/mapper/vg1-pool_single on /mnt/pool_single type ext3 (rw)
/mnt/pool_single/mirror on /srv/nfs/mirror type none (rw,bind)
/mnt/pool_single/tmp on /srv/nfs/tmp type none (rw,bind)
/mnt/pool_mirror/media on /srv/nfs/media type none (rw,bind)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw)
nfsd on /proc/fs/nfsd type nfsd (rw)
xenfs on /proc/xen type xenfs (rw)
/dev/mapper/uncrypted on /mnt/uncrypted type ext4 (rw)
Mar 7 22:42:15 xenserver1 kernel: [469074.917610] BUG: unable to handle kernel paging request at ffff8803e588d010
Mar 7 22:42:15 xenserver1 kernel: [469074.917657] IP: [<ffffffff8100e428>] xen_set_pmd+0x15/0x2c
Mar 7 22:42:15 xenserver1 kernel: [469074.917701] PGD 1002067 PUD 6988067 PMD 6ab5067 PTE 80100003e588d065
Mar 7 22:42:15 xenserver1 kernel: [469074.917749] Oops: 0003 [#1] SMP
Mar 7 22:42:15 xenserver1 kernel: [469074.917784] last sysfs file: /sys/devices/virtual/block/dm-29/dm/suspended
Mar 7 22:42:15 xenserver1 kernel: [469074.917822] CPU 0
Mar 7 22:42:15 xenserver1 kernel: [469074.917851] Modules linked in: ext4 jbd2 crc16 sha256_generic aes_x86_64 aes_generic cbc tun nf_conntrack_ipv4 nf_defrag_ipv4 xt_state nf_conntrack xt_physdev iptable_filter ip_tables x_tables xen_evtchn xenfs nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc bridge 8021q garp stp bonding dm_mirror dm_region_hash dm_log w83793 w83627hf hwmon_vid coretemp ipmi_si ipmi_msghandler loop dm_crypt i5400_edac snd_pcm edac_core snd_timer snd i5k_amb soundcore snd_page_alloc ioatdma psmouse i2c_i801 serio_raw container pcspkr dca processor i2c_core joydev evdev shpchp pci_hotplug button rng_core acpi_processor ext3 jbd mbcache dm_mod raid1 linear md_mod ses enclosure sg sr_mod cdrom sd_mod crc_t10dif ata_generic usbhid hid mptspi mptscsih ahci ata_piix uhci_hcd mptbase scsi_transport_spi e1000e libata ehci_hcd scsi_mod usbcore nls_base thermal thermal_sys [last unloaded: scsi_wait_scan]
Mar 7 22:42:15 xenserver1 kernel: [469074.918711] Pid: 14705, comm: dmsetup_env Not tainted 2.6.32-5-xen-amd64 #1 X7DWE
Mar 7 22:42:15 xenserver1 kernel: [469074.918767] RIP: e030:[<ffffffff8100e428>] [<ffffffff8100e428>] xen_set_pmd+0x15/0x2c
Mar 7 22:42:15 xenserver1 kernel: [469074.918829] RSP: e02b:ffff88014974fb18 EFLAGS: 00010246
Mar 7 22:42:15 xenserver1 kernel: [469074.918864] RAX: 0000000000000000 RBX: ffff8803e588d010 RCX: ffff880000000000
Mar 7 22:42:15 xenserver1 kernel: [469074.918923] RDX: ffffea0000000000 RSI: 0000000001d70000 RDI: ffff8803e588d010
Mar 7 22:42:15 xenserver1 kernel: [469074.918982] RBP: 0000000000000000 R08: 0000000001d70000 R09: ffff8803ea003100
Mar 7 22:42:15 xenserver1 kernel: [469074.919039] R10: 0000000000000000 R11: ffff8803e7628000 R12: 000000000061c000
Mar 7 22:42:15 xenserver1 kernel: [469074.919095] R13: 0000000000400000 R14: ffff8803e588d010 R15: ffff8803e5841000
Mar 7 22:42:15 xenserver1 kernel: [469074.919153] FS: 00007f3c9094f700(0000) GS:ffff880013d77000(0000) knlGS:0000000000000000
Mar 7 22:42:15 xenserver1 kernel: [469074.919210] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
Mar 7 22:42:15 xenserver1 kernel: [469074.919244] CR2: ffff8803e588d010 CR3: 00000003e584d000 CR4: 0000000000002660
Mar 7 22:42:15 xenserver1 kernel: [469074.919300] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Mar 7 22:42:15 xenserver1 kernel: [469074.919356] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Mar 7 22:42:15 xenserver1 kernel: [469074.919413] Process dmsetup_env (pid: 14705, threadinfo ffff88014974e000, task ffff880001a662e0)
Mar 7 22:42:15 xenserver1 kernel: [469074.919473] Stack:
Mar 7 22:42:15 xenserver1 kernel: [469074.919500] ffff880000000000 0000000000600000 0000000000400000 ffffffff810cf886
Mar 7 22:42:15 xenserver1 kernel: [469074.919547] <0> ffff88014974ffd8 00000003e5818067 ffff8803e5d71c00 0000000000000000
Mar 7 22:42:15 xenserver1 kernel: [469074.919620] <0> 0000000000000000 000000000061bfff 000000000061bfff 0000000001c00000
Mar 7 22:42:15 xenserver1 kernel: [469074.919711] Call Trace:
Mar 7 22:42:15 xenserver1 kernel: [469074.919742] [<ffffffff810cf886>] ? free_pgd_range+0x226/0x3bf
Mar 7 22:42:15 xenserver1 kernel: [469074.919779] [<ffffffff810cfabb>] ? free_pgtables+0x9c/0xbd
Mar 7 22:42:15 xenserver1 kernel: [469074.919814] [<ffffffff810d129d>] ? exit_mmap+0xef/0x148
Mar 7 22:42:15 xenserver1 kernel: [469074.919850] [<ffffffff8104cb09>] ? mmput+0x3c/0xdf
Mar 7 22:42:15 xenserver1 kernel: [469074.919889] [<ffffffff810f44d6>] ? flush_old_exec+0x45c/0x548
Mar 7 22:42:15 xenserver1 kernel: [469074.919928] [<ffffffff811270d0>] ? load_elf_binary+0x0/0x1954
Mar 7 22:42:15 xenserver1 kernel: [469074.919964] [<ffffffff8112746d>] ? load_elf_binary+0x39d/0x1954
Mar 7 22:42:15 xenserver1 kernel: [469074.920003] [<ffffffff810cc572>] ? follow_page+0x2ad/0x303
Mar 7 22:42:15 xenserver1 kernel: [469074.920006] [<ffffffff810ce136>] ? __get_user_pages+0x3ea/0x47b
Mar 7 22:42:15 xenserver1 kernel: [469074.920006] [<ffffffff810f4fcb>] ? get_arg_page+0x61/0x110
Mar 7 22:42:15 xenserver1 kernel: [469074.920006] [<ffffffff811270d0>] ? load_elf_binary+0x0/0x1954
Mar 7 22:42:15 xenserver1 kernel: [469074.920006] [<ffffffff810f3caa>] ? search_binary_handler+0xb4/0x245
Mar 7 22:42:15 xenserver1 kernel: [469074.920006] [<ffffffff810f54a7>] ? do_execve+0x1e4/0x2c3
Mar 7 22:42:15 xenserver1 kernel: [469074.920006] [<ffffffff81010500>] ? sys_execve+0x35/0x4c
Mar 7 22:42:15 xenserver1 kernel: [469074.920006] [<ffffffff81011f9a>] ? stub_execve+0x6a/0xc0
Mar 7 22:42:15 xenserver1 kernel: [469074.920006] Code: fb ff ff e8 c6 f4 01 00 bf 01 00 00 00 e8 c9 ea ff ff 59 5e 5b c3 55 48 89 f5 53 48 89 fb 48 83 ec 08 e8 6e e3 ff ff 84 c0 75 08 <48> 89 2b 41 59 5b 5d c3 41 58 48 89 df 48 89 ee 5b 5d e9 7e ff
Mar 7 22:42:15 xenserver1 kernel: [469074.920006] RIP [<ffffffff8100e428>] xen_set_pmd+0x15/0x2c
Mar 7 22:42:15 xenserver1 kernel: [469074.920006] RSP <ffff88014974fb18>
Mar 7 22:42:15 xenserver1 kernel: [469074.920006] CR2: ffff8803e588d010
Mar 7 22:42:15 xenserver1 kernel: [469074.920006] ---[ end trace d1d7d5bffead3e0e ]---
Mar 7 23:02:33 xenserver1 kernel: [470292.290238] ------------[ cut here ]------------
Mar 7 23:02:33 xenserver1 kernel: [470292.290306] kernel BUG at /build/buildd-linux-2.6_2.6.32-30-amd64-d4MbNM/linux-2.6-2.6.32/debian/build/source_amd64_xen/arch/x86/xen/mmu.c:1649!
Mar 7 23:02:33 xenserver1 kernel: [470292.293759] invalid opcode: 0000 [#2] SMP
Mar 7 23:02:33 xenserver1 kernel: [470292.293759] last sysfs file: /sys/devices/virtual/block/dm-40/dm/suspended
Mar 7 23:02:33 xenserver1 kernel: [470292.293759] CPU 1
Mar 7 23:02:33 xenserver1 kernel: [470292.293759] Modules linked in: ext4 jbd2 crc16 sha256_generic aes_x86_64 aes_generic cbc tun nf_conntrack_ipv4 nf_defrag_ipv4 xt_state nf_conntrack xt_physdev iptable_filter ip_tables x_tables xen_evtchn xenfs nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc bridge 8021q garp stp bonding dm_mirror dm_region_hash dm_log w83793 w83627hf hwmon_vid coretemp ipmi_si ipmi_msghandler loop dm_crypt i5400_edac snd_pcm edac_core snd_timer snd i5k_amb soundcore snd_page_alloc ioatdma psmouse i2c_i801 serio_raw container pcspkr dca processor i2c_core joydev evdev shpchp pci_hotplug button rng_core acpi_processor ext3 jbd mbcache dm_mod raid1 linear md_mod ses enclosure sg sr_mod cdrom sd_mod crc_t10dif ata_generic usbhid hid mptspi mptscsih ahci ata_piix uhci_hcd mptbase scsi_transport_spi e1000e libata ehci_hcd scsi_mod usbcore nls_base thermal thermal_sys [last unloaded: scsi_wait_scan]
Mar 7 23:02:33 xenserver1 kernel: [470292.296901] Pid: 15495, comm: dmsetup Tainted: G D 2.6.32-5-xen-amd64 #1 X7DWE
Mar 7 23:02:33 xenserver1 kernel: [470292.296901] RIP: e030:[<ffffffff8100c694>] [<ffffffff8100c694>] pin_pagetable_pfn+0x2d/0x36
Mar 7 23:02:33 xenserver1 kernel: [470292.296901] RSP: e02b:ffff8803e3ae1e08 EFLAGS: 00010282
Mar 7 23:02:33 xenserver1 kernel: [470292.296901] RAX: 00000000ffffffea RBX: 00000000003e3b9c RCX: 0000000000000001
Mar 7 23:02:33 xenserver1 kernel: [470292.296901] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff8803e3ae1e08
Mar 7 23:02:33 xenserver1 kernel: [470292.296901] RBP: ffff8803e5306a00 R08: 0000000000000ce0 R09: ffffea000d9d0a20
Mar 7 23:02:33 xenserver1 kernel: [470292.296901] R10: 0000000000007ff0 R11: 0000000013da7030 R12: ffff8803e3b026c0
Mar 7 23:02:33 xenserver1 kernel: [470292.296901] R13: ffff88016e335958 R14: ffff8803b5cd69f0 R15: ffff8803e3b026c0
Mar 7 23:02:33 xenserver1 kernel: [470292.296901] FS: 00007fdcdb8767a0(0000) GS:ffff880013d95000(0000) knlGS:0000000000000000
Mar 7 23:02:33 xenserver1 kernel: [470292.296901] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
Mar 7 23:02:33 xenserver1 kernel: [470292.296901] CR2: 00007fdcdb003420 CR3: 00000003e3b58000 CR4: 0000000000002660
Mar 7 23:02:33 xenserver1 kernel: [470292.296901] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Mar 7 23:02:33 xenserver1 kernel: [470292.296901] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Mar 7 23:02:33 xenserver1 kernel: [470292.296901] Process dmsetup (pid: 15495, threadinfo ffff8803e3ae0000, task ffff8803b5cd69f0)
Mar 7 23:02:33 xenserver1 kernel: [470292.296901] Stack:
Mar 7 23:02:33 xenserver1 kernel: [470292.296901] 0000000000000000 0000000000010a20 ffffea000d9d0a20 00000000003e3b9c
Mar 7 23:02:33 xenserver1 kernel: [470292.296901] <0> ffff8803e5306a00 ffffffff810cd4e2 ffff8803e62fbb98 00007fdcdb003420
Mar 7 23:02:33 xenserver1 kernel: [470292.296901] <0> 00000003e62fb000 ffffffff810cb394 ffff88016e335958 00007fdcdb003420
Mar 7 23:02:33 xenserver1 kernel: [470292.296901] Call Trace:
Mar 7 23:02:33 xenserver1 kernel: [470292.296901] [<ffffffff810cd4e2>] ? __pte_alloc+0x6b/0xc6
Mar 7 23:02:33 xenserver1 kernel: [470292.296901] [<ffffffff810cb394>] ? pmd_alloc+0x28/0x5b
Mar 7 23:02:33 xenserver1 kernel: [470292.296901] [<ffffffff810cd60b>] ? handle_mm_fault+0xce/0x80f
Mar 7 23:02:33 xenserver1 kernel: [470292.296901] [<ffffffff810fbc5c>] ? do_vfs_ioctl+0x48d/0x4cb
Mar 7 23:02:33 xenserver1 kernel: [470292.296901] [<ffffffff8130f016>] ? do_page_fault+0x2e0/0x2fc
Mar 7 23:02:33 xenserver1 kernel: [470292.296901] [<ffffffff8130ceb5>] ? page_fault+0x25/0x30
Mar 7 23:02:33 xenserver1 kernel: [470292.296901] Code: ec 28 89 3c 24 48 89 f7 e8 a2 fd ff ff 48 89 e7 48 89 44 24 08 be 01 00 00 00 31 d2 41 ba f0 7f 00 00 e8 b0 cc ff ff 85 c0 74 04 <0f> 0b eb fe 48 83 c4 28 c3 55 49 89 ca 48 89 d5 40 88 f1 48 89
Mar 7 23:02:33 xenserver1 kernel: [470292.296901] RIP [<ffffffff8100c694>] pin_pagetable_pfn+0x2d/0x36
Mar 7 23:02:33 xenserver1 kernel: [470292.296901] RSP <ffff8803e3ae1e08>
Mar 7 23:02:33 xenserver1 kernel: [470292.296901] ---[ end trace d1d7d5bffead3e0f ]---
Mar 7 23:03:37 xenserver1 kernel: [470356.904503] BUG: soft lockup - CPU#1 stuck for 61s! [dmsetup:15495]
Mar 7 23:03:37 xenserver1 kernel: [470356.904503] Modules linked in: ext4 jbd2 crc16 sha256_generic aes_x86_64 aes_generic cbc tun nf_conntrack_ipv4 nf_defrag_ipv4 xt_state nf_conntrack xt_physdev iptable_filter ip_tables x_tables xen_evtchn xenfs nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc bridge 8021q garp stp bonding dm_mirror dm_region_hash dm_log w83793 w83627hf hwmon_vid coretemp ipmi_si ipmi_msghandler loop dm_crypt i5400_edac snd_pcm edac_core snd_timer snd i5k_amb soundcore snd_page_alloc ioatdma psmouse i2c_i801 serio_raw container pcspkr dca processor i2c_core joydev evdev shpchp pci_hotplug button rng_core acpi_processor ext3 jbd mbcache dm_mod raid1 linear md_mod ses enclosure sg sr_mod cdrom sd_mod crc_t10dif ata_generic usbhid hid mptspi mptscsih ahci ata_piix uhci_hcd mptbase scsi_transport_spi e1000e libata ehci_hcd scsi_mod usbcore nls_base thermal thermal_sys [last unloaded: scsi_wait_scan]
Mar 7 23:03:37 xenserver1 kernel: [470356.908023] CPU 1:
Mar 7 23:03:37 xenserver1 kernel: [470356.908023] Modules linked in: ext4 jbd2 crc16 sha256_generic aes_x86_64 aes_generic cbc tun nf_conntrack_ipv4 nf_defrag_ipv4 xt_state nf_conntrack xt_physdev iptable_filter ip_tables x_tables xen_evtchn xenfs nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc bridge 8021q garp stp bonding dm_mirror dm_region_hash dm_log w83793 w83627hf hwmon_vid coretemp ipmi_si ipmi_msghandler loop dm_crypt i5400_edac snd_pcm edac_core snd_timer snd i5k_amb soundcore snd_page_alloc ioatdma psmouse i2c_i801 serio_raw container pcspkr dca processor i2c_core joydev evdev shpchp pci_hotplug button rng_core acpi_processor ext3 jbd mbcache dm_mod raid1 linear md_mod ses enclosure sg sr_mod cdrom sd_mod crc_t10dif ata_generic usbhid hid mptspi mptscsih ahci ata_piix uhci_hcd mptbase scsi_transport_spi e1000e libata ehci_hcd scsi_mod usbcore nls_base thermal thermal_sys [last unloaded: scsi_wait_scan]
Mar 7 23:03:37 xenserver1 kernel: [470356.911568] Pid: 15495, comm: dmsetup Tainted: G D 2.6.32-5-xen-amd64 #1 X7DWE
Mar 7 23:03:37 xenserver1 kernel: [470356.911568] RIP: e030:[<ffffffff8130cb18>] [<ffffffff8130cb18>] _spin_lock+0x15/0x1b
Mar 7 23:03:37 xenserver1 kernel: [470356.911568] RSP: e02b:ffff8803e3ae1b10 EFLAGS: 00000297
Mar 7 23:03:37 xenserver1 kernel: [470356.911568] RAX: 0000000000000023 RBX: ffff8803e3ae1b28 RCX: ffff8803e3ae1b68
Mar 7 23:03:37 xenserver1 kernel: [470356.911568] RDX: 0000000000000022 RSI: 0000000000000200 RDI: ffff8803e5306a80
Mar 7 23:03:37 xenserver1 kernel: [470356.911986] RBP: 0000000000000200 R08: 0000000000000008 R09: ffffffff814eb870
Mar 7 23:03:37 xenserver1 kernel: [470356.912034] R10: 000000000000000b R11: ffffffff811ba945 R12: ffff8803e5306a00
Mar 7 23:03:37 xenserver1 kernel: [470356.912034] R13: 000000000000c580 R14: ffff8803e3ae1b28 R15: ffffffff814eb830
Mar 7 23:03:37 xenserver1 kernel: [470356.912270] FS: 00007fdcdb8767a0(0000) GS:ffff880013d95000(0000) knlGS:0000000000000000
Mar 7 23:03:37 xenserver1 kernel: [470356.912270] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
Mar 7 23:03:37 xenserver1 kernel: [470356.912270] CR2: 00007fdcdb003420 CR3: 0000000001001000 CR4: 0000000000002660
Mar 7 23:03:37 xenserver1 kernel: [470356.912468] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Mar 7 23:03:37 xenserver1 kernel: [470356.912468] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Mar 7 23:03:37 xenserver1 kernel: [470356.912468] Call Trace:
Mar 7 23:03:37 xenserver1 kernel: [470356.912468] [<ffffffff8100dd87>] ? xen_exit_mmap+0xf8/0x136
Mar 7 23:03:37 xenserver1 kernel: [470356.912468] [<ffffffff8130cb3a>] ? _spin_unlock_irqrestore+0xd/0xe
Mar 7 23:03:37 xenserver1 kernel: [470356.912468] [<ffffffff8100922a>] ? hypercall_page+0x22a/0x1001
Mar 7 23:03:37 xenserver1 kernel: [470356.912468] [<ffffffff810d1208>] ? exit_mmap+0x5a/0x148
Mar 7 23:03:37 xenserver1 kernel: [470356.912468] [<ffffffff8100ecf2>] ? check_events+0x12/0x20
Mar 7 23:03:37 xenserver1 kernel: [470356.912468] [<ffffffff811ba945>] ? vgacon_cursor+0x0/0x140
Mar 7 23:03:37 xenserver1 kernel: [470356.912468] [<ffffffff8104cb09>] ? mmput+0x3c/0xdf
Mar 7 23:03:37 xenserver1 kernel: [470356.912468] [<ffffffff81050702>] ? exit_mm+0x102/0x10d
Mar 7 23:03:37 xenserver1 kernel: [470356.912468] [<ffffffff8100ec99>] ? xen_irq_enable_direct_end+0x0/0x7
Mar 7 23:03:37 xenserver1 kernel: [470356.912468] [<ffffffff81052127>] ? do_exit+0x1f8/0x6c6
Mar 7 23:03:37 xenserver1 kernel: [470356.912468] [<ffffffff8100ecdf>] ? xen_restore_fl_direct_end+0x0/0x1
Mar 7 23:03:37 xenserver1 kernel: [470356.912468] [<ffffffff8130cb3a>] ? _spin_unlock_irqrestore+0xd/0xe
Mar 7 23:03:37 xenserver1 kernel: [470356.912468] [<ffffffff8104f3af>] ? release_console_sem+0x17e/0x1af
Mar 7 23:03:37 xenserver1 kernel: [470356.913521] [<ffffffff8130d9dd>] ? oops_end+0xaf/0xb4
Mar 7 23:03:37 xenserver1 kernel: [470356.913521] [<ffffffff810135f0>] ? do_invalid_op+0x8b/0x95
Mar 7 23:03:37 xenserver1 kernel: [470356.913521] [<ffffffff8100c694>] ? pin_pagetable_pfn+0x2d/0x36
Mar 7 23:03:37 xenserver1 kernel: [470356.913521] [<ffffffffa01419ea>] ? copy_params+0x71/0xb1 [dm_mod]
Mar 7 23:03:37 xenserver1 kernel: [470356.913521] [<ffffffff810baf07>] ? __alloc_pages_nodemask+0x11c/0x5f5
Mar 7 23:03:37 xenserver1 kernel: [470356.913521] [<ffffffff8101293b>] ? invalid_op+0x1b/0x20
Mar 7 23:03:37 xenserver1 kernel: [470356.913521] [<ffffffff8100c694>] ? pin_pagetable_pfn+0x2d/0x36
Mar 7 23:03:37 xenserver1 kernel: [470356.913521] [<ffffffff8100c690>] ? pin_pagetable_pfn+0x29/0x36
Mar 7 23:03:37 xenserver1 kernel: [470356.913521] [<ffffffff810cd4e2>] ? __pte_alloc+0x6b/0xc6
Mar 7 23:03:37 xenserver1 kernel: [470356.913521] [<ffffffff810cb394>] ? pmd_alloc+0x28/0x5b
Mar 7 23:03:37 xenserver1 kernel: [470356.913521] [<ffffffff810cd60b>] ? handle_mm_fault+0xce/0x80f
Mar 7 23:03:37 xenserver1 kernel: [470356.913521] [<ffffffff810fbc5c>] ? do_vfs_ioctl+0x48d/0x4cb
Mar 7 23:03:37 xenserver1 kernel: [470356.913521] [<ffffffff8130f016>] ? do_page_fault+0x2e0/0x2fc
Mar 7 23:03:37 xenserver1 kernel: [470356.913521] [<ffffffff8130ceb5>] ? page_fault+0x25/0x30
Mar 7 23:04:43 xenserver1 kernel: [470422.400502] BUG: soft lockup - CPU#1 stuck for 61s! [dmsetup:15495]
Mar 7 23:04:43 xenserver1 kernel: [470422.400502] Modules linked in: ext4 jbd2 crc16 sha256_generic aes_x86_64 aes_generic cbc tun nf_conntrack_ipv4 nf_defrag_ipv4 xt_state nf_conntrack xt_physdev iptable_filter ip_tables x_tables xen_evtchn xenfs nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc bridge 8021q garp stp bonding dm_mirror dm_region_hash dm_log w83793 w83627hf hwmon_vid coretemp ipmi_si ipmi_msghandler loop dm_crypt i5400_edac snd_pcm edac_core snd_timer snd i5k_amb soundcore snd_page_alloc ioatdma psmouse i2c_i801 serio_raw container pcspkr dca processor i2c_core joydev evdev shpchp pci_hotplug button rng_core acpi_processor ext3 jbd mbcache dm_mod raid1 linear md_mod ses enclosure sg sr_mod cdrom sd_mod crc_t10dif ata_generic usbhid hid mptspi mptscsih ahci ata_piix uhci_hcd mptbase scsi_transport_spi e1000e libata ehci_hcd scsi_mod usbcore nls_base thermal thermal_sys [last unloaded: scsi_wait_scan]
Mar 7 23:04:43 xenserver1 kernel: [470422.404022] CPU 1:
Mar 7 23:04:43 xenserver1 kernel: [470422.404022] Modules linked in: ext4 jbd2 crc16 sha256_generic aes_x86_64 aes_generic cbc tun nf_conntrack_ipv4 nf_defrag_ipv4 xt_state nf_conntrack xt_physdev iptable_filter ip_tables x_tables xen_evtchn xenfs nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc bridge 8021q garp stp bonding dm_mirror dm_region_hash dm_log w83793 w83627hf hwmon_vid coretemp ipmi_si ipmi_msghandler loop dm_crypt i5400_edac snd_pcm edac_core snd_timer snd i5k_amb soundcore snd_page_alloc ioatdma psmouse i2c_i801 serio_raw container pcspkr dca processor i2c_core joydev evdev shpchp pci_hotplug button rng_core acpi_processor ext3 jbd mbcache dm_mod raid1 linear md_mod ses enclosure sg sr_mod cdrom sd_mod crc_t10dif ata_generic usbhid hid mptspi mptscsih ahci ata_piix uhci_hcd mptbase scsi_transport_spi e1000e libata ehci_hcd scsi_mod usbcore nls_base thermal thermal_sys [last unloaded: scsi_wait_scan]
Mar 7 23:04:43 xenserver1 kernel: [470422.405522] Pid: 15495, comm: dmsetup Tainted: G D 2.6.32-5-xen-amd64 #1 X7DWE
Mar 7 23:04:43 xenserver1 kernel: [470422.405522] RIP: e030:[<ffffffff8130cb16>] [<ffffffff8130cb16>] _spin_lock+0x13/0x1b
Mar 7 23:04:43 xenserver1 kernel: [470422.405522] RSP: e02b:ffff8803e3ae1b10 EFLAGS: 00000297
Mar 7 23:04:43 xenserver1 kernel: [470422.405522] RAX: 0000000000000023 RBX: ffff8803e3ae1b28 RCX: ffff8803e3ae1b68
Mar 7 23:04:43 xenserver1 kernel: [470422.405522] RDX: 0000000000000022 RSI: 0000000000000200 RDI: ffff8803e5306a80
Mar 7 23:04:43 xenserver1 kernel: [470422.408023] RBP: 0000000000000200 R08: 0000000000000008 R09: ffffffff814eb870
Mar 7 23:04:43 xenserver1 kernel: [470422.408023] R10: 000000000000000b R11: ffffffff811ba945 R12: ffff8803e5306a00
Mar 7 23:04:43 xenserver1 kernel: [470422.408023] R13: 000000000000c580 R14: ffff8803e3ae1b28 R15: ffffffff814eb830
Mar 7 23:04:43 xenserver1 kernel: [470422.412023] FS: 00007fdcdb8767a0(0000) GS:ffff880013d95000(0000) knlGS:0000000000000000
Mar 7 23:04:43 xenserver1 kernel: [470422.412023] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
Mar 7 23:04:43 xenserver1 kernel: [470422.412023] CR2: 00007fdcdb003420 CR3: 0000000001001000 CR4: 0000000000002660
Mar 7 23:04:43 xenserver1 kernel: [470422.412023] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Mar 7 23:04:43 xenserver1 kernel: [470422.412023] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Mar 7 23:04:43 xenserver1 kernel: [470422.412023] Call Trace:
Mar 7 23:04:43 xenserver1 kernel: [470422.412023] [<ffffffff8100dd87>] ? xen_exit_mmap+0xf8/0x136
Mar 7 23:04:43 xenserver1 kernel: [470422.412023] [<ffffffff8130cb3a>] ? _spin_unlock_irqrestore+0xd/0xe
Mar 7 23:04:43 xenserver1 kernel: [470422.412023] [<ffffffff8100922a>] ? hypercall_page+0x22a/0x1001
Mar 7 23:04:43 xenserver1 kernel: [470422.412023] [<ffffffff810d1208>] ? exit_mmap+0x5a/0x148
Mar 7 23:04:43 xenserver1 kernel: [470422.412023] [<ffffffff8100ecf2>] ? check_events+0x12/0x20
Mar 7 23:04:43 xenserver1 kernel: [470422.412023] [<ffffffff811ba945>] ? vgacon_cursor+0x0/0x140
Mar 7 23:04:43 xenserver1 kernel: [470422.412023] [<ffffffff8104cb09>] ? mmput+0x3c/0xdf
Mar 7 23:04:43 xenserver1 kernel: [470422.412023] [<ffffffff81050702>] ? exit_mm+0x102/0x10d
Mar 7 23:04:43 xenserver1 kernel: [470422.413520] [<ffffffff8100ec99>] ? xen_irq_enable_direct_end+0x0/0x7
Mar 7 23:04:43 xenserver1 kernel: [470422.413520] [<ffffffff81052127>] ? do_exit+0x1f8/0x6c6
Mar 7 23:04:43 xenserver1 kernel: [470422.413520] [<ffffffff8100ecdf>] ? xen_restore_fl_direct_end+0x0/0x1
Mar 7 23:04:43 xenserver1 kernel: [470422.413520] [<ffffffff8130cb3a>] ? _spin_unlock_irqrestore+0xd/0xe
Mar 7 23:04:43 xenserver1 kernel: [470422.413520] [<ffffffff8104f3af>] ? release_console_sem+0x17e/0x1af
Mar 7 23:04:43 xenserver1 kernel: [470422.413520] [<ffffffff8130d9dd>] ? oops_end+0xaf/0xb4
Mar 7 23:04:43 xenserver1 kernel: [470422.413520] [<ffffffff810135f0>] ? do_invalid_op+0x8b/0x95
Mar 7 23:04:43 xenserver1 kernel: [470422.413520] [<ffffffff8100c694>] ? pin_pagetable_pfn+0x2d/0x36
Mar 7 23:04:43 xenserver1 kernel: [470422.413520] [<ffffffffa01419ea>] ? copy_params+0x71/0xb1 [dm_mod]
Mar 7 23:04:43 xenserver1 kernel: [470422.413520] [<ffffffff810baf07>] ? __alloc_pages_nodemask+0x11c/0x5f5
Mar 7 23:04:43 xenserver1 kernel: [470422.413520] [<ffffffff8101293b>] ? invalid_op+0x1b/0x20
Mar 7 23:04:43 xenserver1 kernel: [470422.413520] [<ffffffff8100c694>] ? pin_pagetable_pfn+0x2d/0x36
Mar 7 23:04:43 xenserver1 kernel: [470422.413520] [<ffffffff8100c690>] ? pin_pagetable_pfn+0x29/0x36
Mar 7 23:04:43 xenserver1 kernel: [470422.413520] [<ffffffff810cd4e2>] ? __pte_alloc+0x6b/0xc6
Mar 7 23:04:43 xenserver1 kernel: [470422.413520] [<ffffffff810cb394>] ? pmd_alloc+0x28/0x5b
Mar 7 23:04:43 xenserver1 kernel: [470422.413520] [<ffffffff810cd60b>] ? handle_mm_fault+0xce/0x80f
Mar 7 23:04:43 xenserver1 kernel: [470422.413520] [<ffffffff810fbc5c>] ? do_vfs_ioctl+0x48d/0x4cb
Mar 7 23:04:43 xenserver1 kernel: [470422.413520] [<ffffffff8130f016>] ? do_page_fault+0x2e0/0x2fc
Mar 7 23:04:43 xenserver1 kernel: [470422.413520] [<ffffffff8130ceb5>] ? page_fault+0x25/0x30
Mar 7 23:05:48 xenserver1 kernel: [470487.900502] BUG: soft lockup - CPU#1 stuck for 61s! [dmsetup:15495]
Mar 7 23:05:48 xenserver1 kernel: [470487.900502] Modules linked in: ext4 jbd2 crc16 sha256_generic aes_x86_64 aes_generic cbc tun nf_conntrack_ipv4 nf_defrag_ipv4 xt_state nf_conntrack xt_physdev iptable_filter ip_tables x_tables xen_evtchn xenfs nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc bridge 8021q garp stp bonding dm_mirror dm_region_hash dm_log w83793 w83627hf hwmon_vid coretemp ipmi_si ipmi_msghandler loop dm_crypt i5400_edac snd_pcm edac_core snd_timer snd i5k_amb soundcore snd_page_alloc ioatdma psmouse i2c_i801 serio_raw container pcspkr dca processor i2c_core joydev evdev shpchp pci_hotplug button rng_core acpi_processor ext3 jbd mbcache dm_mod raid1 linear md_mod ses enclosure sg sr_mod cdrom sd_mod crc_t10dif ata_generic usbhid hid mptspi mptscsih ahci ata_piix uhci_hcd mptbase scsi_transport_spi e1000e libata ehci_hcd scsi_mod usbcore nls_base thermal thermal_sys [last unloaded: scsi_wait_scan]
Mar 7 23:05:48 xenserver1 kernel: [470487.904020] CPU 1:
Mar 7 23:05:48 xenserver1 kernel: [470487.904020] Modules linked in: ext4 jbd2 crc16 sha256_generic aes_x86_64 aes_generic cbc tun nf_conntrack_ipv4 nf_defrag_ipv4 xt_state nf_conntrack xt_physdev iptable_filter ip_tables x_tables xen_evtchn xenfs nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc bridge 8021q garp stp bonding dm_mirror dm_region_hash dm_log w83793 w83627hf hwmon_vid coretemp ipmi_si ipmi_msghandler loop dm_crypt i5400_edac snd_pcm edac_core snd_timer snd i5k_amb soundcore snd_page_alloc ioatdma psmouse i2c_i801 serio_raw container pcspkr dca processor i2c_core joydev evdev shpchp pci_hotplug button rng_core acpi_processor ext3 jbd mbcache dm_mod raid1 linear md_mod ses enclosure sg sr_mod cdrom sd_mod crc_t10dif ata_generic usbhid hid mptspi mptscsih ahci ata_piix uhci_hcd mptbase scsi_transport_spi e1000e libata ehci_hcd scsi_mod usbcore nls_base thermal thermal_sys [last unloaded: scsi_wait_scan]
Mar 7 23:05:48 xenserver1 kernel: [470487.905521] Pid: 15495, comm: dmsetup Tainted: G D 2.6.32-5-xen-amd64 #1 X7DWE
Mar 7 23:05:48 xenserver1 kernel: [470487.905521] RIP: e030:[<ffffffff8130cb18>] [<ffffffff8130cb18>] _spin_lock+0x15/0x1b
Mar 7 23:05:48 xenserver1 kernel: [470487.905521] RSP: e02b:ffff8803e3ae1b10 EFLAGS: 00000297
Mar 7 23:05:48 xenserver1 kernel: [470487.908017] RAX: 0000000000000023 RBX: ffff8803e3ae1b28 RCX: ffff8803e3ae1b68
Mar 7 23:05:48 xenserver1 kernel: [470487.908017] RDX: 0000000000000022 RSI: 0000000000000200 RDI: ffff8803e5306a80
Mar 7 23:05:48 xenserver1 kernel: [470487.908017] RBP: 0000000000000200 R08: 0000000000000008 R09: ffffffff814eb870
Mar 7 23:05:48 xenserver1 kernel: [470487.908017] R10: 000000000000000b R11: ffffffff811ba945 R12: ffff8803e5306a00
Mar 7 23:05:48 xenserver1 kernel: [470487.908017] R13: 000000000000c580 R14: ffff8803e3ae1b28 R15: ffffffff814eb830
Mar 7 23:05:48 xenserver1 kernel: [470487.908017] FS: 00007fdcdb8767a0(0000) GS:ffff880013d95000(0000) knlGS:0000000000000000
Mar 7 23:05:48 xenserver1 kernel: [470487.908017] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
Mar 7 23:05:48 xenserver1 kernel: [470487.908017] CR2: 00007fdcdb003420 CR3: 0000000001001000 CR4: 0000000000002660
Mar 7 23:05:48 xenserver1 kernel: [470487.908017] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Mar 7 23:05:48 xenserver1 kernel: [470487.908017] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Mar 7 23:05:48 xenserver1 kernel: [470487.908017] Call Trace:
Mar 7 23:05:48 xenserver1 kernel: [470487.908017] [<ffffffff8100dd87>] ? xen_exit_mmap+0xf8/0x136
Mar 7 23:05:48 xenserver1 kernel: [470487.908017] [<ffffffff8130cb3a>] ? _spin_unlock_irqrestore+0xd/0xe
Mar 7 23:05:48 xenserver1 kernel: [470487.908017] [<ffffffff8100922a>] ? hypercall_page+0x22a/0x1001
Mar 7 23:05:48 xenserver1 kernel: [470487.908017] [<ffffffff810d1208>] ? exit_mmap+0x5a/0x148
Mar 7 23:05:48 xenserver1 kernel: [470487.908017] [<ffffffff8100ecf2>] ? check_events+0x12/0x20
Mar 7 23:05:48 xenserver1 kernel: [470487.908017] [<ffffffff811ba945>] ? vgacon_cursor+0x0/0x140
Mar 7 23:05:48 xenserver1 kernel: [470487.908017] [<ffffffff8104cb09>] ? mmput+0x3c/0xdf
Mar 7 23:05:48 xenserver1 kernel: [470487.908017] [<ffffffff81050702>] ? exit_mm+0x102/0x10d
Mar 7 23:05:48 xenserver1 kernel: [470487.908017] [<ffffffff8100ec99>] ? xen_irq_enable_direct_end+0x0/0x7
Mar 7 23:05:48 xenserver1 kernel: [470487.908017] [<ffffffff81052127>] ? do_exit+0x1f8/0x6c6
Mar 7 23:05:48 xenserver1 kernel: [470487.909523] [<ffffffff8100ecdf>] ? xen_restore_fl_direct_end+0x0/0x1
Mar 7 23:05:48 xenserver1 kernel: [470487.909523] [<ffffffff8130cb3a>] ? _spin_unlock_irqrestore+0xd/0xe
Mar 7 23:05:48 xenserver1 kernel: [470487.909523] [<ffffffff8104f3af>] ? release_console_sem+0x17e/0x1af
Mar 7 23:05:48 xenserver1 kernel: [470487.909523] [<ffffffff8130d9dd>] ? oops_end+0xaf/0xb4
Mar 7 23:05:48 xenserver1 kernel: [470487.909523] [<ffffffff810135f0>] ? do_invalid_op+0x8b/0x95
Mar 7 23:05:48 xenserver1 kernel: [470487.909523] [<ffffffff8100c694>] ? pin_pagetable_pfn+0x2d/0x36
Mar 7 23:05:48 xenserver1 kernel: [470487.909523] [<ffffffffa01419ea>] ? copy_params+0x71/0xb1 [dm_mod]
Mar 7 23:05:48 xenserver1 kernel: [470487.909523] [<ffffffff810baf07>] ? __alloc_pages_nodemask+0x11c/0x5f5
Mar 7 23:05:48 xenserver1 kernel: [470487.909523] [<ffffffff8101293b>] ? invalid_op+0x1b/0x20
Mar 7 23:05:48 xenserver1 kernel: [470487.909523] [<ffffffff8100c694>] ? pin_pagetable_pfn+0x2d/0x36
Mar 7 23:05:48 xenserver1 kernel: [470487.909523] [<ffffffff8100c690>] ? pin_pagetable_pfn+0x29/0x36
Mar 7 23:05:48 xenserver1 kernel: [470487.909523] [<ffffffff810cd4e2>] ? __pte_alloc+0x6b/0xc6
Mar 7 23:05:48 xenserver1 kernel: [470487.909523] [<ffffffff810cb394>] ? pmd_alloc+0x28/0x5b
Mar 7 23:05:48 xenserver1 kernel: [470487.909523] [<ffffffff810cd60b>] ? handle_mm_fault+0xce/0x80f
Mar 7 23:05:48 xenserver1 kernel: [470487.909523] [<ffffffff810fbc5c>] ? do_vfs_ioctl+0x48d/0x4cb
Mar 7 23:05:48 xenserver1 kernel: [470487.909523] [<ffffffff8130f016>] ? do_page_fault+0x2e0/0x2fc
Mar 7 23:05:48 xenserver1 kernel: [470487.909523] [<ffffffff8130ceb5>] ? page_fault+0x25/0x30
Mar 7 23:06:54 xenserver1 kernel: [470553.396503] BUG: soft lockup - CPU#1 stuck for 61s! [dmsetup:15495]
Mar 7 23:06:54 xenserver1 kernel: [470553.396503] Modules linked in: ext4 jbd2 crc16 sha256_generic aes_x86_64 aes_generic cbc tun nf_conntrack_ipv4 nf_defrag_ipv4 xt_state nf_conntrack xt_physdev iptable_filter ip_tables x_tables xen_evtchn xenfs nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc bridge 8021q garp stp bonding dm_mirror dm_region_hash dm_log w83793 w83627hf hwmon_vid coretemp ipmi_si ipmi_msghandler loop dm_crypt i5400_edac snd_pcm edac_core snd_timer snd i5k_amb soundcore snd_page_alloc ioatdma psmouse i2c_i801 serio_raw container pcspkr dca processor i2c_core joydev evdev shpchp pci_hotplug button rng_core acpi_processor ext3 jbd mbcache dm_mod raid1 linear md_mod ses enclosure sg sr_mod cdrom sd_mod crc_t10dif ata_generic usbhid hid mptspi mptscsih ahci ata_piix uhci_hcd mptbase scsi_transport_spi e1000e libata ehci_hcd scsi_mod usbcore nls_base thermal thermal_sys [last unloaded: scsi_wait_scan]
Mar 7 23:06:54 xenserver1 kernel: [470553.400016] CPU 1:
Mar 7 23:06:54 xenserver1 kernel: [470553.400016] Modules linked in: ext4 jbd2 crc16 sha256_generic aes_x86_64 aes_generic cbc tun nf_conntrack_ipv4 nf_defrag_ipv4 xt_state nf_conntrack xt_physdev iptable_filter ip_tables x_tables xen_evtchn xenfs nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc bridge 8021q garp stp bonding dm_mirror dm_region_hash dm_log w83793 w83627hf hwmon_vid coretemp ipmi_si ipmi_msghandler loop dm_crypt i5400_edac snd_pcm edac_core snd_timer snd i5k_amb soundcore snd_page_alloc ioatdma psmouse i2c_i801 serio_raw container pcspkr dca processor i2c_core joydev evdev shpchp pci_hotplug button rng_core acpi_processor ext3 jbd mbcache dm_mod raid1 linear md_mod ses enclosure sg sr_mod cdrom sd_mod crc_t10dif ata_generic usbhid hid mptspi mptscsih ahci ata_piix uhci_hcd mptbase scsi_transport_spi e1000e libata ehci_hcd scsi_mod usbcore nls_base thermal thermal_sys [last unloaded: scsi_wait_scan]
Mar 7 23:06:54 xenserver1 kernel: [470553.401514] Pid: 15495, comm: dmsetup Tainted: G D 2.6.32-5-xen-amd64 #1 X7DWE
Mar 7 23:06:54 xenserver1 kernel: [470553.401514] RIP: e030:[<ffffffff8130cb18>] [<ffffffff8130cb18>] _spin_lock+0x15/0x1b
Mar 7 23:06:54 xenserver1 kernel: [470553.401514] RSP: e02b:ffff8803e3ae1b10 EFLAGS: 00000297
Mar 7 23:06:54 xenserver1 kernel: [470553.401514] RAX: 0000000000000023 RBX: ffff8803e3ae1b28 RCX: ffff8803e3ae1b68
Mar 7 23:06:54 xenserver1 kernel: [470553.404018] RDX: 0000000000000022 RSI: 0000000000000200 RDI: ffff8803e5306a80
Mar 7 23:06:54 xenserver1 kernel: [470553.404018] RBP: 0000000000000200 R08: 0000000000000008 R09: ffffffff814eb870
Mar 7 23:06:54 xenserver1 kernel: [470553.404018] R10: 000000000000000b R11: ffffffff811ba945 R12: ffff8803e5306a00
Mar 7 23:06:54 xenserver1 kernel: [470553.404018] R13: 000000000000c580 R14: ffff8803e3ae1b28 R15: ffffffff814eb830
Mar 7 23:06:54 xenserver1 kernel: [470553.404018] FS: 00007fdcdb8767a0(0000) GS:ffff880013d95000(0000) knlGS:0000000000000000
Mar 7 23:06:54 xenserver1 kernel: [470553.404018] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
Mar 7 23:06:54 xenserver1 kernel: [470553.404018] CR2: 00007fdcdb003420 CR3: 0000000001001000 CR4: 0000000000002660
Mar 7 23:06:54 xenserver1 kernel: [470553.404018] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Mar 7 23:06:54 xenserver1 kernel: [470553.404018] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Mar 7 23:06:54 xenserver1 kernel: [470553.404018] Call Trace:
Mar 7 23:06:54 xenserver1 kernel: [470553.404018] [<ffffffff8100dd87>] ? xen_exit_mmap+0xf8/0x136
Mar 7 23:06:54 xenserver1 kernel: [470553.404018] [<ffffffff8130cb3a>] ? _spin_unlock_irqrestore+0xd/0xe
Mar 7 23:06:54 xenserver1 kernel: [470553.404018] [<ffffffff8100922a>] ? hypercall_page+0x22a/0x1001
Mar 7 23:06:54 xenserver1 kernel: [470553.404018] [<ffffffff810d1208>] ? exit_mmap+0x5a/0x148
Mar 7 23:06:54 xenserver1 kernel: [470553.404018] [<ffffffff8100ecf2>] ? check_events+0x12/0x20
Mar 7 23:06:54 xenserver1 kernel: [470553.404018] [<ffffffff811ba945>] ? vgacon_cursor+0x0/0x140
Mar 7 23:06:54 xenserver1 kernel: [470553.404018] [<ffffffff8104cb09>] ? mmput+0x3c/0xdf
Mar 7 23:06:54 xenserver1 kernel: [470553.404018] [<ffffffff81050702>] ? exit_mm+0x102/0x10d
Mar 7 23:06:54 xenserver1 kernel: [470553.404018] [<ffffffff8100ec99>] ? xen_irq_enable_direct_end+0x0/0x7
Mar 7 23:06:54 xenserver1 kernel: [470553.404018] [<ffffffff81052127>] ? do_exit+0x1f8/0x6c6
Mar 7 23:06:54 xenserver1 kernel: [470553.404018] [<ffffffff8100ecdf>] ? xen_restore_fl_direct_end+0x0/0x1
Mar 7 23:06:54 xenserver1 kernel: [470553.405515] [<ffffffff8130cb3a>] ? _spin_unlock_irqrestore+0xd/0xe
Mar 7 23:06:54 xenserver1 kernel: [470553.405515] [<ffffffff8104f3af>] ? release_console_sem+0x17e/0x1af
Mar 7 23:06:54 xenserver1 kernel: [470553.405515] [<ffffffff8130d9dd>] ? oops_end+0xaf/0xb4
Mar 7 23:06:54 xenserver1 kernel: [470553.409515] [<ffffffff810135f0>] ? do_invalid_op+0x8b/0x95
Mar 7 23:06:54 xenserver1 kernel: [470553.409515] [<ffffffff8100c694>] ? pin_pagetable_pfn+0x2d/0x36
Mar 7 23:06:54 xenserver1 kernel: [470553.409515] [<ffffffffa01419ea>] ? copy_params+0x71/0xb1 [dm_mod]
Mar 7 23:06:54 xenserver1 kernel: [470553.409515] [<ffffffff810baf07>] ? __alloc_pages_nodemask+0x11c/0x5f5
Mar 7 23:06:54 xenserver1 kernel: [470553.409515] [<ffffffff8101293b>] ? invalid_op+0x1b/0x20
Mar 7 23:06:54 xenserver1 kernel: [470553.409515] [<ffffffff8100c694>] ? pin_pagetable_pfn+0x2d/0x36
Mar 7 23:06:54 xenserver1 kernel: [470553.409515] [<ffffffff8100c690>] ? pin_pagetable_pfn+0x29/0x36
Mar 7 23:06:54 xenserver1 kernel: [470553.409515] [<ffffffff810cd4e2>] ? __pte_alloc+0x6b/0xc6
Mar 7 23:06:54 xenserver1 kernel: [470553.409515] [<ffffffff810cb394>] ? pmd_alloc+0x28/0x5b
Mar 7 23:06:54 xenserver1 kernel: [470553.409515] [<ffffffff810cd60b>] ? handle_mm_fault+0xce/0x80f
Mar 7 23:06:54 xenserver1 kernel: [470553.409515] [<ffffffff810fbc5c>] ? do_vfs_ioctl+0x48d/0x4cb
Mar 7 23:06:54 xenserver1 kernel: [470553.409515] [<ffffffff8130f016>] ? do_page_fault+0x2e0/0x2fc
Mar 7 23:06:54 xenserver1 kernel: [470553.409515] [<ffffffff8130ceb5>] ? page_fault+0x25/0x30
Mar 7 23:07:59 xenserver1 kernel: [470618.896503] BUG: soft lockup - CPU#1 stuck for 61s! [dmsetup:15495]
Mar 7 23:07:59 xenserver1 kernel: [470618.896503] Modules linked in: ext4 jbd2 crc16 sha256_generic aes_x86_64 aes_generic cbc tun nf_conntrack_ipv4 nf_defrag_ipv4 xt_state nf_conntrack xt_physdev iptable_filter ip_tables x_tables xen_evtchn xenfs nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc bridge 8021q garp stp bonding dm_mirror dm_region_hash dm_log w83793 w83627hf hwmon_vid coretemp ipmi_si ipmi_msghandler loop dm_crypt i5400_edac snd_pcm edac_core snd_timer snd i5k_amb soundcore snd_page_alloc ioatdma psmouse i2c_i801 serio_raw container pcspkr dca processor i2c_core joydev evdev shpchp pci_hotplug button rng_core acpi_processor ext3 jbd mbcache dm_mod raid1 linear md_mod ses enclosure sg sr_mod cdrom sd_mod crc_t10dif ata_generic usbhid hid mptspi mptscsih ahci ata_piix uhci_hcd mptbase scsi_transport_spi e1000e libata ehci_hcd scsi_mod usbcore nls_base thermal thermal_sys [last unloaded: scsi_wait_scan]
Mar 7 23:07:59 xenserver1 kernel: [470618.900017] CPU 1:
Mar 7 23:07:59 xenserver1 kernel: [470618.900017] Modules linked in: ext4 jbd2 crc16 sha256_generic aes_x86_64 aes_generic cbc tun nf_conntrack_ipv4 nf_defrag_ipv4 xt_state nf_conntrack xt_physdev iptable_filter ip_tables x_tables xen_evtchn xenfs nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc bridge 8021q garp stp bonding dm_mirror dm_region_hash dm_log w83793 w83627hf hwmon_vid coretemp ipmi_si ipmi_msghandler loop dm_crypt i5400_edac snd_pcm edac_core snd_timer snd i5k_amb soundcore snd_page_alloc ioatdma psmouse i2c_i801 serio_raw container pcspkr dca processor i2c_core joydev evdev shpchp pci_hotplug button rng_core acpi_processor ext3 jbd mbcache dm_mod raid1 linear md_mod ses enclosure sg sr_mod cdrom sd_mod crc_t10dif ata_generic usbhid hid mptspi mptscsih ahci ata_piix uhci_hcd mptbase scsi_transport_spi e1000e libata ehci_hcd scsi_mod usbcore nls_base thermal thermal_sys [last unloaded: scsi_wait_scan]
Mar 7 23:07:59 xenserver1 kernel: [470618.901613] Pid: 15495, comm: dmsetup Tainted: G D 2.6.32-5-xen-amd64 #1 X7DWE
Mar 7 23:07:59 xenserver1 kernel: [470618.901613] RIP: e030:[<ffffffff8130cb1b>] [<ffffffff8130cb1b>] _spin_lock+0x18/0x1b
Mar 7 23:07:59 xenserver1 kernel: [470618.901613] RSP: e02b:ffff8803e3ae1b10 EFLAGS: 00000297
Mar 7 23:07:59 xenserver1 kernel: [470618.901613] RAX: 0000000000000023 RBX: ffff8803e3ae1b28 RCX: ffff8803e3ae1b68
Mar 7 23:07:59 xenserver1 kernel: [470618.904017] RDX: 0000000000000022 RSI: 0000000000000200 RDI: ffff8803e5306a80
Mar 7 23:07:59 xenserver1 kernel: [470618.904017] RBP: 0000000000000200 R08: 0000000000000008 R09: ffffffff814eb870
Mar 7 23:07:59 xenserver1 kernel: [470618.904017] R10: 000000000000000b R11: ffffffff811ba945 R12: ffff8803e5306a00
Mar 7 23:07:59 xenserver1 kernel: [470618.904017] R13: 000000000000c580 R14: ffff8803e3ae1b28 R15: ffffffff814eb830
Mar 7 23:07:59 xenserver1 kernel: [470618.904017] FS: 00007fdcdb8767a0(0000) GS:ffff880013d95000(0000) knlGS:0000000000000000
Mar 7 23:07:59 xenserver1 kernel: [470618.904017] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
Mar 7 23:07:59 xenserver1 kernel: [470618.904017] CR2: 00007fdcdb003420 CR3: 0000000001001000 CR4: 0000000000002660
Mar 7 23:07:59 xenserver1 kernel: [470618.904596] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Mar 7 23:07:59 xenserver1 kernel: [470618.904596] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Mar 7 23:07:59 xenserver1 kernel: [470618.904596] Call Trace:
Mar 7 23:07:59 xenserver1 kernel: [470618.904596] [<ffffffff8100dd87>] ? xen_exit_mmap+0xf8/0x136
Mar 7 23:07:59 xenserver1 kernel: [470618.904596] [<ffffffff8130cb3a>] ? _spin_unlock_irqrestore+0xd/0xe
Mar 7 23:07:59 xenserver1 kernel: [470618.904596] [<ffffffff8100922a>] ? hypercall_page+0x22a/0x1001
Mar 7 23:07:59 xenserver1 kernel: [470618.904596] [<ffffffff810d1208>] ? exit_mmap+0x5a/0x148
Mar 7 23:07:59 xenserver1 kernel: [470618.904596] [<ffffffff8100ecf2>] ? check_events+0x12/0x20
Mar 7 23:07:59 xenserver1 kernel: [470618.904596] [<ffffffff811ba945>] ? vgacon_cursor+0x0/0x140
Mar 7 23:07:59 xenserver1 kernel: [470618.904596] [<ffffffff8104cb09>] ? mmput+0x3c/0xdf
Mar 7 23:07:59 xenserver1 kernel: [470618.904596] [<ffffffff81050702>] ? exit_mm+0x102/0x10d
Mar 7 23:07:59 xenserver1 kernel: [470618.904596] [<ffffffff8100ec99>] ? xen_irq_enable_direct_end+0x0/0x7
Mar 7 23:07:59 xenserver1 kernel: [470618.904596] [<ffffffff81052127>] ? do_exit+0x1f8/0x6c6
Mar 7 23:07:59 xenserver1 kernel: [470618.904596] [<ffffffff8100ecdf>] ? xen_restore_fl_direct_end+0x0/0x1
Mar 7 23:07:59 xenserver1 kernel: [470618.905521] [<ffffffff8130cb3a>] ? _spin_unlock_irqrestore+0xd/0xe
Mar 7 23:07:59 xenserver1 kernel: [470618.905521] [<ffffffff8104f3af>] ? release_console_sem+0x17e/0x1af
Mar 7 23:07:59 xenserver1 kernel: [470618.905521] [<ffffffff8130d9dd>] ? oops_end+0xaf/0xb4
Mar 7 23:07:59 xenserver1 kernel: [470618.905521] [<ffffffff810135f0>] ? do_invalid_op+0x8b/0x95
Mar 7 23:07:59 xenserver1 kernel: [470618.905521] [<ffffffff8100c694>] ? pin_pagetable_pfn+0x2d/0x36
Mar 7 23:07:59 xenserver1 kernel: [470618.905521] [<ffffffffa01419ea>] ? copy_params+0x71/0xb1 [dm_mod]
Mar 7 23:07:59 xenserver1 kernel: [470618.905521] [<ffffffff810baf07>] ? __alloc_pages_nodemask+0x11c/0x5f5
Mar 7 23:07:59 xenserver1 kernel: [470618.905521] [<ffffffff8101293b>] ? invalid_op+0x1b/0x20
Mar 7 23:07:59 xenserver1 kernel: [470618.905521] [<ffffffff8100c694>] ? pin_pagetable_pfn+0x2d/0x36
Mar 7 23:07:59 xenserver1 kernel: [470618.905521] [<ffffffff8100c690>] ? pin_pagetable_pfn+0x29/0x36
Mar 7 23:07:59 xenserver1 kernel: [470618.905521] [<ffffffff810cd4e2>] ? __pte_alloc+0x6b/0xc6
Mar 7 23:07:59 xenserver1 kernel: [470618.905521] [<ffffffff810cb394>] ? pmd_alloc+0x28/0x5b
Mar 7 23:07:59 xenserver1 kernel: [470618.905521] [<ffffffff810cd60b>] ? handle_mm_fault+0xce/0x80f
Mar 7 23:07:59 xenserver1 kernel: [470618.905521] [<ffffffff810fbc5c>] ? do_vfs_ioctl+0x48d/0x4cb
Mar 7 23:07:59 xenserver1 kernel: [470618.905521] [<ffffffff8130f016>] ? do_page_fault+0x2e0/0x2fc
Mar 7 23:07:59 xenserver1 kernel: [470618.905521] [<ffffffff8130ceb5>] ? page_fault+0x25/0x30
Mar 7 23:09:05 xenserver1 kernel: [470684.392503] BUG: soft lockup - CPU#1 stuck for 61s! [dmsetup:15495]
Mar 7 23:09:05 xenserver1 kernel: [470684.392503] Modules linked in: ext4 jbd2 crc16 sha256_generic aes_x86_64 aes_generic cbc tun nf_conntrack_ipv4 nf_defrag_ipv4 xt_state nf_conntrack xt_physdev iptable_filter ip_tables x_tables xen_evtchn xenfs nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc bridge 8021q garp stp bonding dm_mirror dm_region_hash dm_log w83793 w83627hf hwmon_vid coretemp ipmi_si ipmi_msghandler loop dm_crypt i5400_edac snd_pcm edac_core snd_timer snd i5k_amb soundcore snd_page_alloc ioatdma psmouse i2c_i801 serio_raw container pcspkr dca processor i2c_core joydev evdev shpchp pci_hotplug button rng_core acpi_processor ext3 jbd mbcache dm_mod raid1 linear md_mod ses enclosure sg sr_mod cdrom sd_mod crc_t10dif ata_generic usbhid hid mptspi mptscsih ahci ata_piix uhci_hcd mptbase scsi_transport_spi e1000e libata ehci_hcd scsi_mod usbcore nls_base thermal thermal_sys [last unloaded: scsi_wait_scan]
Mar 7 23:09:05 xenserver1 kernel: [470684.396018] CPU 1:
Mar 7 23:09:05 xenserver1 kernel: [470684.396018] Modules linked in: ext4 jbd2 crc16 sha256_generic aes_x86_64 aes_generic cbc tun nf_conntrack_ipv4 nf_defrag_ipv4 xt_state nf_conntrack xt_physdev iptable_filter ip_tables x_tables xen_evtchn xenfs nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc bridge 8021q garp stp bonding dm_mirror dm_region_hash dm_log w83793 w83627hf hwmon_vid coretemp ipmi_si ipmi_msghandler loop dm_crypt i5400_edac snd_pcm edac_core snd_timer snd i5k_amb soundcore snd_page_alloc ioatdma psmouse i2c_i801 serio_raw container pcspkr dca processor i2c_core joydev evdev shpchp pci_hotplug button rng_core acpi_processor ext3 jbd mbcache dm_mod raid1 linear md_mod ses enclosure sg sr_mod cdrom sd_mod crc_t10dif ata_generic usbhid hid mptspi mptscsih ahci ata_piix uhci_hcd mptbase scsi_transport_spi e1000e libata ehci_hcd scsi_mod usbcore nls_base thermal thermal_sys [last unloaded: scsi_wait_scan]
Mar 7 23:09:05 xenserver1 kernel: [470684.397522] Pid: 15495, comm: dmsetup Tainted: G D 2.6.32-5-xen-amd64 #1 X7DWE
Mar 7 23:09:05 xenserver1 kernel: [470684.397522] RIP: e030:[<ffffffff8130cb18>] [<ffffffff8130cb18>] _spin_lock+0x15/0x1b
Mar 7 23:09:05 xenserver1 kernel: [470684.397522] RSP: e02b:ffff8803e3ae1b10 EFLAGS: 00000297
Mar 7 23:09:05 xenserver1 kernel: [470684.397522] RAX: 0000000000000023 RBX: ffff8803e3ae1b28 RCX: ffff8803e3ae1b68
Mar 7 23:09:05 xenserver1 kernel: [470684.400021] RDX: 0000000000000022 RSI: 0000000000000200 RDI: ffff8803e5306a80
Mar 7 23:09:05 xenserver1 kernel: [470684.400021] RBP: 0000000000000200 R08: 0000000000000008 R09: ffffffff814eb870
Mar 7 23:09:05 xenserver1 kernel: [470684.400021] R10: 000000000000000b R11: ffffffff811ba945 R12: ffff8803e5306a00
Mar 7 23:09:05 xenserver1 kernel: [470684.400021] R13: 000000000000c580 R14: ffff8803e3ae1b28 R15: ffffffff814eb830
Mar 7 23:09:05 xenserver1 kernel: [470684.400021] FS: 00007fdcdb8767a0(0000) GS:ffff880013d95000(0000) knlGS:0000000000000000
Mar 7 23:09:05 xenserver1 kernel: [470684.400021] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
Mar 7 23:09:05 xenserver1 kernel: [470684.400021] CR2: 00007fdcdb003420 CR3: 0000000001001000 CR4: 0000000000002660
Mar 7 23:09:05 xenserver1 kernel: [470684.400021] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Mar 7 23:09:05 xenserver1 kernel: [470684.400021] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Mar 7 23:09:05 xenserver1 kernel: [470684.400021] Call Trace:
Mar 7 23:09:05 xenserver1 kernel: [470684.400021] [<ffffffff8100dd87>] ? xen_exit_mmap+0xf8/0x136
Mar 7 23:09:05 xenserver1 kernel: [470684.400021] [<ffffffff8130cb3a>] ? _spin_unlock_irqrestore+0xd/0xe
Mar 7 23:09:05 xenserver1 kernel: [470684.400021] [<ffffffff8100922a>] ? hypercall_page+0x22a/0x1001
Mar 7 23:09:05 xenserver1 kernel: [470684.400021] [<ffffffff810d1208>] ? exit_mmap+0x5a/0x148
Mar 7 23:09:05 xenserver1 kernel: [470684.400021] [<ffffffff8100ecf2>] ? check_events+0x12/0x20
Mar 7 23:09:05 xenserver1 kernel: [470684.400021] [<ffffffff811ba945>] ? vgacon_cursor+0x0/0x140
Mar 7 23:09:05 xenserver1 kernel: [470684.400021] [<ffffffff8104cb09>] ? mmput+0x3c/0xdf
Mar 7 23:09:05 xenserver1 kernel: [470684.400021] [<ffffffff81050702>] ? exit_mm+0x102/0x10d
Mar 7 23:09:05 xenserver1 kernel: [470684.400021] [<ffffffff8100ec99>] ? xen_irq_enable_direct_end+0x0/0x7
Mar 7 23:09:05 xenserver1 kernel: [470684.400021] [<ffffffff81052127>] ? do_exit+0x1f8/0x6c6
Mar 7 23:09:05 xenserver1 kernel: [470684.400021] [<ffffffff8100ecdf>] ? xen_restore_fl_direct_end+0x0/0x1
Mar 7 23:09:05 xenserver1 kernel: [470684.401521] [<ffffffff8130cb3a>] ? _spin_unlock_irqrestore+0xd/0xe
Mar 7 23:09:05 xenserver1 kernel: [470684.401521] [<ffffffff8104f3af>] ? release_console_sem+0x17e/0x1af
Mar 7 23:09:05 xenserver1 kernel: [470684.401521] [<ffffffff8130d9dd>] ? oops_end+0xaf/0xb4
Mar 7 23:09:05 xenserver1 kernel: [470684.401521] [<ffffffff810135f0>] ? do_invalid_op+0x8b/0x95
Mar 7 23:09:05 xenserver1 kernel: [470684.401521] [<ffffffff8100c694>] ? pin_pagetable_pfn+0x2d/0x36
Mar 7 23:09:05 xenserver1 kernel: [470684.401521] [<ffffffffa01419ea>] ? copy_params+0x71/0xb1 [dm_mod]
Mar 7 23:09:05 xenserver1 kernel: [470684.401521] [<ffffffff810baf07>] ? __alloc_pages_nodemask+0x11c/0x5f5
Mar 7 23:09:05 xenserver1 kernel: [470684.401521] [<ffffffff8101293b>] ? invalid_op+0x1b/0x20
Mar 7 23:09:05 xenserver1 kernel: [470684.401521] [<ffffffff8100c694>] ? pin_pagetable_pfn+0x2d/0x36
Mar 7 23:09:05 xenserver1 kernel: [470684.401521] [<ffffffff8100c690>] ? pin_pagetable_pfn+0x29/0x36
Mar 7 23:09:05 xenserver1 kernel: [470684.401521] [<ffffffff810cd4e2>] ? __pte_alloc+0x6b/0xc6
Mar 7 23:09:05 xenserver1 kernel: [470684.401521] [<ffffffff810cb394>] ? pmd_alloc+0x28/0x5b
Mar 7 23:09:05 xenserver1 kernel: [470684.401521] [<ffffffff810cd60b>] ? handle_mm_fault+0xce/0x80f
Mar 7 23:09:05 xenserver1 kernel: [470684.401521] [<ffffffff810fbc5c>] ? do_vfs_ioctl+0x48d/0x4cb
Mar 7 23:09:05 xenserver1 kernel: [470684.402478] [<ffffffff8130f016>] ? do_page_fault+0x2e0/0x2fc
Mar 7 23:09:05 xenserver1 kernel: [470684.402539] [<ffffffff8130ceb5>] ? page_fault+0x25/0x30
Mar 7 23:10:10 xenserver1 kernel: [470749.892503] BUG: soft lockup - CPU#1 stuck for 61s! [dmsetup:15495]
Mar 7 23:10:10 xenserver1 kernel: [470749.892503] Modules linked in: ext4 jbd2 crc16 sha256_generic aes_x86_64 aes_generic cbc tun nf_conntrack_ipv4 nf_defrag_ipv4 xt_state nf_conntrack xt_physdev iptable_filter ip_tables x_tables xen_evtchn xenfs nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc bridge 8021q garp stp bonding dm_mirror dm_region_hash dm_log w83793 w83627hf hwmon_vid coretemp ipmi_si ipmi_msghandler loop dm_crypt i5400_edac snd_pcm edac_core snd_timer snd i5k_amb soundcore snd_page_alloc ioatdma psmouse i2c_i801 serio_raw container pcspkr dca processor i2c_core joydev evdev shpchp pci_hotplug button rng_core acpi_processor ext3 jbd mbcache dm_mod raid1 linear md_mod ses enclosure sg sr_mod cdrom sd_mod crc_t10dif ata_generic usbhid hid mptspi mptscsih ahci ata_piix uhci_hcd mptbase scsi_transport_spi e1000e libata ehci_hcd scsi_mod usbcore nls_base thermal thermal_sys [last unloaded: scsi_wait_scan]
Mar 7 23:10:10 xenserver1 kernel: [470749.900017] CPU 1:
Mar 7 23:10:10 xenserver1 kernel: [470749.900017] Modules linked in: ext4 jbd2 crc16 sha256_generic aes_x86_64 aes_generic cbc tun nf_conntrack_ipv4 nf_defrag_ipv4 xt_state nf_conntrack xt_physdev iptable_filter ip_tables x_tables xen_evtchn xenfs nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc bridge 8021q garp stp bonding dm_mirror dm_region_hash dm_log w83793 w83627hf hwmon_vid coretemp ipmi_si ipmi_msghandler loop dm_crypt i5400_edac snd_pcm edac_core snd_timer snd i5k_amb soundcore snd_page_alloc ioatdma psmouse i2c_i801 serio_raw container pcspkr dca processor i2c_core joydev evdev shpchp pci_hotplug button rng_core acpi_processor ext3 jbd mbcache dm_mod raid1 linear md_mod ses enclosure sg sr_mod cdrom sd_mod crc_t10dif ata_generic usbhid hid mptspi mptscsih ahci ata_piix uhci_hcd mptbase scsi_transport_spi e1000e libata ehci_hcd scsi_mod usbcore nls_base thermal thermal_sys [last unloaded: scsi_wait_scan]
Mar 7 23:10:10 xenserver1 kernel: [470749.904019] Pid: 15495, comm: dmsetup Tainted: G D 2.6.32-5-xen-amd64 #1 X7DWE
Mar 7 23:10:10 xenserver1 kernel: [470749.904019] RIP: e030:[<ffffffff8130cb1b>] [<ffffffff8130cb1b>] _spin_lock+0x18/0x1b
Mar 7 23:10:10 xenserver1 kernel: [470749.904019] RSP: e02b:ffff8803e3ae1b10 EFLAGS: 00000297
Mar 7 23:10:10 xenserver1 kernel: [470749.904019] RAX: 0000000000000023 RBX: ffff8803e3ae1b28 RCX: ffff8803e3ae1b68
Mar 7 23:10:10 xenserver1 kernel: [470749.904019] RDX: 0000000000000022 RSI: 0000000000000200 RDI: ffff8803e5306a80
Mar 7 23:10:10 xenserver1 kernel: [470749.904019] RBP: 0000000000000200 R08: 0000000000000008 R09: ffffffff814eb870
Mar 7 23:10:10 xenserver1 kernel: [470749.904019] R10: 000000000000000b R11: ffffffff811ba945 R12: ffff8803e5306a00
Mar 7 23:10:10 xenserver1 kernel: [470749.904019] R13: 000000000000c580 R14: ffff8803e3ae1b28 R15: ffffffff814eb830
Mar 7 23:10:10 xenserver1 kernel: [470749.904019] FS: 00007fdcdb8767a0(0000) GS:ffff880013d95000(0000) knlGS:0000000000000000
Mar 7 23:10:10 xenserver1 kernel: [470749.904019] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
Mar 7 23:10:10 xenserver1 kernel: [470749.904019] CR2: 00007fdcdb003420 CR3: 0000000001001000 CR4: 0000000000002660
Mar 7 23:10:10 xenserver1 kernel: [470749.904019] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Mar 7 23:10:10 xenserver1 kernel: [470749.904019] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Mar 7 23:10:10 xenserver1 kernel: [470749.904019] Call Trace:
Mar 7 23:10:10 xenserver1 kernel: [470749.904019] [<ffffffff8100dd87>] ? xen_exit_mmap+0xf8/0x136
Mar 7 23:10:10 xenserver1 kernel: [470749.904019] [<ffffffff8130cb3a>] ? _spin_unlock_irqrestore+0xd/0xe
Mar 7 23:10:10 xenserver1 kernel: [470749.904019] [<ffffffff8100922a>] ? hypercall_page+0x22a/0x1001
Mar 7 23:10:10 xenserver1 kernel: [470749.904019] [<ffffffff810d1208>] ? exit_mmap+0x5a/0x148
Mar 7 23:10:10 xenserver1 kernel: [470749.904019] [<ffffffff8100ecf2>] ? check_events+0x12/0x20
Mar 7 23:10:10 xenserver1 kernel: [470749.904019] [<ffffffff811ba945>] ? vgacon_cursor+0x0/0x140
Mar 7 23:10:10 xenserver1 kernel: [470749.905522] [<ffffffff8104cb09>] ? mmput+0x3c/0xdf
Mar 7 23:10:10 xenserver1 kernel: [470749.905522] [<ffffffff81050702>] ? exit_mm+0x102/0x10d
Mar 7 23:10:10 xenserver1 kernel: [470749.905522] [<ffffffff8100ec99>] ? xen_irq_enable_direct_end+0x0/0x7
Mar 7 23:10:10 xenserver1 kernel: [470749.905522] [<ffffffff81052127>] ? do_exit+0x1f8/0x6c6
Mar 7 23:10:10 xenserver1 kernel: [470749.905522] [<ffffffff8100ecdf>] ? xen_restore_fl_direct_end+0x0/0x1
Mar 7 23:10:10 xenserver1 kernel: [470749.905522] [<ffffffff8130cb3a>] ? _spin_unlock_irqrestore+0xd/0xe
Mar 7 23:10:10 xenserver1 kernel: [470749.905522] [<ffffffff8104f3af>] ? release_console_sem+0x17e/0x1af
Mar 7 23:10:10 xenserver1 kernel: [470749.905522] [<ffffffff8130d9dd>] ? oops_end+0xaf/0xb4
Mar 7 23:10:10 xenserver1 kernel: [470749.905522] [<ffffffff810135f0>] ? do_invalid_op+0x8b/0x95
Mar 7 23:10:10 xenserver1 kernel: [470749.905522] [<ffffffff8100c694>] ? pin_pagetable_pfn+0x2d/0x36
Mar 7 23:10:10 xenserver1 kernel: [470749.905522] [<ffffffffa01419ea>] ? copy_params+0x71/0xb1 [dm_mod]
Mar 7 23:10:10 xenserver1 kernel: [470749.905522] [<ffffffff810baf07>] ? __alloc_pages_nodemask+0x11c/0x5f5
Mar 7 23:10:10 xenserver1 kernel: [470749.905522] [<ffffffff8101293b>] ? invalid_op+0x1b/0x20
Mar 7 23:10:10 xenserver1 kernel: [470749.905522] [<ffffffff8100c694>] ? pin_pagetable_pfn+0x2d/0x36
Mar 7 23:10:10 xenserver1 kernel: [470749.905522] [<ffffffff8100c690>] ? pin_pagetable_pfn+0x29/0x36
Mar 7 23:10:10 xenserver1 kernel: [470749.905522] [<ffffffff810cd4e2>] ? __pte_alloc+0x6b/0xc6
Mar 7 23:10:10 xenserver1 kernel: [470749.905522] [<ffffffff810cb394>] ? pmd_alloc+0x28/0x5b
Mar 7 23:10:10 xenserver1 kernel: [470749.905522] [<ffffffff810cd60b>] ? handle_mm_fault+0xce/0x80f
Mar 7 23:10:10 xenserver1 kernel: [470749.905522] [<ffffffff810fbc5c>] ? do_vfs_ioctl+0x48d/0x4cb
Mar 7 23:10:10 xenserver1 kernel: [470749.905522] [<ffffffff8130f016>] ? do_page_fault+0x2e0/0x2fc
Mar 7 23:10:10 xenserver1 kernel: [470749.905522] [<ffffffff8130ceb5>] ? page_fault+0x25/0x30
Mar 7 23:11:16 xenserver1 kernel: [470815.392504] BUG: soft lockup - CPU#1 stuck for 61s! [dmsetup:15495]
Mar 7 23:11:16 xenserver1 kernel: [470815.392504] Modules linked in: ext4 jbd2 crc16 sha256_generic aes_x86_64 aes_generic cbc tun nf_conntrack_ipv4 nf_defrag_ipv4 xt_state nf_conntrack xt_physdev iptable_filter ip_tables x_tables xen_evtchn xenfs nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc bridge 8021q garp stp bonding dm_mirror dm_region_hash dm_log w83793 w83627hf hwmon_vid coretemp ipmi_si ipmi_msghandler loop dm_crypt i5400_edac snd_pcm edac_core snd_timer snd i5k_amb soundcore snd_page_alloc ioatdma psmouse i2c_i801 serio_raw container pcspkr dca processor i2c_core joydev evdev shpchp pci_hotplug button rng_core acpi_processor ext3 jbd mbcache dm_mod raid1 linear md_mod ses enclosure sg sr_mod cdrom sd_mod crc_t10dif ata_generic usbhid hid mptspi mptscsih ahci ata_piix uhci_hcd mptbase scsi_transport_spi e1000e libata ehci_hcd scsi_mod usbcore nls_base thermal thermal_sys [last unloaded: scsi_wait_scan]
Mar 7 23:11:16 xenserver1 kernel: [470815.396042] CPU 1:
Mar 7 23:11:16 xenserver1 kernel: [470815.396042] Modules linked in: ext4 jbd2 crc16 sha256_generic aes_x86_64 aes_generic cbc tun nf_conntrack_ipv4 nf_defrag_ipv4 xt_state nf_conntrack xt_physdev iptable_filter ip_tables x_tables xen_evtchn xenfs nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc bridge 8021q garp stp bonding dm_mirror dm_region_hash dm_log w83793 w83627hf hwmon_vid coretemp ipmi_si ipmi_msghandler loop dm_crypt i5400_edac snd_pcm edac_core snd_timer snd i5k_amb soundcore snd_page_alloc ioatdma psmouse i2c_i801 serio_raw container pcspkr dca processor i2c_core joydev evdev shpchp pci_hotplug button rng_core acpi_processor ext3 jbd mbcache dm_mod raid1 linear md_mod ses enclosure sg sr_mod cdrom sd_mod crc_t10dif ata_generic usbhid hid mptspi mptscsih ahci ata_piix uhci_hcd mptbase scsi_transport_spi e1000e libata ehci_hcd scsi_mod usbcore nls_base thermal thermal_sys [last unloaded: scsi_wait_scan]
Mar 7 23:11:16 xenserver1 kernel: [470815.397527] Pid: 15495, comm: dmsetup Tainted: G D 2.6.32-5-xen-amd64 #1 X7DWE
Mar 7 23:11:16 xenserver1 kernel: [470815.397527] RIP: e030:[<ffffffff8130cb1b>] [<ffffffff8130cb1b>] _spin_lock+0x18/0x1b
Mar 7 23:11:16 xenserver1 kernel: [470815.400019] RSP: e02b:ffff8803e3ae1b10 EFLAGS: 00000297
Mar 7 23:11:16 xenserver1 kernel: [470815.400019] RAX: 0000000000000023 RBX: ffff8803e3ae1b28 RCX: ffff8803e3ae1b68
Mar 7 23:11:16 xenserver1 kernel: [470815.400019] RDX: 0000000000000022 RSI: 0000000000000200 RDI: ffff8803e5306a80
Mar 7 23:11:16 xenserver1 kernel: [470815.400019] RBP: 0000000000000200 R08: 0000000000000008 R09: ffffffff814eb870
Mar 7 23:11:16 xenserver1 kernel: [470815.400019] R10: 000000000000000b R11: ffffffff811ba945 R12: ffff8803e5306a00
Mar 7 23:11:16 xenserver1 kernel: [470815.400019] R13: 000000000000c580 R14: ffff8803e3ae1b28 R15: ffffffff814eb830
Mar 7 23:11:16 xenserver1 kernel: [470815.400019] FS: 00007fdcdb8767a0(0000) GS:ffff880013d95000(0000) knlGS:0000000000000000
Mar 7 23:11:16 xenserver1 kernel: [470815.400019] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b
Mar 7 23:11:16 xenserver1 kernel: [470815.400019] CR2: 00007fdcdb003420 CR3: 0000000001001000 CR4: 0000000000002660
Mar 7 23:11:16 xenserver1 kernel: [470815.400019] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Mar 7 23:11:16 xenserver1 kernel: [470815.400019] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Mar 7 23:11:16 xenserver1 kernel: [470815.400019] Call Trace:
Mar 7 23:11:16 xenserver1 kernel: [470815.400019] [<ffffffff8100dd87>] ? xen_exit_mmap+0xf8/0x136
Mar 7 23:11:16 xenserver1 kernel: [470815.400019] [<ffffffff8130cb3a>] ? _spin_unlock_irqrestore+0xd/0xe
Mar 7 23:11:16 xenserver1 kernel: [470815.400019] [<ffffffff8100922a>] ? hypercall_page+0x22a/0x1001
Mar 7 23:11:16 xenserver1 kernel: [470815.400019] [<ffffffff810d1208>] ? exit_mmap+0x5a/0x148
Mar 7 23:11:16 xenserver1 kernel: [470815.400019] [<ffffffff8100ecf2>] ? check_events+0x12/0x20
Mar 7 23:11:16 xenserver1 kernel: [470815.400019] [<ffffffff811ba945>] ? vgacon_cursor+0x0/0x140
Mar 7 23:11:16 xenserver1 kernel: [470815.400019] [<ffffffff8104cb09>] ? mmput+0x3c/0xdf
Mar 7 23:11:16 xenserver1 kernel: [470815.400019] [<ffffffff81050702>] ? exit_mm+0x102/0x10d
Mar 7 23:11:16 xenserver1 kernel: [470815.400019] [<ffffffff8100ec99>] ? xen_irq_enable_direct_end+0x0/0x7
Mar 7 23:11:16 xenserver1 kernel: [470815.401523] [<ffffffff81052127>] ? do_exit+0x1f8/0x6c6
Mar 7 23:11:16 xenserver1 kernel: [470815.401523] [<ffffffff8100ecdf>] ? xen_restore_fl_direct_end+0x0/0x1
Mar 7 23:11:16 xenserver1 kernel: [470815.401523] [<ffffffff8130cb3a>] ? _spin_unlock_irqrestore+0xd/0xe
Mar 7 23:11:16 xenserver1 kernel: [470815.401523] [<ffffffff8104f3af>] ? release_console_sem+0x17e/0x1af
Mar 7 23:11:16 xenserver1 kernel: [470815.401523] [<ffffffff8130d9dd>] ? oops_end+0xaf/0xb4
Mar 7 23:11:16 xenserver1 kernel: [470815.401523] [<ffffffff810135f0>] ? do_invalid_op+0x8b/0x95
Mar 7 23:11:16 xenserver1 kernel: [470815.401523] [<ffffffff8100c694>] ? pin_pagetable_pfn+0x2d/0x36
Mar 7 23:11:16 xenserver1 kernel: [470815.401523] [<ffffffffa01419ea>] ? copy_params+0x71/0xb1 [dm_mod]
Mar 7 23:11:16 xenserver1 kernel: [470815.401523] [<ffffffff810baf07>] ? __alloc_pages_nodemask+0x11c/0x5f5
Mar 7 23:11:16 xenserver1 kernel: [470815.401523] [<ffffffff8101293b>] ? invalid_op+0x1b/0x20
Mar 7 23:11:16 xenserver1 kernel: [470815.401523] [<ffffffff8100c694>] ? pin_pagetable_pfn+0x2d/0x36
Mar 7 23:11:16 xenserver1 kernel: [470815.401523] [<ffffffff8100c690>] ? pin_pagetable_pfn+0x29/0x36
Mar 7 23:11:16 xenserver1 kernel: [470815.401523] [<ffffffff810cd4e2>] ? __pte_alloc+0x6b/0xc6
Mar 7 23:11:16 xenserver1 kernel: [470815.401523] [<ffffffff810cb394>] ? pmd_alloc+0x28/0x5b
Mar 7 23:11:16 xenserver1 kernel: [470815.401523] [<ffffffff810cd60b>] ? handle_mm_fault+0xce/0x80f
Mar 7 23:11:16 xenserver1 kernel: [470815.401523] [<ffffffff810fbc5c>] ? do_vfs_ioctl+0x48d/0x4cb
Mar 7 23:11:16 xenserver1 kernel: [470815.401523] [<ffffffff8130f016>] ? do_page_fault+0x2e0/0x2fc
Mar 7 23:11:16 xenserver1 kernel: [470815.401523] [<ffffffff8130ceb5>] ? page_fault+0x25/0x30
Reply to: