--- Begin Message ---
- To: Debian Bug Tracking System <submit@bugs.debian.org>
- Subject: linux-image-2.6.26-2-amd64: fff
- From: Ronald Moesbergen <intercommit@gmail.com>
- Date: Thu, 10 Sep 2009 17:24:59 +0200
- Message-id: <20090910152459.3486.32358.reportbug@san01.intercommit.local>
Package: linux-image-2.6.26-2-amd64
Version: 2.6.26-19
Severity: grave
Justification: causes non-serious data loss
Subject: linux-image-2.6.26-2-amd64: OOPS when using two lvm2 snapshots of one volume
Package: linux-image-2.6.26-2-amd64
Version: 2.6.26-19
Severity: important
When I create two lvm2 snapshots of one volume and there's heavy IO activity on the original volume, the kernel crashes.
1) lvcreate -pr -s /dev/vg/orgvolume -n snapshot1 -L 10G
2) lvcreate -pr -s /dev/vg/orgvolume -n snapshot2 -L 10G
3) ** Do heavy IO on /dev/vg/orgvolume **
** Kernel log:
[101899.596813] BUG: unable to handle kernel paging request at ffffc20005812000
[101899.596853] IP: [<ffffffffa0096726>] :dm_snapshot:persistent_commit+0x44/0xdc
[101899.596908] PGD 19f833067 PUD 19f834067 PMD 19c09a067 PTE 0
[101899.596946] Oops: 0002 [1] SMP
[101899.596974] CPU 1
[101899.596998] Modules linked in: iscsi_scst crc32c libcrc32c scst_vdisk scst drbd cn bonding ipmi_devintf cpufreq_ondemand acpi_cpufreq freq_table loop serio_raw pcspkr snd_pcm snd_timer snd soundcore snd_page_alloc psmouse ipmi_si usbhid hid ff_memless hpilo ipmi_msghandler container button evdev ext3 jbd mbcache dm_mirror dm_log dm_snapshot dm_mod ehci_hcd bnx2 uhci_hcd firmware_class cciss scsi_mod thermal processor fan thermal_sys [last unloaded: scsi_wait_scan]
[101899.597287] Pid: 8335, comm: kcopyd Not tainted 2.6.26-2-amd64 #1
[101899.597318] RIP: 0010:[<ffffffffa0096726>] [<ffffffffa0096726>] :dm_snapshot:persistent_commit+0x44/0xdc
[101899.597376] RSP: 0018:ffff81014ab51df0 EFLAGS: 00010286
[101899.597405] RAX: ffffc20005812000 RBX: 0000000000c310f6 RCX: ffff81008419bf28
[101899.597470] RDX: 0000000000000101 RSI: 0000000000000000 RDI: ffff81015fee84c0
[101899.597518] RBP: ffff81015fee84c0 R08: ffff81019c376000 R09: ffffffffa008a6f3
[101899.597567] R10: 0000000000000282 R11: ffffffffa00966e2 R12: 000000000002a108
[101899.597615] R13: ffffffffa0095adc R14: ffff81008419bf28 R15: 0000000000000000
[101899.597663] FS: 0000000000000000(0000) GS:ffff81019ec87ec0(0000) knlGS:0000000000000000
[101899.597714] CS: 0010 DS: 0018 ES: 0018 CR0: 000000008005003b
[101899.597744] CR2: ffffc20005812000 CR3: 0000000000201000 CR4: 00000000000006e0
[101899.597792] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[101899.597840] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[101899.597889] Process kcopyd (pid: 8335, threadinfo ffff81014ab50000, task ffff81019ed72ee0)
[101899.597939] Stack: ffff810148d43768 ffff81019c4bd4c0 0000000000000000 ffff81008419bf28
[101899.598000] ffffffffa0095aa4 ffffffffa008a830 ffffffffa008a6f3 ffff810148d43768
[101899.598056] ffff81019c4bd530 ffff81019c4bd538 00000000000000e1 ffff81019c4bd4c0
[101899.598096] Call Trace:
[101899.598140] [<ffffffffa0095aa4>] ? :dm_snapshot:copy_callback+0x0/0x38
[101899.598179] [<ffffffffa008a830>] ? :dm_mod:run_complete_job+0x51/0x80
[101899.598216] [<ffffffffa008a6f3>] ? :dm_mod:run_io_job+0x0/0x78
[101899.598252] [<ffffffffa008a7df>] ? :dm_mod:run_complete_job+0x0/0x80
[101899.598288] [<ffffffffa008a60e>] ? :dm_mod:process_jobs+0x22/0xb8
[101899.598324] [<ffffffffa008a6a4>] ? :dm_mod:do_work+0x0/0x4f
[101899.598359] [<ffffffffa008a6c5>] ? :dm_mod:do_work+0x21/0x4f
[101899.598393] [<ffffffff80243120>] ? run_workqueue+0x82/0x111
[101899.598424] [<ffffffff802439ed>] ? worker_thread+0xd5/0xe0
[101899.598455] [<ffffffff80246221>] ? autoremove_wake_function+0x0/0x2e
[101899.598490] [<ffffffff80243918>] ? worker_thread+0x0/0xe0
[101899.598536] [<ffffffff802460fb>] ? kthread+0x47/0x74
[101899.598567] [<ffffffff802301e9>] ? schedule_tail+0x27/0x5c
[101899.598597] [<ffffffff8020cf28>] ? child_rip+0xa/0x12
[101899.598630] [<ffffffff802460b4>] ? kthread+0x0/0x74
[101899.598659] [<ffffffff8020cf1e>] ? child_rip+0x0/0x12
[101899.598688]
[101899.598709]
[101899.598729] Code: 18 8b 75 28 48 89 ef 8d 46 01 89 45 28 e8 c4 fd ff ff 48 89 18 4c 89 60 08 8b 55 30 89 d0 ff c2 48 c1 e0 04 48 03 45 38 89 55 30 <4c> 89 28 4c 89 70 08 f0 ff 4d 2c 0f 94 c0 84 c0 75 08 8b 45 28
[101899.598949] RIP [<ffffffffa0096726>] :dm_snapshot:persistent_commit+0x44/0xdc
[101899.599002] RSP <ffff81014ab51df0>
[101899.599027] CR2: ffffc20005812000
[101899.599307] ---[ end trace 695003d4e0a79e16 ]---
-- System Information:
Debian Release: 5.0.3
APT prefers stable
APT policy: (500, 'stable')
Architecture: amd64 (x86_64)
Kernel: Linux 2.6.26-2-amd64 (SMP w/4 CPU cores)
Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8)
Shell: /bin/sh linked to /bin/bash
Versions of packages linux-image-2.6.26-2-amd64 depends on:
ii debconf [debconf-2.0] 1.5.24 Debian configuration management sy
ii initramfs-tools [linux-initra 0.92o tools for generating an initramfs
ii module-init-tools 3.4-1 tools for managing Linux kernel mo
linux-image-2.6.26-2-amd64 recommends no packages.
Versions of packages linux-image-2.6.26-2-amd64 suggests:
ii grub-pc [grub] 1.96+20080724-16 GRand Unified Bootloader, version
pn linux-doc-2.6.26 <none> (no description available)
-- debconf information excluded
-- Package-specific info:
** Version:
Linux version 2.6.26-2-amd64 (Debian 2.6.26-19) (dannf@debian.org) (gcc version 4.1.3 20080704 (prerelease) (Debian 4.1.2-25)) #1 SMP Wed Aug 19 22:33:18 UTC 2009
** Command line:
BOOT_IMAGE=/boot/vmlinuz-2.6.26-2-amd64 root=UUID=ce83bed5-f199-4f9c-9dd6-f27a646cb0e0 ro
** Not tainted
** Kernel log:
[ 59.635353] block drbd1: drbd_sync_handshake:
[ 59.635353] block drbd1: self C7578DEADBC19B7C:0000000000000000:EE5A3A077A3721BE:91F195B89AC73D31 bits:130048 flags:0
[ 59.635353] block drbd1: peer C7578DEADBC19B7C:0000000000000000:EE5A3A077A3721BE:91F195B89AC73D31 bits:0 flags:0
[ 59.635353] block drbd1: uuid_compare()=1 by rule 4
[ 59.635338] block drbd0: data-integrity-alg: <not-used>
[ 59.635353] block drbd1: peer( Unknown -> Secondary ) conn( WFReportParams -> WFBitMapS ) pdsk( DUnknown -> UpToDate )
[ 59.635338] block drbd0: drbd_sync_handshake:
[ 59.635338] block drbd0: self F2F5B1F5B0FEBF4E:0000000000000000:666DDCD7EF118ECB:3232F8AA480B950B bits:130048 flags:0
[ 59.635338] block drbd0: peer F2F5B1F5B0FEBF4E:0000000000000000:666DDCD7EF118ECA:3232F8AA480B950B bits:0 flags:0
[ 59.635338] block drbd0: uuid_compare()=1 by rule 4
[ 59.648764] block drbd0: peer( Unknown -> Secondary ) conn( WFReportParams -> WFBitMapS ) pdsk( DUnknown -> UpToDate )
[ 59.648932] block drbd2: drbd_sync_handshake:
[ 59.651525] block drbd2: self 1314BCBE70808226:0000000000000000:0560C6290E741232:A010C9D41A3770CD bits:130048 flags:0
[ 59.651525] block drbd2: peer 1314BCBE70808226:0000000000000000:0560C6290E741232:A010C9D41A3770CD bits:0 flags:0
[ 59.651525] block drbd2: uuid_compare()=1 by rule 4
[ 59.651531] block drbd2: peer( Unknown -> Secondary ) conn( WFReportParams -> WFBitMapS ) pdsk( DUnknown -> UpToDate )
[ 59.758383] block drbd1: conn( WFBitMapS -> SyncSource ) pdsk( UpToDate -> Inconsistent )
[ 59.758383] block drbd1: Began resync as SyncSource (will sync 520192 KB [130048 bits set]).
[ 59.762268] block drbd2: conn( WFBitMapS -> SyncSource ) pdsk( UpToDate -> Inconsistent )
[ 59.762268] block drbd2: Began resync as SyncSource (will sync 520192 KB [130048 bits set]).
[ 59.921896] block drbd0: conn( WFBitMapS -> SyncSource ) pdsk( UpToDate -> Inconsistent )
[ 59.921989] block drbd0: Began resync as SyncSource (will sync 520192 KB [130048 bits set]).
[ 61.442699] warning: `ntpd' uses 32-bit capabilities (legacy support in use)
[ 81.860250] block drbd1: Resync done (total 13 sec; paused 0 sec; 40012 K/sec)
[ 81.860343] block drbd1: conn( SyncSource -> Connected ) pdsk( Inconsistent -> UpToDate )
[ 81.882810] block drbd0: Resync done (total 13 sec; paused 0 sec; 40012 K/sec)
[ 81.882921] block drbd0: conn( SyncSource -> Connected ) pdsk( Inconsistent -> UpToDate )
[ 81.941728] block drbd2: Resync done (total 13 sec; paused 0 sec; 40012 K/sec)
[ 81.941824] block drbd2: conn( SyncSource -> Connected ) pdsk( Inconsistent -> UpToDate )
[ 239.804065] block drbd0: role( Secondary -> Primary )
[ 239.815176] block drbd1: role( Secondary -> Primary )
[ 239.852716] block drbd2: role( Secondary -> Primary )
[ 250.056023] scst: ***WARNING***: There is no patch io_context for your kernel version. For performance reasons it is strongly recommended to upgrade your kernel to version >= 2.6.27.x.
[ 250.057858] scst: Processing thread started, PID 3126
[ 250.057858] scst: Processing thread started, PID 3127
[ 250.058011] scst: Processing thread started, PID 3128
[ 250.058086] scst: Processing thread started, PID 3129
[ 250.057900] scst: Init thread started, PID 3130
[ 250.058011] scst: Task management thread started, PID 3131
[ 250.060490] scst: SCST version 1.0.2 loaded successfully (max mem for commands 1494MB, per device 597MB)
[ 250.060490] scst: Management thread started, PID 3132
[ 250.085645] scst: Virtual device handler vdisk for type 0 registered successfully
[ 250.092981] scst: Virtual device handler vdisk_blk for type 0 registered successfully
[ 250.095389] scst: Virtual device handler vdisk_null for type 0 registered successfully
[ 250.095389] scst: Virtual device handler vcdrom for type 5 registered successfully
[ 250.587438] dev_vdisk: Registering virtual FILEIO device attachments
[ 250.587726] scst: Processing thread started, PID 3141
[ 250.587624] scst: Processing thread started, PID 3140
[ 250.592004] scst: Processing thread started, PID 3142
[ 250.592134] scst: Processing thread started, PID 3143
[ 250.592134] dev_vdisk: Attached SCSI target virtual disk attachments (file="/dev/drbd0", fs=204793MB, bs=4096, nblocks=52427191, cyln=25599)
[ 250.592134] scst: Processing thread started, PID 3144
[ 250.592441] scst: Attached to virtual device attachments (id 1)
[ 250.593146] dev_vdisk: Registering virtual FILEIO device db-master
[ 250.593319] scst: Processing thread started, PID 3145
[ 250.593319] scst: Processing thread started, PID 3146
[ 250.593498] scst: Processing thread started, PID 3147
[ 250.593390] scst: Processing thread started, PID 3148
[ 250.594015] dev_vdisk: Attached SCSI target virtual disk db-master (file="/dev/drbd1", fs=51198MB, bs=4096, nblocks=13106791, cyln=6399)
[ 250.593571] scst: Processing thread started, PID 3149
[ 250.594090] scst: Attached to virtual device db-master (id 2)
[ 250.594782] dev_vdisk: Registering virtual FILEIO device db-slave
[ 250.594782] scst: Processing thread started, PID 3150
[ 250.594782] scst: Processing thread started, PID 3151
[ 250.594901] scst: Processing thread started, PID 3152
[ 250.594912] scst: Processing thread started, PID 3153
[ 250.598797] dev_vdisk: Attached SCSI target virtual disk db-slave (file="/dev/drbd2", fs=51198MB, bs=4096, nblocks=13106791, cyln=6399)
[ 250.598797] scst: Processing thread started, PID 3154
[ 250.598797] scst: Attached to virtual device db-slave (id 3)
[ 250.598797] scst: Added device db-master to group Default (LUN 1, rd_only 0)
[ 250.598797] scst: Added device attachments to group Default (LUN 0, rd_only 0)
[ 250.598797] scst: Added device db-slave to group Default (LUN 2, rd_only 0)
[ 254.837312] iscsi-scst: iSCSI SCST Target - version 1.0.2/0.4.17r214
[ 254.837384] iscsi-scst: ***WARNING***: CONFIG_TCP_ZERO_COPY_TRANSFER_COMPLETION_NOTIFICATION not enabled in your kernel. ISCSI-SCST will be working with not the best performance. Refer README file for details.
[ 254.837627] scst: Target template iscsi registered successfully
[ 254.837627] iscsi-scst: Read thread started, PID 3179
[ 254.837627] iscsi-scst: Read thread started, PID 3181
[ 254.837627] iscsi-scst: Write thread started, PID 3186
[ 254.837627] iscsi-scst: Write thread started, PID 3185
[ 254.837627] iscsi-scst: Write thread started, PID 3184
[ 254.837627] iscsi-scst: Write thread started, PID 3183
[ 254.837627] iscsi-scst: Read thread started, PID 3182
[ 254.837627] iscsi-scst: Read thread started, PID 3180
[ 254.865259] scst: Target iqn.2009-07.nl.go-secure:san01 (ffff810197eaacc0) for template iscsi registered successfully
[ 254.865517] iscsi-scst: Target parameter changed: QueuedCommands 32
[ 284.562531] scst: Using security group "Default" for initiator "iqn.2009-06.nl.go-secure:app01"
[ 284.562531] iscsi-scst: Negotiated parameters: InitialR2T No, ImmediateData Yes, MaxConnections 1, MaxRecvDataSegmentLength 1048576, MaxXmitDataSegmentLength 131072,
[ 284.562531] iscsi-scst: MaxBurstLength 1048576, FirstBurstLength 262144, DefaultTime2Wait 2, DefaultTime2Retain 0,
[ 284.562531] iscsi-scst: MaxOutstandingR2T 1, DataPDUInOrder Yes, DataSequenceInOrder Yes, ErrorRecoveryLevel 0,
[ 284.562531] iscsi-scst: HeaderDigest None, DataDigest None, OFMarker No, IFMarker No, OFMarkInt 2048, IFMarkInt 2048
[ 411.507921] scst: Using security group "Default" for initiator "iqn.2009-07.nl.go-secure:db01"
[ 411.508071] iscsi-scst: Negotiated parameters: InitialR2T No, ImmediateData Yes, MaxConnections 1, MaxRecvDataSegmentLength 1048576, MaxXmitDataSegmentLength 131072,
[ 411.508185] iscsi-scst: MaxBurstLength 1048576, FirstBurstLength 262144, DefaultTime2Wait 2, DefaultTime2Retain 0,
[ 411.508278] iscsi-scst: MaxOutstandingR2T 1, DataPDUInOrder Yes, DataSequenceInOrder Yes, ErrorRecoveryLevel 0,
[ 411.508370] iscsi-scst: HeaderDigest None, DataDigest None, OFMarker No, IFMarker No, OFMarkInt 2048, IFMarkInt 2048
[ 414.670553] scst: Using security group "Default" for initiator "iqn.2009-07.nl.go-secure:db02"
[ 414.670720] iscsi-scst: Negotiated parameters: InitialR2T No, ImmediateData Yes, MaxConnections 1, MaxRecvDataSegmentLength 1048576, MaxXmitDataSegmentLength 131072,
[ 414.670836] iscsi-scst: MaxBurstLength 1048576, FirstBurstLength 262144, DefaultTime2Wait 2, DefaultTime2Retain 0,
[ 414.670939] iscsi-scst: MaxOutstandingR2T 1, DataPDUInOrder Yes, DataSequenceInOrder Yes, ErrorRecoveryLevel 0,
[ 414.671028] iscsi-scst: HeaderDigest None, DataDigest None, OFMarker No, IFMarker No, OFMarkInt 2048, IFMarkInt 2048
** Loaded modules:
Module Size Used by
iscsi_scst 57452 4
crc32c 6400 0
libcrc32c 7168 2 iscsi_scst,crc32c
scst_vdisk 35308 0
scst 156792 2 iscsi_scst,scst_vdisk
drbd 228584 12
cn 12332 1 drbd
bonding 83808 0
ipmi_devintf 13200 0
cpufreq_ondemand 11792 1
acpi_cpufreq 11792 0
freq_table 9344 2 cpufreq_ondemand,acpi_cpufreq
loop 19468 0
ipmi_si 43628 0
snd_pcm 81800 0
serio_raw 9988 0
ipmi_msghandler 38520 2 ipmi_devintf,ipmi_si
snd_timer 25744 1 snd_pcm
snd 63688 2 snd_pcm,snd_timer
pcspkr 7040 0
hpilo 12176 0
soundcore 12064 1 snd
psmouse 42268 0
snd_page_alloc 13072 1 snd_pcm
container 8320 0
button 11680 0
evdev 14208 0
usbhid 45792 0
hid 41792 1 usbhid
ff_memless 9224 1 usbhid
ext3 125072 1
jbd 51240 1 ext3
mbcache 12804 1 ext3
dm_mirror 20608 0
dm_log 13956 1 dm_mirror
dm_snapshot 19400 2
dm_mod 58864 20 dm_mirror,dm_log,dm_snapshot
ehci_hcd 36108 0
uhci_hcd 25760 0
bnx2 63496 0
firmware_class 12544 1 bnx2
cciss 62344 3
scsi_mod 161016 2 scst,cciss
thermal 22688 0
processor 42304 6 acpi_cpufreq,thermal
fan 9352 0
thermal_sys 17728 3 thermal,processor,fan
** PCI devices:
not available
-- System Information:
Debian Release: 5.0.3
APT prefers stable
APT policy: (500, 'stable')
Architecture: amd64 (x86_64)
Kernel: Linux 2.6.26-2-amd64 (SMP w/4 CPU cores)
Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8)
Shell: /bin/sh linked to /bin/bash
Versions of packages linux-image-2.6.26-2-amd64 depends on:
ii debconf [debconf-2.0] 1.5.24 Debian configuration management sy
ii initramfs-tools [linux-initra 0.92o tools for generating an initramfs
ii module-init-tools 3.4-1 tools for managing Linux kernel mo
linux-image-2.6.26-2-amd64 recommends no packages.
Versions of packages linux-image-2.6.26-2-amd64 suggests:
ii grub-pc [grub] 1.96+20080724-16 GRand Unified Bootloader, version
pn linux-doc-2.6.26 <none> (no description available)
-- debconf information excluded
--- End Message ---