Bug#501134: RAW-pictures break down after copied on a crypted raid5
Package: linux-image-2.6.24-etchnhalf.1-486
Version: ?
Hello,
I have an extra-ordinary problem or perhaps an Kernel bug:
My Server:
* Debian Etch (Kernel: Etch-n-half), Samba 3.0.24
* 500gb harddisk with a system and a data partition. Both are crypted
with Luks (cipher:serpent-cbc-essiv:sha256)
* Raid 5 crypted with Luks (cipher: serpent-cbc-essiv:sha256)
* All partitions have the ext3 filesystem
Client1: Notebook (Windows XP and Fedora)
Client2: Desktop (Fedora)
I did all tests from both clients
My problem:
I tried to copy RAW pictures (*.cr2 files) from a client to the raid5
partition with the following 4 different ways.
1. I exported the raid partition with samba and copied the pictures with
Windows XP and the Windows Explorer
2. I copied the pictures through an smb-mount with Fedora with the
"cp"-command
3. I copied the pictures with the "scp"-command (first initiiated from
the client and then from the server)
4. I copied the pictures with the "rsync"-command (first initiiated from
the client and then from the server)
I checked the files after I had copied them with "md5sum" and I saw that
the values where different to the values of the original files.
The pictures where broken. They had lila stribes and where cutted in the
half.
I tried the same 4 methods and copied the pictures on the 500gb data
partition and there where no failures or md5sum differences.
Then I copied the pictures in an ssh shell with an normal cp-command
from the local-partition to the raid5-partition. The md5sum values where
the same, so this worked well.
So in my opinion the problem has to do with the crypted raid5.
I tried to reproduce this failures with other files but i had this
problem only with RAW (*.cr2 Canon) picture files.
I tried to repair my system with these 3 Methods:
1. fsck.ext3 -y /dev/mapper/md0_crypt
2. fsck.ext3 -c -p /dev/mapper/md0_crypt
3. server rebooted a few times
I couldn't find out any failure messages in the log-files or at the
booting.
After many hours I found this out:
With Kernel 2.6.24-etchnhalf.1-686, Kernel 2.6.24-etchnhalf.1-486 and
Kernel 2.6.26-bpo.1-486 I could reproduce my Image-copy-problem.
As I booted the older Kernel 2.6.18-6-486 I where able to copy the
pictures with any of the methods above and the md5sum values where OK.
Because of this I think its an Kernel problem.
I absolutly don't know what additional information I should post with
this E-Mail, please write me what I should add or where I should post
the extra-information.
Sorry if I addressed this E-Mail wrong, I don't know where to go with
this problem/bug. With bug-buddy I weren't able to make a Bug-Report.
Nice regards
Daniel
###########################################################################
###########################################################################
Server Systeminformation :
Debian Etch with different Kernels:
2.6.24-etchnhalf.1-686, Kernel 2.6.24-etchnhalf.1-486, Kernel
2.6.26-bpo.1-486, Kernel 2.6.18-6-486
Kernel 2.6.18-6-486 installed with the Installation-setup from the
debian stable cd.
the others with apt-get install from the source:
deb http://www.backports.org/debian etch-backports main contrib non-free
# ls -l /lib/libc.so.6
/lib/libc.so.6 -> libc-2.3.6.so
# lspci -v
00:00.0 Host bridge: nVidia Corporation nForce2 AGP (different version?)
(rev c1)
Subsystem: ASUSTeK Computer Inc. Unknown device 80ac
Flags: bus master, 66MHz, fast devsel, latency 0
Memory at d0000000 (32-bit, prefetchable) [size=128M]
Capabilities: [40] AGP version 3.0
Capabilities: [60] HyperTransport: Host or Secondary Interface
00:00.1 RAM memory: nVidia Corporation nForce2 Memory Controller 0 (rev
c1)
Subsystem: nVidia Corporation Unknown device 0c17
Flags: 66MHz, fast devsel
00:00.2 RAM memory: nVidia Corporation nForce2 Memory Controller 4 (rev
c1)
Subsystem: nVidia Corporation Unknown device 0c17
Flags: 66MHz, fast devsel
00:00.3 RAM memory: nVidia Corporation nForce2 Memory Controller 3 (rev
c1)
Subsystem: nVidia Corporation Unknown device 0c17
Flags: 66MHz, fast devsel
00:00.4 RAM memory: nVidia Corporation nForce2 Memory Controller 2 (rev
c1)
Subsystem: nVidia Corporation Unknown device 0c17
Flags: 66MHz, fast devsel
00:00.5 RAM memory: nVidia Corporation nForce2 Memory Controller 5 (rev
c1)
Subsystem: nVidia Corporation Unknown device 0c17
Flags: 66MHz, fast devsel
00:01.0 ISA bridge: nVidia Corporation nForce2 ISA Bridge (rev a4)
Subsystem: ASUSTeK Computer Inc. A7N8X Mainboard
Flags: bus master, 66MHz, fast devsel, latency 0
Capabilities: [48] HyperTransport: Slave or Primary Interface
00:01.1 SMBus: nVidia Corporation nForce2 SMBus (MCP) (rev a2)
Subsystem: ASUSTeK Computer Inc. Unknown device 0c11
Flags: 66MHz, fast devsel, IRQ 255
I/O ports at c400 [size=32]
Capabilities: [44] Power Management version 2
00:02.0 USB Controller: nVidia Corporation nForce2 USB Controller (rev
a4) (prog-if 10 [OHCI])
Subsystem: ASUSTeK Computer Inc. A7N8X Mainboard
Flags: bus master, 66MHz, fast devsel, latency 0, IRQ 22
Memory at e5002000 (32-bit, non-prefetchable) [size=4K]
Capabilities: [44] Power Management version 2
00:02.1 USB Controller: nVidia Corporation nForce2 USB Controller (rev
a4) (prog-if 10 [OHCI])
Subsystem: ASUSTeK Computer Inc. A7N8X Mainboard
Flags: bus master, 66MHz, fast devsel, latency 0, IRQ 21
Memory at e5003000 (32-bit, non-prefetchable) [size=4K]
Capabilities: [44] Power Management version 2
00:02.2 USB Controller: nVidia Corporation nForce2 USB Controller (rev
a4) (prog-if 20 [EHCI])
Subsystem: ASUSTeK Computer Inc. A7N8X Mainboard
Flags: bus master, 66MHz, fast devsel, latency 0, IRQ 20
Memory at e5004000 (32-bit, non-prefetchable) [size=256]
Capabilities: [44] Debug port
Capabilities: [80] Power Management version 2
00:04.0 Ethernet controller: nVidia Corporation nForce2 Ethernet
Controller (rev a1)
Subsystem: ASUSTeK Computer Inc. A7N8X Mainboard onboard nForce2
Ethernet
Flags: bus master, 66MHz, fast devsel, latency 0, IRQ 22
Memory at e5005000 (32-bit, non-prefetchable) [size=4K]
I/O ports at b000 [size=8]
Capabilities: [44] Power Management version 2
00:06.0 Multimedia audio controller: nVidia Corporation nForce2 AC97
Audio Controler (MCP) (rev a1)
Subsystem: ASUSTeK Computer Inc. nForce2 AC97 Audio Controler (MCP)
Flags: bus master, 66MHz, fast devsel, latency 0, IRQ 21
I/O ports at b400 [size=256]
I/O ports at b800 [size=128]
Memory at e5000000 (32-bit, non-prefetchable) [size=4K]
Capabilities: [44] Power Management version 2
00:08.0 PCI bridge: nVidia Corporation nForce2 External PCI Bridge (rev
a3) (prog-if 00 [Normal decode])
Flags: bus master, 66MHz, fast devsel, latency 0
Bus: primary=00, secondary=01, subordinate=01, sec-latency=32
I/O behind bridge: 00009000-0000afff
Memory behind bridge: e3000000-e4ffffff
Prefetchable memory behind bridge: e0000000-e0ffffff
00:09.0 IDE interface: nVidia Corporation nForce2 IDE (rev a2) (prog-if
8a [Master SecP PriP])
Subsystem: ASUSTeK Computer Inc. Unknown device 0c11
Flags: bus master, 66MHz, fast devsel, latency 0
[virtual] Memory at 000001f0 (32-bit, non-prefetchable) [disabled]
[size=8]
[virtual] Memory at 000003f0 (type 3, non-prefetchable) [disabled]
[size=1]
[virtual] Memory at 00000170 (32-bit, non-prefetchable) [disabled]
[size=8]
[virtual] Memory at 00000370 (type 3, non-prefetchable) [disabled]
[size=1]
I/O ports at f000 [size=16]
Capabilities: [44] Power Management version 2
00:1e.0 PCI bridge: nVidia Corporation nForce2 AGP (rev c1) (prog-if 00
[Normal decode])
Flags: bus master, 66MHz, medium devsel, latency 32
Bus: primary=00, secondary=02, subordinate=02, sec-latency=32
Memory behind bridge: e1000000-e2ffffff
Prefetchable memory behind bridge: d8000000-dfffffff
01:07.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL-8169
Gigabit Ethernet (rev 10)
Subsystem: Realtek Semiconductor Co., Ltd. RTL-8169 Gigabit Ethernet
Flags: bus master, 66MHz, medium devsel, latency 64, IRQ 19
I/O ports at 9000 [size=256]
Memory at e4000000 (32-bit, non-prefetchable) [size=256]
[virtual] Expansion ROM at e0020000 [disabled] [size=128K]
Capabilities: [dc] Power Management version 2
01:08.0 RAID bus controller: Silicon Image, Inc. PCI0680 Ultra ATA-133
Host Controller (rev 02)
Subsystem: Silicon Image, Inc. Winic W-680 (Silicon Image 680 based)
Flags: bus master, medium devsel, latency 32, IRQ 18
I/O ports at 9400 [size=8]
I/O ports at 9800 [size=4]
I/O ports at 9c00 [size=8]
I/O ports at a000 [size=4]
I/O ports at a400 [size=16]
Memory at e4001000 (32-bit, non-prefetchable) [size=256]
[virtual] Expansion ROM at e0080000 [disabled] [size=512K]
Capabilities: [60] Power Management version 2
01:09.0 Multimedia controller: Philips Semiconductors SAA7146 (rev 01)
Subsystem: KNC One Unknown device 0022
Flags: bus master, medium devsel, latency 32, IRQ 17
Memory at e4002000 (32-bit, non-prefetchable) [size=512]
01:0a.0 Multimedia video controller: Brooktree Corporation Bt878 Video
Capture (rev 11)
Subsystem: Pinnacle Systems, Inc. (Wrong ID) PCTV pro (TV + FM stereo
receiver)
Flags: bus master, medium devsel, latency 32, IRQ 16
Memory at e0000000 (32-bit, prefetchable) [size=4K]
Capabilities: [44] Vital Product Data
Capabilities: [4c] Power Management version 2
01:0a.1 Multimedia controller: Brooktree Corporation Bt878 Audio Capture
(rev 11)
Subsystem: Pinnacle Systems, Inc. (Wrong ID) PCTV pro (TV + FM stereo
receiver, audio section)
Flags: bus master, medium devsel, latency 32, IRQ 16
Memory at e0001000 (32-bit, prefetchable) [size=4K]
Capabilities: [44] Vital Product Data
Capabilities: [4c] Power Management version 2
02:00.0 VGA compatible controller: nVidia Corporation NV31 [GeForce FX
5600 Ultra] (rev a1) (prog-if 00 [VGA])
Subsystem: CardExpert Technology Unknown device 0a01
Flags: bus master, 66MHz, medium devsel, latency 32, IRQ 5
Memory at e1000000 (32-bit, non-prefetchable) [size=16M]
Memory at d8000000 (32-bit, prefetchable) [size=128M]
[virtual] Expansion ROM at e2000000 [disabled] [size=128K]
Capabilities: [60] Power Management version 2
Capabilities: [44] AGP version 3.0
# mdadm --detail /dev/md0
/dev/md0:
Version : 00.90.03
Creation Time : Mon May 19 17:27:44 2008
Raid Level : raid5
Array Size : 585929920 (558.79 GiB 599.99 GB)
Device Size : 117185984 (111.76 GiB 120.00 GB)
Raid Devices : 6
Total Devices : 6
Preferred Minor : 0
Persistence : Superblock is persistent
Update Time : Sat Oct 4 16:36:15 2008
State : clean
Active Devices : 6
Working Devices : 6
Failed Devices : 0
Spare Devices : 0
Layout : left-symmetric
Chunk Size : 64K
UUID : ea235335:711ad654:c6f9e53f:2a844983
Events : 0.58
Number Major Minor RaidDevice State
0 22 1 0 active sync /dev/hdc1
1 22 65 1 active sync /dev/hdd1
2 3 1 2 active sync /dev/hda1
3 3 65 3 active sync /dev/hdb1
4 34 1 4 active sync /dev/hdg1
5 34 65 5 active sync /dev/hdh1
# cryptsetup status /dev/mapper/md0_crypt
/dev/mapper//dev/mapper/md0_crypt is active:
cipher: serpent-cbc-essiv:sha256
keysize: 256 bits
device: /dev/.static/dev/md0
offset: 2056 sectors
size: 1171857784 sectors
mode: read/write
# cat /etc/fstab
...
/dev/mapper/hda4_crypt /mnt/local_data ext3 defaults 0
2
/dev/mapper/md0_crypt /mnt/raid ext3 defaults 0
2
...
Reply to: