[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Bug#501134: marked as done (RAW-pictures break down after copied on a crypted raid5)



Your message dated Tue, 8 May 2012 13:20:31 -0500
with message-id <20120508182031.GF19964@burratino>
and subject line Re: RAW-pictures break down after copied on a crypted raid5
has caused the Debian Bug report #501134,
regarding RAW-pictures break down after copied on a crypted raid5
to be marked as done.

This means that you claim that the problem has been dealt with.
If this is not the case it is now your responsibility to reopen the
Bug report if necessary, and/or fix the problem forthwith.

(NB: If you are a system administrator and have no idea what this
message is talking about, this may indicate a serious mail system
misconfiguration somewhere. Please contact owner@bugs.debian.org
immediately.)


-- 
501134: http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=501134
Debian Bug Tracking System
Contact owner@bugs.debian.org with problems
--- Begin Message ---
Package:  linux-image-2.6.24-etchnhalf.1-486	  
Version:  ?


Hello,
I have an extra-ordinary problem or perhaps an Kernel bug:

My Server: 
* Debian Etch (Kernel: Etch-n-half), Samba 3.0.24
* 500gb harddisk with a system and a data partition. Both are crypted
with Luks (cipher:serpent-cbc-essiv:sha256)
* Raid 5 crypted with Luks (cipher:  serpent-cbc-essiv:sha256)
* All partitions have the ext3 filesystem

Client1: Notebook (Windows XP and Fedora)
Client2: Desktop (Fedora)
I did all tests from both clients

My problem:
I tried to copy RAW pictures (*.cr2 files) from a client to the raid5
partition with the following 4 different ways.

1. I exported the raid partition with samba and copied the pictures with
Windows XP and the Windows Explorer
2. I copied the pictures through an smb-mount with Fedora with the
"cp"-command
3. I copied the pictures with the "scp"-command (first initiiated from
the client and then from the server)
4. I copied the pictures with the "rsync"-command (first initiiated from
the client and then from the server)

I checked the files after I had copied them with "md5sum" and I saw that
the values where different to the values of the original files.
The pictures where broken. They had lila stribes and where cutted in the
half.
I tried the same 4 methods and copied the pictures on the 500gb data
partition and there where no failures or md5sum differences.
Then I copied the pictures in an ssh shell with an normal cp-command
from the local-partition to the raid5-partition. The md5sum values where
the same, so this worked well.
So in my opinion the problem has to do with the crypted raid5.
I tried to reproduce this failures with other files but i had this
problem only with RAW (*.cr2 Canon) picture files.


I tried to repair my system with these 3 Methods:
1. fsck.ext3 -y /dev/mapper/md0_crypt
2. fsck.ext3 -c -p  /dev/mapper/md0_crypt
3. server rebooted a few times
I couldn't find out any failure messages in the log-files or at the
booting.


After many hours I found this out:
With Kernel 2.6.24-etchnhalf.1-686, Kernel 2.6.24-etchnhalf.1-486 and
Kernel 2.6.26-bpo.1-486 I could reproduce my Image-copy-problem. 
As I booted the older Kernel 2.6.18-6-486 I where able to copy the
pictures with any of the methods above and the md5sum values where OK.
Because of this I think its an Kernel problem.



I absolutly don't know what additional information I should post with
this E-Mail, please write me what I should add or where I should post
the extra-information.
Sorry if I addressed this E-Mail wrong, I don't know where to go with
this problem/bug. With bug-buddy I weren't able to make a Bug-Report.






Nice regards

Daniel







###########################################################################
###########################################################################
Server Systeminformation :

Debian Etch with different Kernels: 
2.6.24-etchnhalf.1-686, Kernel 2.6.24-etchnhalf.1-486, Kernel
2.6.26-bpo.1-486, Kernel 2.6.18-6-486

Kernel 2.6.18-6-486 installed with the Installation-setup from the
debian stable cd.
the others with apt-get install from the source: 

deb http://www.backports.org/debian etch-backports main contrib non-free


# ls -l /lib/libc.so.6
/lib/libc.so.6 -> libc-2.3.6.so

# lspci -v
00:00.0 Host bridge: nVidia Corporation nForce2 AGP (different version?)
(rev c1)
	Subsystem: ASUSTeK Computer Inc. Unknown device 80ac
	Flags: bus master, 66MHz, fast devsel, latency 0
	Memory at d0000000 (32-bit, prefetchable) [size=128M]
	Capabilities: [40] AGP version 3.0
	Capabilities: [60] HyperTransport: Host or Secondary Interface

00:00.1 RAM memory: nVidia Corporation nForce2 Memory Controller 0 (rev
c1)
	Subsystem: nVidia Corporation Unknown device 0c17
	Flags: 66MHz, fast devsel

00:00.2 RAM memory: nVidia Corporation nForce2 Memory Controller 4 (rev
c1)
	Subsystem: nVidia Corporation Unknown device 0c17
	Flags: 66MHz, fast devsel

00:00.3 RAM memory: nVidia Corporation nForce2 Memory Controller 3 (rev
c1)
	Subsystem: nVidia Corporation Unknown device 0c17
	Flags: 66MHz, fast devsel

00:00.4 RAM memory: nVidia Corporation nForce2 Memory Controller 2 (rev
c1)
	Subsystem: nVidia Corporation Unknown device 0c17
	Flags: 66MHz, fast devsel

00:00.5 RAM memory: nVidia Corporation nForce2 Memory Controller 5 (rev
c1)
	Subsystem: nVidia Corporation Unknown device 0c17
	Flags: 66MHz, fast devsel

00:01.0 ISA bridge: nVidia Corporation nForce2 ISA Bridge (rev a4)
	Subsystem: ASUSTeK Computer Inc. A7N8X Mainboard
	Flags: bus master, 66MHz, fast devsel, latency 0
	Capabilities: [48] HyperTransport: Slave or Primary Interface

00:01.1 SMBus: nVidia Corporation nForce2 SMBus (MCP) (rev a2)
	Subsystem: ASUSTeK Computer Inc. Unknown device 0c11
	Flags: 66MHz, fast devsel, IRQ 255
	I/O ports at c400 [size=32]
	Capabilities: [44] Power Management version 2

00:02.0 USB Controller: nVidia Corporation nForce2 USB Controller (rev
a4) (prog-if 10 [OHCI])
	Subsystem: ASUSTeK Computer Inc. A7N8X Mainboard
	Flags: bus master, 66MHz, fast devsel, latency 0, IRQ 22
	Memory at e5002000 (32-bit, non-prefetchable) [size=4K]
	Capabilities: [44] Power Management version 2

00:02.1 USB Controller: nVidia Corporation nForce2 USB Controller (rev
a4) (prog-if 10 [OHCI])
	Subsystem: ASUSTeK Computer Inc. A7N8X Mainboard
	Flags: bus master, 66MHz, fast devsel, latency 0, IRQ 21
	Memory at e5003000 (32-bit, non-prefetchable) [size=4K]
	Capabilities: [44] Power Management version 2

00:02.2 USB Controller: nVidia Corporation nForce2 USB Controller (rev
a4) (prog-if 20 [EHCI])
	Subsystem: ASUSTeK Computer Inc. A7N8X Mainboard
	Flags: bus master, 66MHz, fast devsel, latency 0, IRQ 20
	Memory at e5004000 (32-bit, non-prefetchable) [size=256]
	Capabilities: [44] Debug port
	Capabilities: [80] Power Management version 2

00:04.0 Ethernet controller: nVidia Corporation nForce2 Ethernet
Controller (rev a1)
	Subsystem: ASUSTeK Computer Inc. A7N8X Mainboard onboard nForce2
Ethernet
	Flags: bus master, 66MHz, fast devsel, latency 0, IRQ 22
	Memory at e5005000 (32-bit, non-prefetchable) [size=4K]
	I/O ports at b000 [size=8]
	Capabilities: [44] Power Management version 2

00:06.0 Multimedia audio controller: nVidia Corporation nForce2 AC97
Audio Controler (MCP) (rev a1)
	Subsystem: ASUSTeK Computer Inc. nForce2 AC97 Audio Controler (MCP)
	Flags: bus master, 66MHz, fast devsel, latency 0, IRQ 21
	I/O ports at b400 [size=256]
	I/O ports at b800 [size=128]
	Memory at e5000000 (32-bit, non-prefetchable) [size=4K]
	Capabilities: [44] Power Management version 2

00:08.0 PCI bridge: nVidia Corporation nForce2 External PCI Bridge (rev
a3) (prog-if 00 [Normal decode])
	Flags: bus master, 66MHz, fast devsel, latency 0
	Bus: primary=00, secondary=01, subordinate=01, sec-latency=32
	I/O behind bridge: 00009000-0000afff
	Memory behind bridge: e3000000-e4ffffff
	Prefetchable memory behind bridge: e0000000-e0ffffff

00:09.0 IDE interface: nVidia Corporation nForce2 IDE (rev a2) (prog-if
8a [Master SecP PriP])
	Subsystem: ASUSTeK Computer Inc. Unknown device 0c11
	Flags: bus master, 66MHz, fast devsel, latency 0
	[virtual] Memory at 000001f0 (32-bit, non-prefetchable) [disabled]
[size=8]
	[virtual] Memory at 000003f0 (type 3, non-prefetchable) [disabled]
[size=1]
	[virtual] Memory at 00000170 (32-bit, non-prefetchable) [disabled]
[size=8]
	[virtual] Memory at 00000370 (type 3, non-prefetchable) [disabled]
[size=1]
	I/O ports at f000 [size=16]
	Capabilities: [44] Power Management version 2

00:1e.0 PCI bridge: nVidia Corporation nForce2 AGP (rev c1) (prog-if 00
[Normal decode])
	Flags: bus master, 66MHz, medium devsel, latency 32
	Bus: primary=00, secondary=02, subordinate=02, sec-latency=32
	Memory behind bridge: e1000000-e2ffffff
	Prefetchable memory behind bridge: d8000000-dfffffff

01:07.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL-8169
Gigabit Ethernet (rev 10)
	Subsystem: Realtek Semiconductor Co., Ltd. RTL-8169 Gigabit Ethernet
	Flags: bus master, 66MHz, medium devsel, latency 64, IRQ 19
	I/O ports at 9000 [size=256]
	Memory at e4000000 (32-bit, non-prefetchable) [size=256]
	[virtual] Expansion ROM at e0020000 [disabled] [size=128K]
	Capabilities: [dc] Power Management version 2

01:08.0 RAID bus controller: Silicon Image, Inc. PCI0680 Ultra ATA-133
Host Controller (rev 02)
	Subsystem: Silicon Image, Inc. Winic W-680 (Silicon Image 680 based)
	Flags: bus master, medium devsel, latency 32, IRQ 18
	I/O ports at 9400 [size=8]
	I/O ports at 9800 [size=4]
	I/O ports at 9c00 [size=8]
	I/O ports at a000 [size=4]
	I/O ports at a400 [size=16]
	Memory at e4001000 (32-bit, non-prefetchable) [size=256]
	[virtual] Expansion ROM at e0080000 [disabled] [size=512K]
	Capabilities: [60] Power Management version 2

01:09.0 Multimedia controller: Philips Semiconductors SAA7146 (rev 01)
	Subsystem: KNC One Unknown device 0022
	Flags: bus master, medium devsel, latency 32, IRQ 17
	Memory at e4002000 (32-bit, non-prefetchable) [size=512]

01:0a.0 Multimedia video controller: Brooktree Corporation Bt878 Video
Capture (rev 11)
	Subsystem: Pinnacle Systems, Inc. (Wrong ID) PCTV pro (TV + FM stereo
receiver)
	Flags: bus master, medium devsel, latency 32, IRQ 16
	Memory at e0000000 (32-bit, prefetchable) [size=4K]
	Capabilities: [44] Vital Product Data
	Capabilities: [4c] Power Management version 2

01:0a.1 Multimedia controller: Brooktree Corporation Bt878 Audio Capture
(rev 11)
	Subsystem: Pinnacle Systems, Inc. (Wrong ID) PCTV pro (TV + FM stereo
receiver, audio section)
	Flags: bus master, medium devsel, latency 32, IRQ 16
	Memory at e0001000 (32-bit, prefetchable) [size=4K]
	Capabilities: [44] Vital Product Data
	Capabilities: [4c] Power Management version 2

02:00.0 VGA compatible controller: nVidia Corporation NV31 [GeForce FX
5600 Ultra] (rev a1) (prog-if 00 [VGA])
	Subsystem: CardExpert Technology Unknown device 0a01
	Flags: bus master, 66MHz, medium devsel, latency 32, IRQ 5
	Memory at e1000000 (32-bit, non-prefetchable) [size=16M]
	Memory at d8000000 (32-bit, prefetchable) [size=128M]
	[virtual] Expansion ROM at e2000000 [disabled] [size=128K]
	Capabilities: [60] Power Management version 2
	Capabilities: [44] AGP version 3.0


# mdadm --detail /dev/md0
/dev/md0:
        Version : 00.90.03
  Creation Time : Mon May 19 17:27:44 2008
     Raid Level : raid5
     Array Size : 585929920 (558.79 GiB 599.99 GB)
    Device Size : 117185984 (111.76 GiB 120.00 GB)
   Raid Devices : 6
  Total Devices : 6
Preferred Minor : 0
    Persistence : Superblock is persistent

    Update Time : Sat Oct  4 16:36:15 2008
          State : clean
 Active Devices : 6
Working Devices : 6
 Failed Devices : 0
  Spare Devices : 0

         Layout : left-symmetric
     Chunk Size : 64K

           UUID : ea235335:711ad654:c6f9e53f:2a844983
         Events : 0.58

    Number   Major   Minor   RaidDevice State
       0      22        1        0      active sync   /dev/hdc1
       1      22       65        1      active sync   /dev/hdd1
       2       3        1        2      active sync   /dev/hda1
       3       3       65        3      active sync   /dev/hdb1
       4      34        1        4      active sync   /dev/hdg1
       5      34       65        5      active sync   /dev/hdh1

# cryptsetup status /dev/mapper/md0_crypt
/dev/mapper//dev/mapper/md0_crypt is active:
  cipher:  serpent-cbc-essiv:sha256
  keysize: 256 bits
  device:  /dev/.static/dev/md0
  offset:  2056 sectors
  size:    1171857784 sectors
  mode:    read/write


# cat /etc/fstab
...
/dev/mapper/hda4_crypt 		/mnt/local_data 	ext3    defaults        0
2
/dev/mapper/md0_crypt 		/mnt/raid       	ext3    defaults        0
2
...











--- End Message ---
--- Begin Message ---
Version: 2.6.32-45

Daniel Starzmann wrote:

> The bug seems to be fixed in the current Debian 6.0 'squeeze' with the
> 2.6.32-5-amd64 kernel.
> I'm running it on new hardware but with a similar configuration
> (luks-crypted raid 5) and couldn't reproduce the described problem.

Thanks for checking.  Closing.


--- End Message ---

Reply to: