LVM bug?
#############################################################
Sent this yesterday, but never showed up in digest. Resending
#############################################################
I am trying to setup a striped lvol on 7 raid disks, and getting
corruption.
I have set up 14 disks as 7 distinct raid 1 disks with mdadm, then
set up a LVM vg using the 7 raid disks.
I then create a striped lvol using all 7 raid disks, using 4K
stripes, then I mkfs -t ext3 on the lvol.
All goes fine, however once I mount and populate the lvol with data,
the files on the lvol get corrupted, i.e. the data seems also seems
to be striped amoungst each other.
That is, data from the files is also striped in the inodes so that
data from file1 is interspersed with all the other files and vice
versa.
NOTE: If I create the lvol with no striping all is fine.
So is there a limitation with LVM striping, such that it doesn't
work with raid, or is there some other bug I am bumping into?
With striping the following errors are logged in /var/log/messages
when I start to populate the lvol with data.
--------------------------------------------------------------------
--------------------------------------------------------------------
kjournald starting. Commit interval 5 seconds EXT3 FS on dm-0,
internal journal EXT3-fs: mounted filesystem with ordered data mode.
attempt to access beyond end of device dm-0: rw=0, want=1101759496,
limit=248815616 attempt to access beyond end of device dm-0: rw=0,
want=949485584, limit=248815616 attempt to access beyond end of
device dm-0: rw=0, want=725614592, limit=248815616 attempt to access
beyond end of device dm-0: rw=0, want=1569103704, limit=248815616 .
. . .
--------------------------------------------------------------------
--------------------------------------------------------------------
No errors are logged to /var/log/messages when NOT using striping.
Anybody seen this before?
-jpg
Details
--------------------------------------------------------------------
--------------------------------------------------------------------
Kernel: 2.6.12.2 Distro: Debian sarge
# dpkg -l | grep -i lvm ii lvm-common 1.5.17 The Logical Volume
Manager for Linux (common ii lvm2 2.01.04-5 The Linux Logical Volume
Manager
# cat /proc/mdstat Personalities : [raid1] md5 : active raid1
sdj1[1] sdc1[0] 17775808 blocks [2/2] [UU]
md6 : active raid1 sdk1[1] sdd1[0 17775808 blocks [2/2] [UU ]
md3 : active raid1 sdh1[1] sda1[0 17775808 blocks [2/2] [UU ]
md4 : active raid1 sdi1[1] sdb1[0 17775808 blocks [2/2] [UU ]
md7 : active raid1 sde1[1] sdl1[0 17775808 blocks [2/2] [UU ]
md8 : active raid1 sdf1[1] sdm1[0 17775808 blocks [2/2] [UU ]
md9 : active raid1 sdn1[0] sdg1[1 17775808 blocks [2/2] [UU ]
md1 : active raid1 sdp2[1] sdo2[0 2698816 blocks [2/2] [UU ]
md2 : active raid1 sdp3[1] sdo3[0 2714880 blocks [2/2] [UU ]
md0 : active raid1 sdp1[1] sdo1[0 66267968 blocks [2/2] [UU ]
unused devices: <none>
# vgdisplay -v --- Volume group --- VG Name vg01 System ID Format
lvm2 Metadata Areas 7 Metadata Sequence No 4 VG Access read/write
VG Status resizable MAX LV 1 Cur LV 1 Open LV 1 Max PV 18 Cur
PV 7 Act PV 7 VG Size 118.64 GB PE Size 4.00 MB Total PE 30373
Alloc PE / Size 30373 / 118.64 GB Free PE / Size 0 / 0 VG UUID
nw1DJY-hNGt-gZdG-601D-Db2X-9bXF-Dfa1cW
--- Logical volume --- LV Name /dev/vg01/lvol1 VG Name vg01 LV UUID
j2QV4L-kci9-NPfI-Mnas-ULoD-vYkR-GbnPom LV Write Access read/write
LV Status available # open 1 LV Size 118.64 GB Current LE 30373
Segments 7 Allocation inherit Read ahead sectors 0 Block device
253:0
--- Physical volumes --- PV Name /dev/md3 PV UUID
sp3bHf-Wr7G-snF7-b1iG-x1Ig-7LDg-0PGOMW PV Status allocatable Total
PE / Free PE 4339 / 0
PV Name /dev/md4 PV UUID PL9uQs-diti-P6VV-xdCU-pTPv-B7z0-2i7Hy7 PV
Status allocatable Total PE / Free PE 4339 / 0
PV Name /dev/md5 PV UUID iuIs3K-oIus-vycz-7Oni-e3WI-evd5-9awvwX PV
Status allocatable Total PE / Free PE 4339 / 0
PV Name /dev/md6 PV UUID jeoU3U-wjL6-ValO-ibwC-ban2-SRPA-ntcNUq PV
Status allocatable Total PE / Free PE 4339 / 0
PV Name /dev/md7 PV UUID CsZ4Ym-0JfC-iyMg-fIeS-2RH1-r6ZP-EoiEcj PV
Status allocatable Total PE / Free PE 4339 / 0
PV Name /dev/md8 PV UUID hZTmmv-r6ZH-ZMkV-aHfT-Ts65-1CTq-twNK0c PV
Status allocatable Total PE / Free PE 4339 / 0
PV Name /dev/md9 PV UUID L1oKIk-4R1r-wj99-sCkx-Z8tM-mpxZ-aj1rRZ PV
Status allocatable Total PE / Free PE 4339 / 0
This is the lvdisplay with no striping: # lvdisplay -v
/dev/vg01/lvol1 --- Logical volume --- LV Name /dev/vg01/lvol1 VG
Name vg01 LV UUID j2QV4L-kci9-NPfI-Mnas-ULoD-vYkR-GbnPom LV Write
Access read/write LV Status available # open 1 LV Size 118.64 GB
Current LE 30373 Segments 7 Allocation inherit Read ahead sectors 0
Block device 253:0
# df -T /dev/md0 ext3 65227372 25996096 35917880 42% / tmpfs tmpfs
1037380 0 1037380 0% /dev/shm tmpfs tmpfs 10240 2720 7520 27%
/dev /dev/mapper/vg01-lvol1 ext3 122454068 11186348 105047332 10%
/striped_lvol
Reply to: