############################################################# Sent this yesterday, but never showed up in digest. Resending #############################################################
I am trying to setup a striped lvol on 7 raid disks, and getting corruption. I have set up 14 disks as 7 distinct raid 1 disks with mdadm, then set up a LVM vg using the 7 raid disks. I then create a striped lvol using all 7 raid disks, using 4K stripes, then I mkfs -t ext3 on the lvol. All goes fine, however once I mount and populate the lvol with data, the files on the lvol get corrupted, i.e. the data seems also seems to be striped amoungst each other. That is, data from the files is also striped in the inodes so that data from file1 is interspersed with all the other files and vice versa. NOTE: If I create the lvol with no striping all is fine. So is there a limitation with LVM striping, such that it doesn't work with raid, or is there some other bug I am bumping into? With striping the following errors are logged in /var/log/messages when I start to populate the lvol with data. -------------------------------------------------------------------- -------------------------------------------------------------------- kjournald starting. Commit interval 5 seconds EXT3 FS on dm-0, internal journal EXT3-fs: mounted filesystem with ordered data mode. attempt to access beyond end of device dm-0: rw=0, want=1101759496, limit=248815616 attempt to access beyond end of device dm-0: rw=0, want=949485584, limit=248815616 attempt to access beyond end of device dm-0: rw=0, want=725614592, limit=248815616 attempt to access beyond end of device dm-0: rw=0, want=1569103704, limit=248815616 . . . . -------------------------------------------------------------------- -------------------------------------------------------------------- No errors are logged to /var/log/messages when NOT using striping. Anybody seen this before? -jpg Details -------------------------------------------------------------------- -------------------------------------------------------------------- Kernel: 2.6.12.2 Distro: Debian sarge # dpkg -l | grep -i lvm ii lvm-common 1.5.17 The Logical Volume Manager for Linux (common ii lvm2 2.01.04-5 The Linux Logical Volume Manager # cat /proc/mdstat Personalities : [raid1] md5 : active raid1 sdj1[1] sdc1[0] 17775808 blocks [2/2] [UU] md6 : active raid1 sdk1[1] sdd1[0 17775808 blocks [2/2] [UU ] md3 : active raid1 sdh1[1] sda1[0 17775808 blocks [2/2] [UU ] md4 : active raid1 sdi1[1] sdb1[0 17775808 blocks [2/2] [UU ] md7 : active raid1 sde1[1] sdl1[0 17775808 blocks [2/2] [UU ] md8 : active raid1 sdf1[1] sdm1[0 17775808 blocks [2/2] [UU ] md9 : active raid1 sdn1[0] sdg1[1 17775808 blocks [2/2] [UU ] md1 : active raid1 sdp2[1] sdo2[0 2698816 blocks [2/2] [UU ] md2 : active raid1 sdp3[1] sdo3[0 2714880 blocks [2/2] [UU ] md0 : active raid1 sdp1[1] sdo1[0 66267968 blocks [2/2] [UU ] unused devices: <none> # vgdisplay -v --- Volume group --- VG Name vg01 System ID Format lvm2 Metadata Areas 7 Metadata Sequence No 4 VG Access read/write VG Status resizable MAX LV 1 Cur LV 1 Open LV 1 Max PV 18 Cur PV 7 Act PV 7 VG Size 118.64 GB PE Size 4.00 MB Total PE 30373 Alloc PE / Size 30373 / 118.64 GB Free PE / Size 0 / 0 VG UUID nw1DJY-hNGt-gZdG-601D-Db2X-9bXF-Dfa1cW --- Logical volume --- LV Name /dev/vg01/lvol1 VG Name vg01 LV UUID j2QV4L-kci9-NPfI-Mnas-ULoD-vYkR-GbnPom LV Write Access read/write LV Status available # open 1 LV Size 118.64 GB Current LE 30373 Segments 7 Allocation inherit Read ahead sectors 0 Block device 253:0 --- Physical volumes --- PV Name /dev/md3 PV UUID sp3bHf-Wr7G-snF7-b1iG-x1Ig-7LDg-0PGOMW PV Status allocatable Total PE / Free PE 4339 / 0 PV Name /dev/md4 PV UUID PL9uQs-diti-P6VV-xdCU-pTPv-B7z0-2i7Hy7 PV Status allocatable Total PE / Free PE 4339 / 0 PV Name /dev/md5 PV UUID iuIs3K-oIus-vycz-7Oni-e3WI-evd5-9awvwX PV Status allocatable Total PE / Free PE 4339 / 0 PV Name /dev/md6 PV UUID jeoU3U-wjL6-ValO-ibwC-ban2-SRPA-ntcNUq PV Status allocatable Total PE / Free PE 4339 / 0 PV Name /dev/md7 PV UUID CsZ4Ym-0JfC-iyMg-fIeS-2RH1-r6ZP-EoiEcj PV Status allocatable Total PE / Free PE 4339 / 0 PV Name /dev/md8 PV UUID hZTmmv-r6ZH-ZMkV-aHfT-Ts65-1CTq-twNK0c PV Status allocatable Total PE / Free PE 4339 / 0 PV Name /dev/md9 PV UUID L1oKIk-4R1r-wj99-sCkx-Z8tM-mpxZ-aj1rRZ PV Status allocatable Total PE / Free PE 4339 / 0 This is the lvdisplay with no striping: # lvdisplay -v /dev/vg01/lvol1 --- Logical volume --- LV Name /dev/vg01/lvol1 VG Name vg01 LV UUID j2QV4L-kci9-NPfI-Mnas-ULoD-vYkR-GbnPom LV Write Access read/write LV Status available # open 1 LV Size 118.64 GB Current LE 30373 Segments 7 Allocation inherit Read ahead sectors 0 Block device 253:0 # df -T /dev/md0 ext3 65227372 25996096 35917880 42% / tmpfs tmpfs 1037380 0 1037380 0% /dev/shm tmpfs tmpfs 10240 2720 7520 27% /dev /dev/mapper/vg01-lvol1 ext3 122454068 11186348 105047332 10% /striped_lvol -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
