[zfs-discuss] cpio silently not copying files > 2GB -- seriously!?

[Håkan Olsson]

Hi,

I was just restoring a bunch of files from backup using find|cpio when I 
noticed that cpio does not copy files >2GB properly. The resulting files 
were "oddly" sized ( % 2GB, perhaps?).

Even more alarming, cpio did not warn in any way about not copying the 
file correctly! The cpio command exited normally ($? was 0). Output from 
"-pmdu" did not indicate any errors!

Fortunately, I happened to run 'du' and noticed it giving different sizes 
for the restored and "backup" directories, I've since re-restored the 
affected files using plain cp.

I guess I was lucky not doing the backup using cpio! :(

Seriously bad behaviour here -- something that really should be fixed for 
e.g "Solaris 11".

FWIW, I know about "largefile(5)", but I don't think failing silently like 
this (copying "some" data) can be considered proper behaviour in any 
scenario.

(This probably does not strictly belong in zfs-discuss, although for me 
both the backup media and the destination pool to restore to are ZFS.)

/H
___
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

Re: [zfs-discuss] cpio silently not copying files > 2GB -- seriously!?

[Håkan Olsson]

On Fri, 28 Nov 2008, Joerg Schilling wrote:


Håkan Olsson <[EMAIL PROTECTED]> wrote:


I was just restoring a bunch of files from backup using find|cpio when I
noticed that cpio does not copy files >2GB properly. The resulting files
were "oddly" sized ( % 2GB, perhaps?).

Even more alarming, cpio did not warn in any way about not copying the
file correctly! The cpio command exited normally ($? was 0). Output from
"-pmdu" did not indicate any errors!


What exactly did you do when encountering the problem?


cd /backup
find . -depth -print | cpio -pdmvu /pool
<...lots of files listed>
 blocks copied

I've filed a bug report on it now.

The limit is 4GB, not 2 as I believed last night. It's simple to 
reproduce:


mkdir test
mkfile 4200m bigfile
echo bigfile | cpio -pdmvu test/
echo $?
ls -l bigfile test/bigfile

/H___
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss