Re: file compression on target side

2009-01-20 Thread Sven Hartrumpf
Mon, 19 Jan 2009 20:05:07 -0500, magawake wrote: > Using Redhat 4.5; I have been researching this for weeks and all signs > and wisemen (such as yourself) point to the Holy Grail -- ZFS! You could try FuseCompress: http://www.miio.net/fusecompress/ The author claims that he improved its speed rec

Re: file compression on target side

2009-01-19 Thread Mag Gam
Using Redhat 4.5; I have been researching this for weeks and all signs and wisemen (such as yourself) point to the Holy Grail -- ZFS! On a side node, brtfs nor ext4 won't help us too much. Strange that ZFS is being ported to FreeBSD but a license dispute between GPL and CDDL? I guess GPL isn't all

Re: file compression on target side

2009-01-19 Thread Ryan Malayter
On Mon, Jan 19, 2009 at 2:34 PM, Mag Gam wrote: > ZFS on fuse is just too slow. I suppose I will wait for ZFS on Linux > (pipe dream) or try to switch to Solaris 10 on x86 > There will never be ZFS in the Linux kernel because of license incompatibilites. The linux answer to ZFS is btrfs, which is

Re: file compression on target side

2009-01-19 Thread Ryan Malayter
You can switch to a filesystem that supports transparent encrytpion (Reiser, ZFS, NTFS, others depending on your OS). Rsync would be completely unaware of any file-system level compression in that case. Or you can use gzip with the --rsyncable option. Not all distributions of gzip support --rsynca

Re: file compression on target side

2009-01-19 Thread Mag Gam
yep. ZFS on fuse is just too slow. I suppose I will wait for ZFS on Linux (pipe dream) or try to switch to Solaris 10 on x86 On Mon, Jan 19, 2009 at 1:34 PM, Ryan Malayter wrote: > On Mon, Jan 19, 2009 at 12:33 PM, Ryan Malayter wrote: >> You can switch to a filesystem that supports transparent

Re: file compression on target side

2009-01-19 Thread Ryan Malayter
On Mon, Jan 19, 2009 at 12:33 PM, Ryan Malayter wrote: > You can switch to a filesystem that supports transparent encrytpion > (Reiser, ZFS, NTFS, others depending on your OS). Rsync would be > completely unaware of any file-system level compression in that case. Oops. I meant "transparent compre

Re: file compression on target side

2009-01-19 Thread Mag Gam
Thanks all. I figured this was the only solution available. Too bad I am using Linux and don't think my RAID controller is supported under Solaris. On Mon, Jan 19, 2009 at 10:41 AM, Kyle Lanclos wrote: > You wrote: >> The problem is, I am backing up a lot of ASCII .log, csv, and .txt >> files.

file compression on target side

2009-01-19 Thread Mag Gam
Hello All, I have been using rsync to backup several filesystems by using Mike Rubel's hard link method (http://www.mikerubel.org/computers/rsync_snapshots/). The problem is, I am backing up a lot of ASCII .log, csv, and .txt files. These files are large and can range anywhere from 1GB to 30GB. I