Re: compressing intermediate files with LZO on the fly

2007-04-07 Thread David Lang
files with LZO on the fly. How can you do that on ext3? Also, can you do that on a partition block-io level? No, sorry for the confusion. My scripts simply do : $ lzop -cd file1.lzo | process | lzop -c3 > file2.lzo With decent CPU, you can reach higher read/write data rates than what a single

Re: compressing intermediate files with LZO on the fly

2007-04-07 Thread Willy Tarreau
Hi Al, On Sat, Apr 07, 2007 at 02:32:34PM +0300, Al Boldi wrote: > Willy Tarreau wrote: > > > > ... for some usages (temporary space), > > light compression can increase speed. For instance, when processing logs, > > I get better speed by compressing intermediat

compressing intermediate files with LZO on the fly

2007-04-07 Thread Al Boldi
Willy Tarreau wrote: > > ... for some usages (temporary space), > light compression can increase speed. For instance, when processing logs, > I get better speed by compressing intermediate files with LZO on the fly. How can you do that on ext3? Also, can you do that on a partition bl