Re: Using a better compression than .gz for one's CPAN modules

2010-11-19 Thread Daniel Staal
On Fri, November 19, 2010 2:57 pm, dhu...@hudes.org wrote: > Disk space is cheap. Bandwidth is cheap. What's rough is the rsync between > mirrors. Compressing to .bz2 won't help that: the stress is doing a stat > on every single file in CPAN not the transfer. Work toward optimizing the > mirror d

Re: Using a better compression than .gz for one's CPAN modules

2010-11-19 Thread Curtis Jewell
On Fri, 19 Nov 2010 11:57 -0800, dhu...@hudes.org wrote: > Disk space is cheap. Bandwidth is cheap. What's rough is the rsync > between > mirrors. Compressing to .bz2 won't help that: the stress is doing a stat > on every single file in CPAN not the transfer. Work toward optimizing the > mirror d

Re: Using a better compression than .gz for one's CPAN modules

2010-11-19 Thread David Cantrell
On Fri, Nov 19, 2010 at 08:53:12PM +0200, Shlomi Fish wrote: > here is a report on compressing Graph-Easy-0.70.tar with various > compression methods: > > -rw-r--r-- 1 shlomif shlomif 416916 Nov 14 22:23 Graph-Easy-0.70.tar.gz > > -rw-r--r-- 1 shlomif shlomif 329197 Nov 5 12:24 Graph-Easy-0.70

Re: Using a better compression than .gz for one's CPAN modules

2010-11-19 Thread dhudes
>> source code, even 100KLOC? Once you go to .gz you're already at better >> than 2:1. What are you going to save by going to even 3:1, 10Kbytes? >> compared to the nuisance inflicted, it's nothing. > > Over the entire CPAN archive, it'd be significant... > > I agree on the individual case it's pro

Re: Using a better compression than .gz for one's CPAN modules

2010-11-19 Thread Daniel Staal
On Fri, November 19, 2010 2:18 pm, dhu...@hudes.org wrote: > The savings for going to .bz2 over .gz for source code are fairly > insignificant. We're talking about source code for a perl module. Is > your stuff tens of megabytes in size? That's a lot of code if so. I could > understand if you we

Re: Using a better compression than .gz for one's CPAN modules

2010-11-19 Thread dhudes
The savings for going to .bz2 over .gz for source code are fairly insignificant. We're talking about source code for a perl module. Is your stuff tens of megabytes in size? That's a lot of code if so. I could understand if you were distributing a sizable database with your code but source code, e

Re: Using a better compression than .gz for one's CPAN modules

2010-11-19 Thread David Golden
On Fri, Nov 19, 2010 at 1:53 PM, Shlomi Fish wrote: > 1. Will the CPAN testing and downloading toolchian will handle modules > uploaded as .tar.bz2?  (Allow to install them, unpack them, etc.)  How > about tar.xz. .bz2, yes. .xz, possibly, but not reliably. CPANPLUS uses Archive::Extract, which

Using a better compression than .gz for one's CPAN modules

2010-11-19 Thread Shlomi Fish
Hi all, here is a report on compressing Graph-Easy-0.70.tar with various compression methods: {{{ shlomif:~/progs/perl/cpan/Graph/Easy/trunk/Graph-Easy/TEMP$ ls -l total 3420 -rw-r--r-- 1 shlomif shlomif 2160640 Nov 14 22:20 Graph-Easy-0.70.tar -rw-r--r-- 1 shlomif shlomif 329197 Nov 5 12:24 Gr