On Wed, Sep 28, 2011 at 17:52, Bruce Dubbs <bruce.du...@gmail.com> wrote:
> Right now, the BW for the book is 100-150 GB/month.  That includes
> mailing lists, etc.
>
> The BW for the files on anduin are 1-2 TB/month.  I don't know about the
> other mirrors.

Wow!  That's a lot.  It would be interesting to know how often
multiple LFS versions are downloaded.

So I've completed my experiment of importing all lfs-packages tarballs
into a git repo.  I did it by creating a base commit and then
branching each version off that commit.  I then unpacked all tarballs
and patches into a PACKAGES/<version> directory and added that.  Some
empty dirs and some odd .gitignore files required a second commit to
catch them.  In an actual creation of this repo I would suggest doing
it differently, but that can be discussed.

The summary of this experiment:

2143M of lfs-packages tarballs (6.0 - 6.8) become a 600M git repository.

The raw numbers are as follows:

133M    ../pkgs-tarballs/lfs-packages-6.0.tar
146M    ../pkgs-tarballs/lfs-packages-6.1.tar
148M    ../pkgs-tarballs/lfs-packages-6.1.1.tar
181M    ../pkgs-tarballs/lfs-packages-6.2.tar
198M    ../pkgs-tarballs/lfs-packages-6.3.tar
248M    ../pkgs-tarballs/lfs-packages-6.4.tar
261M    ../pkgs-tarballs/lfs-packages-6.6-rc1.tar
261M    ../pkgs-tarballs/lfs-packages-6.6.tar
281M    ../pkgs-tarballs/lfs-packages-6.7.tar
286M    ../pkgs-tarballs/lfs-packages-6.8.tar
 ---
Wed Sep 28 21:38:42 IST 2011
6.0
441M    .git
936M    PACKAGES/6.0
post-gc
178M    .git
 ---
Thu Sep 29 06:07:26 IST 2011
6.1
365M    .git
1.0G    PACKAGES/6.1
post-gc
209M    .git
 ---
Thu Sep 29 06:41:06 IST 2011
6.1.1
220M    .git
1.0G    PACKAGES/6.1.1
post-gc
212M    .git
 ---
Thu Sep 29 07:12:39 IST 2011
6.2
499M    .git
1.2G    PACKAGES/6.2
post-gc
269M    .git
 ---
Thu Sep 29 07:51:49 IST 2011
6.3
623M    .git
1.3G    PACKAGES/6.3
post-gc
330M    .git
 ---
Thu Sep 29 09:08:25 IST 2011
6.4
852M    .git
1.6G    PACKAGES/6.4
post-gc
424M    .git
 ---
Thu Sep 29 10:44:44 IST 2011
6.6-rc1
872M    .git
1.7G    PACKAGES/6.6-rc1
post-gc
519M    .git
 ---
Thu Sep 29 14:05:40 IST 2011
6.6
526M    .git
1.7G    PACKAGES/6.6
post-gc
519M    .git
 ---
Thu Sep 29 15:04:31 IST 2011
6.7
877M    .git
1.9G    PACKAGES/6.7
post-gc
573M    .git
 ---
Thu Sep 29 16:00:41 IST 2011
6.8
805M    .git
1.9G    PACKAGES/6.8
post-gc
602M    .git
 ---

Note that the .git dir is larger when an lfs-packages containing
branch is checked out (I assume for the hidden index branch).  I
haven't tested yet, but a bare repo is likely around 20M less.

I also have not tried a git clone --branch v6.6 --depth 1
file:blah/pkgs.git.  That might download a dramatically smaller amount
of data.  If it does we could create a few branches for each release:
v6.6-full, v6.6-book-only-source, v6.6-book-only-pdf,
v6.6-book-only-html, v6.6-book-only-nochunks-html, v6.6-packages-only

Kevin

-- 
Kevin Lyda
Dublin, Ireland
US Citizen overseas? We can vote.
Register now: http://www.votefromabroad.org/
-- 
http://linuxfromscratch.org/mailman/listinfo/lfs-dev
FAQ: http://www.linuxfromscratch.org/faq/
Unsubscribe: See the above information page

Reply via email to