Re: [PERFORM] filesystem performance with lots of files

2005-12-20 Thread Jim C. Nasby
On Tue, Dec 20, 2005 at 01:26:00PM +, David Roussel wrote: > Note that you can do the taring, zipping, copying and untaring > concurrentlt. I can't remember the exactl netcat command line options, > but it goes something like this > > Box1: > tar czvf - myfiles/* | netcat myserver:12345 >

Re: [PERFORM] filesystem performance with lots of files

2005-12-20 Thread David Roussel
David Lang wrote:   ext3 has an option to make searching directories faster (htree), but enabling it kills performance when you create files. And this doesn't help with large files. The ReiserFS white paper talks about the data structure he uses to store directories (some kind of tree),

Re: [PERFORM] filesystem performance with lots of files

2005-12-02 Thread David Lang
On Fri, 2 Dec 2005, Qingqing Zhou wrote: I don't have all the numbers readily available (and I didn't do all the tests on every filesystem), but I found that even with only 1000 files/directory ext3 had some problems, and if you enabled dir_hash some functions would speed up, but writing lots o

Re: [PERFORM] filesystem performance with lots of files

2005-12-01 Thread Qingqing Zhou
On Fri, 2 Dec 2005, David Lang wrote: > > I don't have all the numbers readily available (and I didn't do all the > tests on every filesystem), but I found that even with only 1000 > files/directory ext3 had some problems, and if you enabled dir_hash some > functions would speed up, but writing l

Re: [PERFORM] filesystem performance with lots of files

2005-12-01 Thread David Lang
On Thu, 1 Dec 2005, Qingqing Zhou wrote: "David Lang" <[EMAIL PROTECTED]> wrote a few weeks ago I did a series of tests to compare different filesystems. the test was for a different purpose so the particulars are not what I woud do for testing aimed at postgres, but I think the data is relave

Re: [PERFORM] filesystem performance with lots of files

2005-12-01 Thread Qingqing Zhou
"David Lang" <[EMAIL PROTECTED]> wrote > > a few weeks ago I did a series of tests to compare different filesystems. > the test was for a different purpose so the particulars are not what I > woud do for testing aimed at postgres, but I think the data is relavent) > and I saw major differences