Re: Performance of fileset related operations with a large number of files

2006-01-20 Thread Steve Loughran
Stefan Bodewig wrote: On Thu, 19 Jan 2006, Paul Mackay <[EMAIL PROTECTED]> wrote: Is there any way to avoid this high memory usage and time spent building a list? No. And you'll see that Ant 1.7 is both a bit better and a bit worse than it used to be. Directoryscanner has probably become a

Re: Performance of fileset related operations with a large number of files

2006-01-19 Thread Stefan Bodewig
On Thu, 19 Jan 2006, Paul Mackay <[EMAIL PROTECTED]> wrote: > Is there any way to avoid this high memory usage and time spent > building a list? No. And you'll see that Ant 1.7 is both a bit better and a bit worse than it used to be. Directoryscanner has probably become a bit faster but at the

Re: Performance of fileset related operations with a large number of files

2006-01-19 Thread Jeffrey E Care
I don't profess to know the code as well as the committers, but I don't see how this would be feasible. First off, how would an iterative approach actually be faster? DirectoryScanner (or its iterative equivalent) would still have to do the same amount of work to select the files, so even thou

Performance of fileset related operations with a large number of files

2006-01-19 Thread Paul.Mackay
Hello, I have been trialling Ant as a driver for a large scale build execution. The preparation before the build involves copying and unzipping >100,000 files spread across >20,000 directories. When using Ant's built in copy task with filesets selecting large parts of these files, a long time is s