Re: Sluggish code

2012-06-11 Thread John W. Krahn
venkates wrote: Hi all, Hello, I am trying to filter files from a directory (code provided below) by comparing the contents of each file with a hash ref (a parsed id map file provided as an argument). The code is working however, is extremely slow. The .csv files (81 files) that I am reading

Re: Sluggish code

2012-06-11 Thread Jim Gibson
On Jun 11, 2012, at 7:31 AM, venkates wrote: > Hi all, > > I am trying to filter files from a directory (code provided below) by > comparing the contents of each file with a hash ref (a parsed id map file > provided as an argument). The code is working however, is extremely slow. > The .csv

Re: Sluggish code

2012-06-11 Thread Liutauras Diu
It's hard to suggest improvement seeing only a fragment of entire code for, but I would probably expect your code to be slow as you have 5 nested for each loops: while ( my @data_files = grep(/\.csv$/,readdir(DH)) ) ... foreach my $file ( @data_files ) ... while ( my $data = <$FH>

Re: Sluggish code

2012-06-11 Thread Rob Coops
On Mon, Jun 11, 2012 at 4:31 PM, venkates wrote: > Hi all, > > I am trying to filter files from a directory (code provided below) by > comparing the contents of each file with a hash ref (a parsed id map file > provided as an argument). The code is working however, is extremely slow. > The .csv