RE: techniques for handling large text files

2003-12-29 Thread Bakken, Luke
> How's abouts this (pls excuse any syntax errs) . > > my $out1 = "$file1.txt"; > my $out2 = "$file2.txt"; > > open(INPUT, $filename) or die "error: $filename cannot be opened\n"; > open(OUT1, ">$out1") or die "error: $out1 cannot be opened > for writing\n"; > open(OUT2, ">$out2") or die "er

Re: techniques for handling large text files

2003-12-29 Thread James Edward Gray II
On Dec 29, 2003, at 12:05 AM, danl001 wrote: Hi, Howdy. If this question would be better posted to another perl list, please let me know. I think you found the right place. I have a very large text files (~2 GB) and it's in the following format: header line header line header line marker 1 he

Re: techniques for handling large text files

2003-12-29 Thread Andy Unick
How's abouts this (pls excuse any syntax errs) . my $out1 = "$file1.txt"; my $out2 = "$file2.txt"; open(INPUT, $filename) or die "error: $filename cannot be opened\n"; open(OUT1, ">$out1") or die "error: $out1 cannot be opened for writing\n"; open(OUT2, ">$out2") or die "error: $out2 cannot b

Re: techniques for handling large text files

2003-12-28 Thread Randy W. Sims
On 12/29/2003 1:06 AM, danl001 wrote: Hi, If this question would be better posted to another perl list, please let me know. I have a very large text files (~2 GB) and it's in the following format: header line header line header line marker 1 header line header line header line marker 2 line typ

RE: techniques for handling large text files

2003-12-28 Thread Tom Kinzer
Maybe try not checking the marker counter every single line. Also, is the end of file check really necessary? You could just let it drop out naturally. These are probably minor hits compared to a major I/O tweak someone may come up with but is a suggestion. I don't see anything jumping out at m