Re: large files

2013-03-05 Thread Dr.Ruud
On 2013-03-05 21:41, Chris Stinemetz wrote: I am working on a script to parse large files, by large I mean 4 million line+ in length and when splitting on the delimiter ( ; ) there are close to 300 fields per record, but I am only interested in the first 44. Try Text::CSV_XS. -- Ruud -- To

Re: large files

2013-03-05 Thread John SJ Anderson
On Tue, Mar 5, 2013 at 12:41 PM, Chris Stinemetz wrote: > Hello List, > > I am working on a script to parse large files, by large I mean 4 million > line+ in length and when splitting on the delimiter ( ; ) there are close > to 300 fields per record, but I am only interested in the first 44. Cons

Re: large files

2013-03-05 Thread Rob Dixon
On 05/03/2013 20:41, Chris Stinemetz wrote: Hello List, I am working on a script to parse large files, by large I mean 4 million line+ in length and when splitting on the delimiter ( ; ) there are close to 300 fields per record, but I am only interested in the first 44. I have begin testing to

Re: large Files management

2007-09-26 Thread Dr.Ruud
"Armin Garcia" schreef: > well i work with mbox files, but i have a huge mbox file, its 339 MB > and when i processing this file with Mail::MboxParser module, my > program breaks becouse send a message of out of memory Change-or-convert to maildir-type storage? -- Affijn, Ruud "Gewoon is

RE: large files

2006-01-26 Thread Wagner, David --- Senior Programmer Analyst --- WGO
Bill Peters wrote: > Hello, > I hope this question is appropriate to this list: > I am running ActiveState Perl 5.8 on Windows XP with > Spreadsheet::ParseExcel and Spreadsheet::WriteExcel::Big. I have 2 > programs I've written using these modules. One program reads from a > SQL DB and just writes

Re: Large files

2002-09-11 Thread Paul Johnson
On Wed, Sep 11, 2002 at 11:58:12AM -0500, Frank Wiles wrote: > There aren't any limits in Perl on the size of the file, except of > course your operating system limits. Well, that's not strictly true. Large file support (>2Gb) came in 5.6.0. Now the limit is bigger ;-) -- Paul Johns

Re: Large files

2002-09-11 Thread Frank Wiles
.--[ Rob wrote (2002/09/11 at 12:56:10) ]-- | | Hi, I'm parsing a 16 meg file and my program dies 111 lines from the | bottom. The record that it stops isn't any different from the ones that | make it through. If I delete from there down it works ok and if I delete | 111 lines

Re: Large files

2002-09-11 Thread Rob
If I take 111 lines off from the top of the file it does make it through that line and finishes without a problem. Rob Good judgement comes from experience, and experience - well, that comes from poor judgement. On Wed, 11 Sep 2002, Frank Wiles wrote: > .--[ Rob wrote (2002/09/11 at 12:

Re: Large files

2002-09-11 Thread Joe Raube
When it dies, what error do you get? --- Rob <[EMAIL PROTECTED]> wrote: > Hi, I'm parsing a 16 meg file and my program dies 111 lines from > the > bottom. The record that it stops isn't any different from the ones > that > make it through. If I delete from there down it works ok and if I > dele