Oops. I wasn't paying attention to your statements. It has nothing to do with the array. Even though my original code used alines(aArray,filetostr(bigfile)), I broke it down to isolate the problem, so now I'm using cBuffer = filetostr(bigfile), then alines(aArray, cBuffer) ie 2 statements. It's the filetostr() that's failing as I originally stated. Nothing to do with the array.
-----Original Message----- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Michael Madigan Sent: Wednesday, October 01, 2008 6:36 PM To: ProFox Email List Subject: RE: Memory compaction/clean up can you release those arrays after your done with the parsing? It looks like they take up the full 1.2 gb of RAM. --- On Wed, 10/1/08, Lew <[EMAIL PROTECTED]> wrote: > From: Lew <[EMAIL PROTECTED]> > Subject: RE: Memory compaction/clean up > To: "'ProFox Email List'" <[email protected]> > Date: Wednesday, October 1, 2008, 6:07 PM > Actually, I am 'parsing' the data, but much later in > the process. The immediate goal is to get the entire 1.3 > g file into an array. alines(aArray,filetostr(bigfile)) is > blazingly fast. > > -----Original Message----- > From: [EMAIL PROTECTED] > [mailto:[EMAIL PROTECTED] On Behalf Of Tracy Pearson > Sent: Wednesday, October 01, 2008 5:52 PM > To: [email protected] > Subject: RE: Memory compaction/clean up > > I take it you aren't parsing the data. My work with a > 20 MB XML showed the > LLFF were 20ish seconds faster than StrToFile processing. > And minutes faster > than the XML DOM. Of course YMMV is evident. > > -----Original Message----- > From: Lew > Sent: Wednesday, October 01, 2008 5:47 PM > > What's wrong about it? The low level functions take > *much* longer to > process. > > -----Original Message----- > From: Paul Hill > Sent: Wednesday, October 01, 2008 5:29 PM > > On Wed, Oct 1, 2008 at 10:00 PM, Lew > <[EMAIL PROTECTED]> wrote: > > I've just had an app blow up while loading a 1.3g > file via file2str(). > > It was the second file that size, the first one > processed ok. I was > > able to process the second, but only after re-booting > the machine, so > > I'm wondering if there are any memory > compaction/clean up routines I can > call in the app that are somewhat less extreme. > > This is not to say that my app is at fault, however, > there's plenty of > > other stuff running that has nothing > to > > do with vfp & the machine hadn't been rebooted > for a few days. > > If you're loading a 1.3Gb file into memory you're > probably doing something > wrong... > > Can't you process the file in chunks with FRead() or > FGets()? > > -- > Paul > > > > [excessive quoting removed by server] _______________________________________________ Post Messages to: [email protected] Subscription Maintenance: http://leafe.com/mailman/listinfo/profox OT-free version of this list: http://leafe.com/mailman/listinfo/profoxtech Searchable Archive: http://leafe.com/archives/search/profox This message: http://leafe.com/archives/byMID/profox/[EMAIL PROTECTED] ** All postings, unless explicitly stated otherwise, are the opinions of the author, and do not constitute legal or medical advice. This statement is added to the messages for those lawyers who are too stupid to see the obvious.
