Re: Working with large files and Memory

2008-03-12 Thread Scott Ribe
One more thing, if you can require 10.5, you can build a 64-bit app. You should *still* avoid unnecessary allocations, and likely read the file in chunks, to lower the amount of RAM your users will require in order to avoid too much VM swapping. -- Scott Ribe [EMAIL PROTECTED] http://www.killerb

Re: Working with large files and Memory

2008-03-11 Thread Carl McIntosh
Thank you to both for your good advice. I will look into this. Carl. On Tuesday, March 11, 2008, at 04:49PM, "Jens Alfke" <[EMAIL PROTECTED]> wrote: > >On 11 Mar '08, at 10:18 AM, Jean-Daniel Dupas wrote: > >> The first advice I can give you is "do not load the whole file into >> memory". > >Ab

Re: Working with large files and Memory

2008-03-11 Thread Jens Alfke
On 11 Mar '08, at 10:18 AM, Jean-Daniel Dupas wrote: The first advice I can give you is "do not load the whole file into memory". Absolutely. Use read stream to read chunk of data and process them. (see NSInputStream or NSFileHandle). Or if the file is simple ascii text with newlines, y

Re: Working with large files and Memory

2008-03-11 Thread Jean-Daniel Dupas
Le 11 mars 08 à 17:54, Carl E. McIntosh a écrit : Can you please give advice about handling large data files with memory management techniques? I am attempting to read three large files (1 GB, 208 MB, 725 MB) sequentially and place the data into arrays for processing. Here is my psuedocode:

Re: Working with large files and Memory

2008-03-11 Thread Clark Cox
On Tue, Mar 11, 2008 at 9:54 AM, Carl E. McIntosh <[EMAIL PROTECTED]> wrote: > Can you please give advice about handling large data files with memory > management techniques? I am attempting to read three large files (1 > GB, 208 MB, 725 MB) sequentially and place the data into arrays for > proc

Working with large files and Memory

2008-03-11 Thread Carl E. McIntosh
Can you please give advice about handling large data files with memory management techniques? I am attempting to read three large files (1 GB, 208 MB, 725 MB) sequentially and place the data into arrays for processing. Here is my psuedocode: 1) Import a file into NSString. NSString *a