Re: Buffer size (was Looking for parser for Email (MIME))

2016-03-22 Thread Alejandro Tejada
Hi All, Just wondering: Using LiveCode could you split and compress this 38 gb text file in 10,000 smaller files? Some years ago, when I was interested in creating an Offline Wikipedia Reader (using Livecode), I found the same problem to gather all parts of an article from compressed files. A

Re: Buffer size (was Looking for parser for Email (MIME))

2016-03-22 Thread Alex Tweedly
On 22/03/2016 14:24, Richard Gaskin wrote: Given that the engine is probably already doing pretty much the same thing, would it make sense to consider a readBufferSize global property which would govern the size of the buffer the engine uses when executing "read...until "? In my experiments

Re: Buffer size (was Looking for parser for Email (MIME))

2016-03-22 Thread Richard Gaskin
Very helpful info - thanks! I'll see if I can dig up my old experiment code and submit a tidy version with an enhancement request. My hope was that it might be as simple as "Aha, yes, as bigger buffer size!", but few things in life are that simple. :) -- Richard Gaskin Fourth World System

Re: Buffer size (was Looking for parser for Email (MIME))

2016-03-22 Thread Mark Waddingham
On 2016-03-22 15:24, Richard Gaskin wrote: What is the size of the read buffer used when reading until ? I'm assuming it isn't reading a single char per disk access, probably at least using the file system's block size, no? Well, the engine will memory map files if it can (if there is availabl