Am Tue, 04 Feb 2014 00:04:22 +
schrieb "Rene Zwanenburg" :
> On Monday, 3 February 2014 at 23:50:54 UTC, bearophile wrote:
> > Rene Zwanenburg:
> >
> >> The problem is speed. I'm using LockingTextReader in
> >> std.stdio, but it't not nearly fast enough. On my system it
> >> only reads about
You can also try a BufferedRange.
http://forum.dlang.org/thread/l9q66g$2he3$1...@digitalmars.com
Parsing should be faster than I/O. Set up two buffers and have
one thread reading into buffer A while you parse buffer B with
a second thread.
...and then flip buffers whenever the slower of the two has
completed.
On Tuesday, 4 February 2014 at 00:04:23 UTC, Rene Zwanenburg
wrote:
On Monday, 3 February 2014 at 23:50:54 UTC, bearophile wrote:
Rene Zwanenburg:
The problem is speed. I'm using LockingTextReader in
std.stdio, but it't not nearly fast enough. On my system it
only reads about 3 MB/s with one
On Monday, 3 February 2014 at 23:50:54 UTC, bearophile wrote:
Rene Zwanenburg:
The problem is speed. I'm using LockingTextReader in
std.stdio, but it't not nearly fast enough. On my system it
only reads about 3 MB/s with one core spending all it's time
in IO calls.
Are you reading the text
Rene Zwanenburg:
The problem is speed. I'm using LockingTextReader in std.stdio,
but it't not nearly fast enough. On my system it only reads
about 3 MB/s with one core spending all it's time in IO calls.
Are you reading the text by lines? In Bugzilla there is a
byLineFast:
https://d.puremag
I'm running into a problem I've come across before but never
found a satisfactory solution for.
There's a pretty large ascii file I need to process, currently
about 3GB but size will increase in the future. D's ranges in
combination with std.algorithm are simply perfect for what I'm
doing, an
