Re: Streaming a big file

2015-05-05 Thread Alan Busby
I wrote a library ( https://github.com/thebusby/iota ) to handle a very similar issue, which I hope would be of some help to you here. On Wed, May 6, 2015 at 12:18 PM, Sam Raker wrote: > I've got two really big CSV files that I need to compare. Stay tuned for > the semi-inevitable "how do I opti

Re: Streaming a big file

2015-05-05 Thread Fluid Dynamics
On Tuesday, May 5, 2015 at 11:18:56 PM UTC-4, Sam Raker wrote: > > I've got two really big CSV files that I need to compare. Stay tuned for > the semi-inevitable "how do I optimize over this M x N space?" question, > but for now I'm still trying to get the data into a reasonable format--I'm > pl