I tend to think of pull operations in these situations. So perhaps wrap a
lazy sequence around a chunked form of the read + transform operation,
perhaps parallelizing the transform, and do the insert in a doseq on the
lazy sequence?
On Tue, Oct 22, 2013 at 8:03 PM, Brian Craft wrote:
> I'm do
Hi Brian,
On Wednesday, 23 October 2013 05:33:30 UTC+5:30, Brian Craft wrote:
>
> I'm doing a load to db, which looks roughly like "read, transform, insert,
> repeat".
>
> Blocking on the inserts leaves the cores sitting cold while they could be
> doing the next read/transform. It's tempting to
