Re: OOM with Agents

2010-12-12 Thread Michael Ossareh
> > This was the first issue, the second issue is that I'm queueing up lots of > data for the thread pools and as a result I'm able to completely exhaust the > available memory. the clj-sys/work framework seems to be what I need to > ensure there is a fixed number of threads. > I wrote this up: ht

Re: OOM with Agents

2010-12-11 Thread Michael Ossareh
On Fri, Dec 10, 2010 at 23:36, Alex Osborne wrote: > Michael Ossareh writes: > > > There are 54874 companies in the companies var. The OOM tends to take > place when there are 1000 or so companies to process. > > > > What is likely to be causing this issue? > > I replied on IRC but just recappin

Re: OOM with Agents

2010-12-10 Thread Alex Osborne
Michael Ossareh writes: > There are 54874 companies in the companies var. The OOM tends to take place > when there are 1000 or so companies to process. > > What is likely to be causing this issue? I replied on IRC but just recapping here. I think you've probably been bitten by the way Java str

Re: OOM with Agents

2010-12-10 Thread Ken Wesson
On Sat, Dec 11, 2010 at 1:05 AM, Michael Ossareh wrote: > I've cobbled together some grungy code to attempt to work out the number of > employees in different ranges - the code is a horrible mess of side > effects: https://gist.github.com/737179 ... > There are 54874 companies in the companies v

OOM with Agents

2010-12-10 Thread Michael Ossareh
Hi, I've cobbled together some grungy code to attempt to work out the number of employees in different ranges - the code is a horrible mess of side effects: https://gist.github.com/737179 (pmap process-company (take 1500 companies)) results in: Exception in thread "pool-2-thread-3905" java.lang