On Friday, December 14, 2012 5:41:59 AM UTC+11, Wm. Josiah Erikson wrote:
>
> Does this help? Should I do something else as well? I'm curious to try
> running like, say 16 concurrent copies on the 48-way node....
>
> Have you made any progress on a small deterministic benchmark that
reflects your applications behaviour (ie. the RNG seed work you were
discussing)? I'm keen to help, but I don't have time to look at benchmarks
that take hours to run.
I've also been using clojure for genetic programming and have been getting
very good parallel speedups on a single jvm, this type of problem should
see excellent performance gains, it has many medium size cpu intensive
sub-problems that require no shared resources. I used hadoop to scale
beyond single machines, in the worst case you can use this approach and you
should see speed-ups equivalent to your multiple jvm test. I just split the
population into small blocks and had each map function calculate the
fitness and return a map of individual-id -> fitness.
Cameron.
--
You received this message because you are subscribed to the Google
Groups "Clojure" group.
To post to this group, send email to [email protected]
Note that posts from new members are moderated - please be patient with your
first post.
To unsubscribe from this group, send email to
[email protected]
For more options, visit this group at
http://groups.google.com/group/clojure?hl=en
