What Slows Down clojure-hadoop?

2013-04-26 Thread Ji Zhang
Hi, I'm writing map-reduce job with Clojure, yet to find that it seems to be much slower than a Jave job. So I write a simple test case, and upload to gist: https://gist.github.com/jizhang/5466149 At the end of code, there is execution outputs, here are some significant stats: Average time t

Re: What Slows Down clojure-hadoop?

2013-04-26 Thread Ji Zhang
t this is one of the obvious ones. > > On Friday, April 26, 2013 12:05:33 PM UTC+2, Ji Zhang wrote: >> >> Hi, >> >> I'm writing map-reduce job with Clojure, yet to find that it seems to be >> much slower than a Jave job. >> >> So I write a simple

Re: What Slows Down clojure-hadoop?

2013-04-26 Thread Ji Zhang
s compared to the java > version, once in map (just to call .get), then in reduce. > > There are other issues probably, but this is one of the obvious ones. > > On Friday, April 26, 2013 12:05:33 PM UTC+2, Ji Zhang wrote: >> >> Hi, >> >> I'm writing map

Re: What Slows Down clojure-hadoop?

2013-04-26 Thread Ji Zhang
2013 6:05:33 PM UTC+8, Ji Zhang wrote: > > Hi, > > I'm writing map-reduce job with Clojure, yet to find that it seems to be > much slower than a Jave job. > > So I write a simple test case, and upload to gist: > https://gist.github.com/jizhang/5466149 > > At the

Re: What Slows Down clojure-hadoop?

2013-04-26 Thread Ji Zhang
ng that takes a few minutes at least. > > However, you can help startup time in a number of ways, AOT compilation > can help a bit, as well as judicious use of third-party code and keeping > class dependencies low. > > > On Fri, Apr 26, 2013 at 12:02 PM, Ji Zhang > > wr

Re: What Slows Down clojure-hadoop?

2013-04-28 Thread Ji Zhang
ay, April 26, 2013 6:05:33 PM UTC+8, Ji Zhang wrote: > > Hi, > > I'm writing map-reduce job with Clojure, yet to find that it seems to be > much slower than a Jave job. > > So I write a simple test case, and upload to gist: > https://gist.github.com/jizhang/5466149 &