I was looking into the question raised in the "Question about pmap" thread, and noticed that on my Mac and on a Linux virtual machine, a recent git version of clojure (about 1 week old) seems to use more parallelism in 'pmap' than its source code in core.clj would imply is the intent. The code there seems to imply that the desired number of threads to run at once is 2 more than the number of available processors. However, when I run it, it always fires off one thread for every element of the collection, right at the beginning, regardless of the number of available processors.
I created my own slightly modified version of pmap, where the only difference is that the version of 'map' used has been changed to 'my- lazy-map', which is explicitly lazy. See this link for the source code of the test I was using. Ignore modified-pmap1. Look at modified-pmap2. http://github.com/jafingerhut/clojure-benchmarks/blob/0227501c6c53736db05facd647c09e1d4e9e77b3/misc/pmap-testing.clj You can try this out on your system with a command line like this: clj pmap-test.clj 10 100000000 You might need to adjust the second number to be more or less, depending upon the speed of your machine. It would be good to make it take at least a couple of seconds. The first number is the length of the collection over which map/pmap is run, and for most obvious results should be about 3 to 4 times the number of processors on your machine. I suspect that the issue is that the version of map used by pmap in core.clj is eager, i.e. not lazy, and thus all of the called to future are performed as soon as the last of these lines in the pmap function is executed: (defn pmap ;; doc string deleted for brevity ([f coll] (let [n (+ 2 (.. Runtime getRuntime availableProcessors)) rets (map #(future (f %)) coll) but I don't know yet where the implementation of map that is "active" at that point in the source code is. Perhaps it is implemented in Java? Andy --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "Clojure" group. To post to this group, send email to clojure@googlegroups.com Note that posts from new members are moderated - please be patient with your first post. To unsubscribe from this group, send email to clojure+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/clojure?hl=en -~----------~----~----~----~------~----~------~--~---
