Hi Brian, On Friday, 25 January 2019 22:19:21 UTC, Brian Craft wrote: > > Are there any docs on transducer parallelism? >
Not a lot, but you can find something here: https://labs.uswitch.com/transducers-from-the-ground-up-the-practice/#parallelism I had the impression, from various sources, that they could operate in > parallel, but in doing some benchmarks over a largish collection (counting > character frequencies in 1.3M strings), transduce never uses more than one > thread. Is this expected? If not, how would one debug it? > Yes it is expected, core/transduce is not designed to run in parallel. But there are ways to run transducers with r/fold or pipelines (see article above) with restrictions related to stateful transducers. If you have a specific problem in mind, I suggest you give a look at https://github.com/reborg/parallel and see if there is a function you can use (such as p/frequencies on strings). That library is also taking care of other details, such as using mutable-concurrent collections internally to speed up performance. Hope this helps Renzo -- You received this message because you are subscribed to the Google Groups "Clojure" group. To post to this group, send email to clojure@googlegroups.com Note that posts from new members are moderated - please be patient with your first post. To unsubscribe from this group, send email to clojure+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/clojure?hl=en --- You received this message because you are subscribed to the Google Groups "Clojure" group. To unsubscribe from this group and stop receiving emails from it, send an email to clojure+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
