Re: Clojure interop with Spark

2020-07-09 Thread Dominic Parry
Another option is Apache Beam. We use it quite extensively. There are a few options for Clojure wrappers (we use datasplash), and beam has libraries for a number of popular languages. Kind Regards, Dom Parry On 10 Jul 2020, 08:22 +0200, Alex Ott , wrote: > From Spark perspective, I would really

Re: [ANN] thurber: Clojure on Apache Beam (distributed batch/streaming)

2020-01-22 Thread Dominic Parry
nother line of sight for thurber. > > We'd also looked at clj-headlights - this was the other clojure Beam lib we'd > surveyed in this space. > > On Wednesday, January 22, 2020 at 7:30:17 AM UTC-6, Dominic Parry wrote: > > Hi! > > > > Congratulation

Re: [ANN] thurber: Clojure on Apache Beam (distributed batch/streaming)

2020-01-22 Thread Dominic Parry
Hi! Congratulations on the library! It makes me super happy when people build clojure libraries for the Google cloud ecosystem. I wanted to draw your attention to datasplash (https://github.com/ngrunwald/datasplash) which has made a start on this. I thought perhaps you could leverage some of it