Re: [ANN] Sparkling, a Clojure-API to Apache Spark.

2016-01-17 Thread Drew R
Hi, Is it possible to run lein repl against standalone spark cluster? I launched cluster on localhost with master at spark://zhmyh-osx.local:7077 and tried to run following commands: (require '[sparkling.conf :as conf]) (require '[sparkling.core :as spark]) (def c (-> (conf/spark-conf)

Re: [ANN] Sparkling, a Clojure-API to Apache Spark.

2015-05-18 Thread Tilak Thapa
Oh yes. Thanks Dmitriy. On Monday, May 18, 2015 at 4:13:09 AM UTC-5, Dmitriy Morozov wrote: > > > Hi Tilak! > > You are trying to call groupByKey on instance of JavaRDD which doesn't > have this method. You need JavaPairRDD which you can create with > spark/map-to-pair. > > Good luck! > > On Wed

Re: [ANN] Sparkling, a Clojure-API to Apache Spark.

2015-05-18 Thread Dmitriy Morozov
Hi Tilak! You are trying to call groupByKey on instance of JavaRDD which doesn't have this method. You need JavaPairRDD which you can create with spark/map-to-pair. Good luck! On Wednesday, January 7, 2015 at 2:23:42 PM UTC+2, chris_betz wrote: > > Hi, > > > we just released Sparkling (https:

Re: [ANN] Sparkling, a Clojure-API to Apache Spark.

2015-05-17 Thread Tilak Thapa
Hi, could anybody please help me to figure out following error with group-by-key fn? (defn sorted-tuple [p f] (if (< (.compareTo p f) 0) (spark/tuple p f) (spark/tuple f p))) (defn tuples-list [[p & frens]] (map #(spark/tuple (sorted-tuple p %) frens) frens)) (->> (spark/paralleliz

[ANN] Sparkling, a Clojure-API to Apache Spark.

2015-01-07 Thread chris_betz
Hi, we just released Sparkling (https://gorillalabs.github.io/sparkling/), our take on an API to Apache Spark. With an eye on speed for very large amounts of data we improved clj-spark and flambo to get us the speed we need for our production environment. See https://gorillalabs.github.io/