Re: Spark Streaming with Redis

2016-05-24 Thread Pariksheet Barapatre
Thanks Sachin. Link that you mentioned uses native connection library JedisPool. I am looking if I can use https://github.com/RedisLabs/spark-redis for same functionality. Regards Pari On 24 May 2016 at 13:33, Sachin Aggarwal wrote: > Hi, > > yahoo benchmark uses redis with spark, > > have a l

Re: Spark Streaming with Redis

2016-05-24 Thread Sachin Aggarwal
Hi, yahoo benchmark uses redis with spark, have a look at this https://github.com/yahoo/streaming-benchmarks/blob/master/spark-benchmarks/src/main/scala/AdvertisingSpark.scala On Tue, May 24, 2016 at 1:28 PM, Pariksheet Barapatre wrote: > Hello All, > > I am trying to use Redis as a data stor

Spark Streaming with Redis

2016-05-24 Thread Pariksheet Barapatre
Hello All, I am trying to use Redis as a data store for one of sensor data use cases and I am fairly new to Redis. I guess spark-redis module can help me, but I am not getting how to use INCR or HINCRBY redis functions. Could you please help me to get some example codes or any pointers to solve

Spark streaming with Redis? Working with large number of model objects at spark compute nodes.

2014-06-16 Thread tnegi
.1001560.n3.nabble.com/Spark-streaming-with-Redis-Working-with-large-number-of-model-objects-at-spark-compute-nodes-tp7663.html Sent from the Apache Spark User List mailing list archive at Nabble.com.