Re: pyspark + kafka + streaming = NoSuchMethodError

2015-12-18 Thread Christos Mantas
ote: Unless you built your own Spark distribution with Scala 2_11, you want to use the 2.10 dependency : --packages org.apache.spark:spark-streaming-kafka_2.10:1.5.2 On Thu, Dec 17, 2015 at 10:10 AM, Christos Mantas mailto:cman...@cslab.ece.ntua.gr>> wrote: Hello, I am trying

pyspark + kafka + streaming = NoSuchMethodError

2015-12-17 Thread Christos Mantas
Hello, I am trying to set up a simple example with Spark Streaming (Python) and Kafka on a single machine deployment. My Kafka broker/server is also on the same machine (localhost:1281) and I am using Spark Version: spark-1.5.2-bin-hadoop2.6 Python code ... ssc = StreamingContext(sc, 1