Re: Can not import KafkaProducer in spark streaming job

2016-05-02 Thread fanooos
I could solve the issue but the solution is very weird. I run this command cat old_script.py > new_script.py then I submitted the job using the new script. This is the second time I face such issue with python script and I have no explanation to what happened. I hope this trick help someone el

Re: Can not import KafkaProducer in spark streaming job

2016-05-01 Thread أنس الليثي
from the bin directory of spark *./spark-submit --master spark://localhost:7077 /home/anas/spark/historical_streamer.py* On 1 May 2016 at 16:30, Ted Yu wrote: > According to > examples/src/main/scala/org/apache/spark/examples/streaming/KafkaWordCount.scala > : > > import org.apache.kafka.clie

Re: Can not import KafkaProducer in spark streaming job

2016-05-01 Thread Ted Yu
According to examples/src/main/scala/org/apache/spark/examples/streaming/KafkaWordCount.scala : import org.apache.kafka.clients.producer.{KafkaProducer, ProducerConfig, ProducerRecord} Can you give the command line you used to submit the job ? Probably classpath issue. On Sun, May 1, 2016 at 5: