Hi team,
I got an issue while integrating with the spark streaming using pyspark, I
did receive the video stream data in a different consumer subscribe to the
same topic.
Works fine with this command : *./kafka-console-consumer.sh
--bootstrap-server <IP_ADDRESS>:9092 --topic spark-streaming-consumer
--from-beginning*
But not with this :
>
def processRecord(record):
print(record)
> sc = SparkContext(master="local[2]",appName="HNStreaming")
sc.setLogLevel('DEBUG')
ssc = StreamingContext(sc, 2)
topic = "spark-stream-message"
kvs = KafkaUtils.createDirectStream(ssc, [topic], {'metadata.broker.list':
> brokers})
kvs.foreachRDD(self.processRecord)
ssc.start()
ssc.awaitTermination()
>
>
Expecting help from your side asap.
Thank you!
--
Regards,
biswajitGhosh