hi,
What is the bet way to process a batch window in SparkStreaming :
kafkaStream.foreachRDD(rdd => {
rdd.collect().foreach(event => {
// process the event
process(event)
})
})
Or
kafkaStream.foreachRDD(rdd => {
rdd.map(event => {
// process the event
process(event)
}).collect()
})
thank's
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/spark-streaming-kafa-best-practices-tp20470.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
