Spark structured steaming from kafka - last message processed again after resume from checkpoint

/blob/3f62e1b5d9e75dc07bac3aa4db3e8d0615cc3cc3/sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamExecution.scala#L290, I don't understand why you are resuming with an already committed offset (the one from currrentBatchId - 1) Thanks, Niek. -- View this message in context: http://apache-spark-devel

Re: Spark structured steaming from kafka - last message processed again after resume from checkpoint

Cool thanks! -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Spark-structured-steaming-from-kafka-last-message-processed-again-after-resume-from-checkpoint-tp20353p20357.html Sent from the Apache Spark Developers List mailing list archive at Nabble.com