Hi,
can you see whether using the option for checkPointLocation would work in
case you are using structured streaming?
Regards,
Gourav Sengupta
On Tue, Jul 24, 2018 at 12:30 PM, John, Vishal (Agoda) <
vishal.j...@agoda.com.invalid> wrote:
>
> Hello all,
>
>
> I have to read data from Kafka top
Hello all,
I have to read data from Kafka topic at regular intervals. I create the
dataframe as shown below. I don’t want to start reading from the beginning on
each run. At the same time, I don’t want to miss the messages between run
intervals.
val queryDf = sqlContext
.read
.format("k
