om the old
> checkpoints, one would need to keep the old app and the new app running
> until new app catches up on data processing with the old app.
>
>
> - Original message -
> From: Tathagata Das
> To: Priyank Shrivastava
> Cc: user
> Subject: Re: [Structured
Why do you want to start the new code in parallel to the old one? Why not
stop the old one, and then start the new one? Structured Streaming ensures
that all checkpoint information (offsets and state) are future-compatible
(as long as state schema is unchanged), hence new code should be able to
pic
I am using Structured Streaming with Spark 2.2. We are using Kafka as our
source and are using checkpoints for failure recovery and e2e exactly once
guarantees. I would like to get some more information on how to handle
updates to the application when there is a change in stateful operations
and/
