FYI: Seth starting a FLIP for adding a savepoint connector that addresses
this -
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/Discuss-FLIP-43-Savepoint-Connector-td29233.html
Please join the discussion there if you are interested!
On Thu, Mar 28, 2019 at 5:23 PM Tzu-Li (Gordon)
Thanks Gordon. We already have 5 people watching it. :-)
On Thu, Mar 28, 2019 at 10:23 AM Tzu-Li (Gordon) Tai
wrote:
>
> @Ufuk
>
> Yes, creating a JIRA now already to track this makes sense.
>
> I've proceeded to open one: https://issues.apache.org/jira/browse/FLINK-12047
> Let's move any furthe
@Ufuk
Yes, creating a JIRA now already to track this makes sense.
I've proceeded to open one:
https://issues.apache.org/jira/browse/FLINK-12047
Let's move any further discussions there.
Cheers,
Gordon
On Thu, Mar 28, 2019 at 5:01 PM Ufuk Celebi wrote:
> I think such a tool would be really val
+1
On Thu, Mar 28, 2019, 5:01 AM Ufuk Celebi wrote:
> I think such a tool would be really valuable to users.
>
> @Gordon: What do you think about creating an umbrella ticket for this
> and linking it in this thread? That way, it's easier to follow this
> effort. You could also link Bravo and Set
I think such a tool would be really valuable to users.
@Gordon: What do you think about creating an umbrella ticket for this
and linking it in this thread? That way, it's easier to follow this
effort. You could also link Bravo and Seth's tool in the ticket as
starting points.
– Ufuk
Hi!
Regarding the support for savepoint reading / writing / processing directly
in core Flink, we've been thinking about that lately and might push a bit
for adding the functionality to Flink in the next release.
For example, beside Bravo, Seth (CC'ed) also had implemented something [1]
for this.
Hi!
I dont think there is any ongoing effort in core Flink other than this
library we created.
You are probably right that it is pretty hacky at the moment. I would say
this one way we could do it that seemed convenient to me at the time I have
written the code.
If you have ideas how to structur
What are the plans to support savepoint state manipulation with batch jobs
natively in core Flink?
I've tried using the bravo tool [1]. It's pretty good at reading
savepoints, but writing seems hacky. For example I wonder what exactly
happens with the following lines:
val newOpState = writer.writ
