Thank you so much for your reply.
I apologise I did not mention multiple savepoint files in my last question.
I understand the part. I did not ask the question (only for one savepoint
file) exactly. When we run a job, we have obviously many savepoint files
(by using a manual command repeatedly)
>
> So, can't we extract all previous savepoint data by using
> ExistingSavepoint?
You can extract all of the data from any specific savepoint. Or nearly all
data, anyway. There is at least one corner case that isn't covered --
ListCheckpointed state -- which has been deprecated and isn't suppor
Hi,
So, can't we extract all previous savepoint data by using
ExistingSavepoint?
Thank you
On Fri, Apr 30, 2021 at 10:25 AM David Anderson
wrote:
> Abdullah,
>
> The example you are studying -- the one using the state processor API --
> can be used with any retained checkpoint or savepo
Abdullah,
The example you are studying -- the one using the state processor API --
can be used with any retained checkpoint or savepoint created while running
the RidesAndFaresSolution job. But this is a very special use of
checkpoints and savepoints that shows how to extract data from them.
Norm
Hi,
Please answer me some of my below question whether my understanding correct
or not, and please answer the direct ask questions.
*Question no 1 (about dependency):*
*What is dependency (in pom.xml) for the org.apache.flink.training?*
I am trying to *import*
org.apache.flink.training.exercise
Abdullah,
ReadRidesAndFaresSnapshot [1] is an example that shows how to use the State
Processor API to display the contents of a snapshot taken while running
RidesAndFaresSolution [2].
Hopefully that will help you get started.
[1]
https://github.com/ververica/flink-training/blob/master/state-pro
Hi,
Thank you for your reply.
I want to read the previous snapshot (if needed) at the time of operation.
In [1], there is a portion:
DataSet listState = savepoint.readListState<>(
"my-uid",
"list-state",
Types.INT);
here, will the function savepoint.readliststate<> () work to read
What is it you're trying to achieve in general? The JavaDoc of
MetadataV2V3SerializerBase provides a description on the format of the
file. Theoretically, you could come up with custom code using the Flink
sources to parse the content of the file. But maybe, there's another way to
accomplish what y
Hi,
I have a savepoint or checkpointed file from my task. However, the file is
binary. I want to see what the file contains.
How is it possible to see what information the file has (or how it is
possible to make it human readable?)
Thank you
On Thu, Apr 22, 2021 at 10:19 AM Matthias Pohl
wrote
Hi Abdullah,
the metadata file contains handles to the operator states of the checkpoint
[1]. You might want to have a look into the State Processor API [2].
Best,
Matthias
[1]
https://github.com/apache/flink/blob/adaaed426c2e637b8e5ffa3f0d051326038d30aa/flink-runtime/src/main/java/org/apache/fli
10 matches
Mail list logo
