From: Shachar Carmeli
Sent: Tuesday, April 21, 2020 20:46
To: user@flink.apache.org
Subject: Re: Flink incremental checkpointing - how long does data is kept in
the share folder
Hi Yun,
First of all sorry for the naming mistake , it was a typo
How to judge that they
meli
> Sent: Monday, April 20, 2020 15:36
> To: user@flink.apache.org
> Subject: Re: Flink incremental checkpointing - how long does data is kept in
> the share folder
>
> Hi Yum
> I noticed that the some files are related to the checkpoint but are not
> mention
___
From: Shachar Carmeli
Sent: Monday, April 20, 2020 15:36
To: user@flink.apache.org
Subject: Re: Flink incremental checkpointing - how long does data is kept in
the share folder
Hi Yum
I noticed that the some files are related to the checkpoint but are not
mentioned in the metadata file
and s
[1]
> https://ci.apache.org/projects/flink/flink-docs-stable/ops/state/checkpoints.html#directory-structure
>
> Best
> Yun Tang
>
>
> From: Shachar Carmeli
> Sent: Sunday, April 12, 2020 15:32
> To: user@flink.apache.org
> Subject:
April 12, 2020 15:32
To: user@flink.apache.org
Subject: Re: Flink incremental checkpointing - how long does data is kept in
the share folder
Thank you for the quick response
Your answer related to the checkpoint folder that contains the _metadata file
e.g. chk-1829
What about the "shared" fol
ava#L96
>
> Best
> Yun Tang
>
>
> From: Shachar Carmeli
> Sent: Tuesday, April 7, 2020 16:19
> To: user@flink.apache.org
> Subject: Flink incremental checkpointing - how long does data is kept in the
> share folder
>
> We are us
/src/main/java/org/apache/flink/runtime/checkpoint/Checkpoints.java#L96
Best
Yun Tang
From: Shachar Carmeli
Sent: Tuesday, April 7, 2020 16:19
To: user@flink.apache.org
Subject: Flink incremental checkpointing - how long does data is kept in the
share folder
We
We are using Flink 1.6.3 and keeping the checkpoint in CEPH ,retaining only one
checkpoint at a time , using incremental and using rocksdb.
We run windows with lateness of 3 days , which means that we expect that no
data in the checkpoint share folder will be kept after 3-4 days ,Still We see
t
