Re: checkpoints/.../shared cleanup

2021-10-09 Thread Alexey Trenikhun
From: Roman Khachatryan Sent: Friday, October 1, 2021 8:51:31 AM To: Alexey Trenikhun Cc: Matthias Pohl ; Flink User Mail List ; sjwies...@gmail.com Subject: Re: checkpoints/.../shared cleanup Hi Alexey, Thanks for sharing this information. I also don't see anything suspicious i

Re: checkpoints/.../shared cleanup

2021-10-01 Thread Roman Khachatryan
not > tracking them > > Thanks, > Alexey > > From: Roman Khachatryan > Sent: Monday, September 6, 2021 4:20 PM > To: Alexey Trenikhun > Cc: Matthias Pohl ; Flink User Mail List > ; sjwies...@gmail.com > Subject: Re: checkpoints/..

Re: checkpoints/.../shared cleanup

2021-09-06 Thread Roman Khachatryan
atryan Roman > Sent: Monday, August 30, 2021 7:16 AM > To: Alexey Trenikhun > Cc: Matthias Pohl ; Flink User Mail List > ; sjwies...@gmail.com > Subject: Re: checkpoints/.../shared cleanup > > Hi, > > I think the documentation is correct. Once the job is stopped with &g

Re: checkpoints/.../shared cleanup

2021-08-31 Thread Alexey Trenikhun
I'm running Flink in Application Mode and set jobId explicitly From: Khachatryan Roman Sent: Monday, August 30, 2021 7:16 AM To: Alexey Trenikhun Cc: Matthias Pohl ; Flink User Mail List ; sjwies...@gmail.com Subject: Re: checkpoints/.../shared cleanup H

Re: checkpoints/.../shared cleanup

2021-08-30 Thread Khachatryan Roman
___ > From: Alexey Trenikhun > Sent: Thursday, August 26, 2021 6:37:27 PM > To: Matthias Pohl > Cc: Flink User Mail List ; sjwies...@gmail.com > > Subject: Re: checkpoints/.../shared cleanup > > Hi Matthias, > > I don't use externalized checkpoin

Re: checkpoints/.../shared cleanup

2021-08-26 Thread Alexey Trenikhun
t ; sjwies...@gmail.com Subject: Re: checkpoints/.../shared cleanup Hi Matthias, I don't use externalized checkpoints (from Flink UI Persist Checkpoints Externally: Disabled), why do you think checkpoint(s) should be retained? It kind of contradicts with documentation [1] - Checkpoints are

Re: checkpoints/.../shared cleanup

2021-08-26 Thread Alexey Trenikhun
pointing is enabled, managed state is persisted to ensure ... ci.apache.org Thanks, Alexey From: Matthias Pohl Sent: Thursday, August 26, 2021 5:42 AM To: Alexey Trenikhun Cc: Flink User Mail List ; sjwies...@gmail.com Subject: Re: checkpoints/.../shared cleanup

Re: checkpoints/.../shared cleanup

2021-08-26 Thread Matthias Pohl
Hi Alexey, thanks for reaching out to the community. I have a question: What do you mean by "the shared subfolder still grows"? As far as I understand, the shared folder contains the state of incremental checkpoints. If you cancel the corresponding job and start a new job from one of the retained i

checkpoints/.../shared cleanup

2021-08-24 Thread Alexey Trenikhun
Hello, I use incremental checkpoints, not externalized, should content of checkpoint/.../shared be removed when I cancel job (or cancel with savepoint). Looks like in our case shared continutes to grow... Thanks, Alexey