RE: Checkpoint directories not cleared as TaskManagers run

2022-05-19 Thread Schwalbe Matthias
es Sandys-Lumsdaine Sent: Wednesday, May 18, 2022 2:53 PM To: Schwalbe Matthias Cc: Hangxiang Yu ; user@flink.apache.org Subject: Re: Checkpoint directories not cleared as TaskManagers run Hello Matthias, Thanks for your reply. Yes indeed your are correct. My /tmp path is private so you hav

Re: Checkpoint directories not cleared as TaskManagers run

2022-05-18 Thread James Sandys-Lumsdaine
James. From: Hangxiang Yu mailto:master...@gmail.com>> Sent: 17 May 2022 14:38 To: James Sandys-Lumsdaine mailto:jas...@hotmail.com>>; user@flink.apache.org<mailto:user@flink.apache.org> mailto:user@flink.apache.org>> Subject: Re: Checkpoint direc

RE: Checkpoint directories not cleared as TaskManagers run

2022-05-17 Thread Schwalbe Matthias
jobmanager can not access the checkpoint files of it can also not clean-up those files Hope that helps Regards Thias From: James Sandys-Lumsdaine Sent: Tuesday, May 17, 2022 3:55 PM To: Hangxiang Yu ; user@flink.apache.org Subject: Re: Checkpoint directories not cleared as TaskManagers run

Re: Checkpoint directories not cleared as TaskManagers run

2022-05-17 Thread James Sandys-Lumsdaine
___ From: Hangxiang Yu Sent: 17 May 2022 14:38 To: James Sandys-Lumsdaine ; user@flink.apache.org Subject: Re: Checkpoint directories not cleared as TaskManagers run Hi, James. I may not get what the problem is. All checkpoints will store in the address as you set. IIUC, TMs will write som

Re: Checkpoint directories not cleared as TaskManagers run

2022-05-17 Thread Hangxiang Yu
gt; > If anyone can clarify/correct me I would appreciate. > > James. > -- > *From:* James Sandys-Lumsdaine > *Sent:* 16 May 2022 18:52 > *To:* user@flink.apache.org > *Subject:* Checkpoint directories not cleared as TaskManagers run > >

Re: Checkpoint directories not cleared as TaskManagers run

2022-05-17 Thread James Sandys-Lumsdaine
he.org Subject: Checkpoint directories not cleared as TaskManagers run Hello, I'm seeing my Flink deployment's checkpoint storage directories build up and never clear down. When I run from my own IDE, I see the only the latest "chk-x" directory under the job id folder

Checkpoint directories not cleared as TaskManagers run

2022-05-16 Thread James Sandys-Lumsdaine
Hello, I'm seeing my Flink deployment's checkpoint storage directories build up and never clear down. When I run from my own IDE, I see the only the latest "chk-x" directory under the job id folder. So the first checkpoint is "chk-1", which is then replaced with "chk-2" etc. However, when