es Sandys-Lumsdaine
Sent: Wednesday, May 18, 2022 2:53 PM
To: Schwalbe Matthias
Cc: Hangxiang Yu ; user@flink.apache.org
Subject: Re: Checkpoint directories not cleared as TaskManagers run
Hello Matthias,
Thanks for your reply. Yes indeed your are correct. My /tmp path is private so
you hav
James.
From: Hangxiang Yu mailto:master...@gmail.com>>
Sent: 17 May 2022 14:38
To: James Sandys-Lumsdaine mailto:jas...@hotmail.com>>;
user@flink.apache.org<mailto:user@flink.apache.org>
mailto:user@flink.apache.org>>
Subject: Re: Checkpoint direc
jobmanager can not access the checkpoint files of it can also not
clean-up those files
Hope that helps
Regards
Thias
From: James Sandys-Lumsdaine
Sent: Tuesday, May 17, 2022 3:55 PM
To: Hangxiang Yu ; user@flink.apache.org
Subject: Re: Checkpoint directories not cleared as TaskManagers run
___
From: Hangxiang Yu
Sent: 17 May 2022 14:38
To: James Sandys-Lumsdaine ; user@flink.apache.org
Subject: Re: Checkpoint directories not cleared as TaskManagers run
Hi, James.
I may not get what the problem is.
All checkpoints will store in the address as you set.
IIUC, TMs will write som
Hi, James.
I may not get what the problem is.
All checkpoints will store in the address as you set.
IIUC, TMs will write some checkpoint info in their local dir and then
upload them to the address and then delete local one.
JM will write some metas of checkpoint to the address and also do the
entir
Some further Googling says on a StackOverflow posting it is the jobmanager that
does the deletion and not the taskmanagers.
Currently my taskmanagers are writing their checkpoints to their own private
disks (/tmp) rather than a share - so my suspicion is the jobmanager can't
access the folder o
