Re: Local blobStore not freed

2019-06-11 Thread Dede
Thanks Tison for looking into it - what I tried to say is that Flink keeps the files locked (hence, the space is still occupied) - this is visible during a lsof command >From my investigations, after the job finishes, the local (and HA) blob store is deleted - the operation succeed in both case,

Re: Local blobStore not freed

2019-06-11 Thread Zili Chen
Hi Dan, Said "The files are removed after a restart of the process", it sounds Flink cleaned up blobs properly. From your description I don't understand clearly in which case/situation you expected Flink deleted blobs but it doesn't. Could you describe the difference between 1.4.2 and 1.7.2/1.8.0

Local blobStore not freed

2019-06-11 Thread Dede
Hi Team, I'm struggling for a while with a strange issue: the local blob store files are not actually deleted from the job manager/task manager in versions 1.7.2 and 1.8.0 : lsof commands shows them like this: java6528 root 63r REG 202,16 162458786 1802248 /mnt/tmp1/blobStore-542f