Hi Konstantin,
This looks fine. Generally it is fine to delete Blobs in /tmp once the
Job is running or has finished. When the job is running, the Flink
classloader has already opened these files. Thus, the file system will
still have these available through the file descriptor and defer
deletion
Hi Ufuk,
any ideas? Any configuration that could be wrong?
Cheers,
Konstantin
On 30.09.2016 13:13, Konstantin Knauf wrote:
> Hi Ufuk,
>
> thanks for your quick answer.
>
> Setup: 2 Servers, each running a JM as well as TM
>
> 1) Removing all existing blobstores locally (/tmp) as well as on H
Hi Ufuk,
thanks for your quick answer.
Setup: 2 Servers, each running a JM as well as TM
1) Removing all existing blobstores locally (/tmp) as well as on HDFS
2) Starting a flink streaming job
Now there are the following BLOBs:
Local:
*Leader JM:
4.0K/tmp/blobStore-563a8820-9617-4d89-97a
On Fri, Sep 30, 2016 at 9:12 AM, Konstantin Knauf
wrote:
> we are running a Flink (1.1.2) Stand-Alone Cluster with JM HA, and HDFS
> as checkpoint and recovery storage dir. What we see is that blobStores
> are stored in HDFS as well as under the local Jobmanagers and
> Taskmanagers /tmp directory.
