Chesnay Schepler created FLINK-9366:
---------------------------------------
Summary: Distribute Cache only works for client-accessible files
Key: FLINK-9366
URL: https://issues.apache.org/jira/browse/FLINK-9366
Project: Flink
Issue Type: Bug
Components: Client, Local Runtime
Affects Versions: 1.5.0
Reporter: Chesnay Schepler
Fix For: 1.5.0
In FLINK-8620 the distributed cache was modified to the distribute files via
the blob store, instead of downloading them from a distributed filesystem.
Previously, taskmanagers would download requested files from the DFS. Now, they
retrieve it form the blob store. This requires the client to preemptively
upload all files used with distributed cache.
As a result it is no longer possible to use the distributed cache for files
that reside in a cluster-internal DFS, as the client cannot download it. This
is a regression from the previous behavior and may break existing setups.
[~aljoscha] [~dawidwys]
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
