David Morávek created FLINK-25597:
-------------------------------------

             Summary: Document which URI based config options works with local 
/ general filesystem
                 Key: FLINK-25597
                 URL: https://issues.apache.org/jira/browse/FLINK-25597
             Project: Flink
          Issue Type: Technical Debt
          Components: Documentation, Runtime / Coordination
            Reporter: David Morávek
             Fix For: 1.15.0


>From S3 documentation [1]:

{code}
Note that these examples are not exhaustive and you can use S3 in other places 
as well, including your high availability setup or the 
EmbeddedRocksDBStateBackend; everywhere that Flink expects a FileSystem URI.
{code}

This is not correct, because there are config options such as `web.upload.dir`, 
that don't work with the filesystem abstraction and therefore can be only used 
with the local (java) filesystem. We should document these options with what 
type of filesystem they expect and get rid of the misleading note in s3 
documentation.

Example: https://lists.apache.org/thread/5sqz77nsr5mkzv3r1w114v2x52vyk80c

[1] 
https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/deployment/filesystems/s3/#amazon-s3



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Reply via email to