Hai Zhou created FLINK-9525:
-------------------------------
Summary: Missing META-INF/services/*FileSystemFactory in
flink-hadoop-fs module
Key: FLINK-9525
URL: https://issues.apache.org/jira/browse/FLINK-9525
Project: Flink
Issue Type: Bug
Components: FileSystem
Affects Versions: 1.5.0, 1.4.0
Reporter: Hai Zhou
Assignee: Hai Zhou
Fix For: 1.5.1
Attachments: wx20180605-142...@2x.png
if flink job dependencies includes `hadoop-common` and `hadoop-hdfs`, throw
runtime error.
like this case:
[https://stackoverflow.com/questions/47890596/java-util-serviceconfigurationerror-org-apache-hadoop-fs-filesystem-provider-o].
the root cause:
see {{org.apache.flink.core.fs.FileSystem}}
This class will load all available file system factories via
{{ServiceLoader.load(FileSystemFactory.class)}}.
Because {{META-INF / services / org.apache.flink.core.fs.FileSystemFactory}}
file in the classpath does not have an
`org.apache.flink.runtime.fs.hdfs.HadoopFsFactory`,
so just only loaded one available {{LocalFileSystemFactory}} .
more error messages see this screenshot.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
