[ 
https://issues.apache.org/jira/browse/FLINK-17359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17311956#comment-17311956
 ] 

Chen Qin commented on FLINK-17359:
----------------------------------

[https://github.com/apache/flink/pull/15442]  

> Entropy key is not resolved if flink-s3-fs-hadoop is added as a plugin
> ----------------------------------------------------------------------
>
>                 Key: FLINK-17359
>                 URL: https://issues.apache.org/jira/browse/FLINK-17359
>             Project: Flink
>          Issue Type: Bug
>          Components: FileSystems
>            Reporter: Prem Santosh
>            Assignee: Prem Santosh
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 1.10.1, 1.11.0
>
>
> Using flink 1.10
> I added the flink-s3-fs-hadoop jar in plugins dir but I am seeing the 
> checkpoints paths like 
> {{s3://my_app/__ENTROPY__/app_name-staging/flink/checkpoints/e10f47968ae74934bd833108d2272419/chk-3071}}
>  which means the entropy injection key is not being resolved. After some 
> debugging I found that in the 
> [EntropyInjector|https://github.com/apache/flink/blob/release-1.10.0/flink-core/src/main/java/org/apache/flink/core/fs/EntropyInjector.java#L97]
>  we check if the given fileSystem is of type {{SafetyNetWrapperFileSystem}} 
> and if so we check if the delegate is of type {{EntropyInjectingFileSystem}} 
> but don't check for {{[ClassLoaderFixingFileSystem 
> |https://github.com/apache/flink/blob/release-1.10.0/flink-core/src/main/java/org/apache/flink/core/fs/PluginFileSystemFactory.java#L65]}}
>  which would be the type if S3 file system dependencies are added as a plugin.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to