Israel Ekpo created FLINK-18562:
-----------------------------------
Summary: Add Support for Azure Data Lake Store Gen 2 in Flink File
System
Key: FLINK-18562
URL: https://issues.apache.org/jira/browse/FLINK-18562
Project: Flink
Issue Type: Improvement
Components: Connectors / FileSystem
Affects Versions: 1.12.0
Reporter: Israel Ekpo
Fix For: 1.12.0
The objective of this improvement is to add support for Azure Data Lake Store
Gen 2 (ADLS Gen2) [1] in the Flink File System [2]
This will allow include the abfs(s) scheme/protocol via ADLS Gen2 to be
available as one of the distributed filesystems that can be used for
savepointing, checkpointing, data sources and sinks in Flink jobs.
It will also simplify the implementation of managed identities [3] which is an
added security benefit in environments where system assigned and user assigned
managed identities can be leveraged.
[1] https://hadoop.apache.org/docs/current/hadoop-azure/abfs.html
[2] https://github.com/apache/flink/tree/master/flink-filesystems
[3]
https://hadoop.apache.org/docs/current/hadoop-azure-datalake/index.html#Using_MSI_.28Managed_Service_Identity.29
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
