Re: [DISCUSS] Adding Azure Platform Support in DataStream, Table and SQL Connectors

2020-07-24 Thread Robert Metzger
Great! Looking forward to your first pull request. I agree that having a connector in Flink's codebase will probably help it's adoption. However, we are careful with the connectors we are adding to Flink for the following reasons: a) The Flink project is lacking people to maintain all connectors,

Re: [DISCUSS] Adding Azure Platform Support in DataStream, Table and SQL Connectors

2020-07-23 Thread Israel Ekpo
Thanks for the guidance Robert. I appreciate the prompt response and will share the pull requests for the ADLS support [2] next week. Regarding the additional, I would like to contribute them to the main codebase [1] if possible I initially thought maybe it is better to start outside the core cod

Re: [DISCUSS] Adding Azure Platform Support in DataStream, Table and SQL Connectors

2020-07-23 Thread Robert Metzger
Hi Israel, thanks a lot for reaching out! I'm very excited about your efforts to bring additional Azure support into Flink. There are ~50 threads on the user@ mailing list mentioning Azure -- that's good evidence that our users use Flink in Azure. Regarding your questions: Do I need to create a

[DISCUSS] Adding Azure Platform Support in DataStream, Table and SQL Connectors

2020-07-22 Thread Israel Ekpo
I have opened the following issues to track new efforts to bring additional Azure Support in the following areas to the connectors ecosystem. My goal is to add the first two features [FLINK-18562] and [FLINK-18568] to the existing file system capabilities [1] and then have the other connectors FLI