I have successfully connected Azure blob storage to Flink-1.1.
Below are the steps necessary:
- Add hadoop-azure-2.7.2.jar (assuming you are using a Hadoop 2.7 Flink
binary) and azure-storage-4.3.0.jar to /lib, and set file
permissions / ownership accordingly.
- Add the following to a file 'core-s
Hello Ufuk,
Thanks for your swift reply.
Those are essentially the steps I took for Drill. I am happy to report back
with my success, or otherwise.
Mikkel
On Tue, Aug 16, 2016 at 12:40 PM, Ufuk Celebi wrote:
> You should be able to follow this:
>
> http://mail-archives.apache.org/mod_mbox/dril
You should be able to follow this:
http://mail-archives.apache.org/mod_mbox/drill-user/201512.mbox/%3CCAAL5oQJQRgqO5LjhG_=YFLyHuZUNqEvm3VX3C=2d9uxnbto...@mail.gmail.com%3E
It's similar to the AWS S3 config
(https://ci.apache.org/projects/flink/flink-docs-master/setup/aws.html).
Add the Azure JAR
Hello,
I would like to access data in Azure blob storage from Flink, via the Azure
storage HDFS-compatibility interface.
That is feasible from Apache Drill, and I am thinking something similar
should be doable from Flink. A documentation page on eternal storage
connectors for Flink exist, but it w
