Re: Using Azure Blob Storage with Flink

There is HADOOP-14753 which is still Open. FYI On Tue, Aug 29, 2017 at 3:41 PM, Joshua Griffith wrote: > Yes, hadoop-azure and azure-storage are both on the classpath. > hadoop-azure is declared as a dependency in my build.sbt file and I’m using > assembly to copy all of the dependencies into a

Re: Using Azure Blob Storage with Flink

Yes, hadoop-azure and azure-storage are both on the classpath. hadoop-azure is declared as a dependency in my build.sbt file and I’m using assembly to copy all of the dependencies into a single jar which is submitted to Flink. I suspect the wasb format needs to be explicitly registered with Hado

Re: Using Azure Blob Storage with Flink

Was hadoop-azure jar on the classpath ? Please also see the following from https://hadoop.apache.org/docs/current/hadoop-azure/index.html : The built jar file, named hadoop-azure.jar, also declares transitive dependencies on the additional artifacts it requires, notably the Azure Storage SDK for

Using Azure Blob Storage with Flink

I’m attempting to write to Azure Blob Storage using Flink's FileOutputFormat. I’ve included hadoop-azure within the jar I submit to Flink and configured the paths to be prefixed with wasb://{CONTAINERNAME}@{