Re: Using Hadoop 2.8.0 in Flink Project for S3A Path Style Access

2017-08-10 Thread Mustafa AKIN
e did that with a possible Flink 1.3.3 release and >> starting from Flink 1.4.0, would this be an option for you? >> >> Best, >> Aljoscha >> >> On 11. Jul 2017, at 10:47, Mustafa AKIN wrote: >> >> Hi all, >> >> I am trying to use S3 b

Using Hadoop 2.8.0 in Flink Project for S3A Path Style Access

2017-07-11 Thread Mustafa AKIN
Hi all, I am trying to use S3 backend with custom endpoint. However, it is not supported in hadoop-aws@2.7.3, I need to use at least 2.8.0 version. The underyling reason is that the requests are being sent as following DEBUG [main] (AmazonHttpClient.java:337) - Sending Request: HEAD http://mustaf