Re: Replacing S3 Client in Hadoop plugin

2021-11-23 Thread Martijn Visser
S3ClientFactory.java#L66 > > [5] > https://github.com/apache/hadoop/blob/branch-3.2.2/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3ClientFactory.java > > Best, > Tamir. > > ------------------ > *From:* Martijn Visser > *Sent:* Wednesd

Replacing S3 Client in Hadoop plugin

2021-11-19 Thread Tamir Sagi
ser Sent: Wednesday, October 13, 2021 8:28 PM To: Tamir Sagi ; user@flink.apache.org Subject: Re: Replacing S3 Client in Hadoop plugin EXTERNAL EMAIL Hi, Could you elaborate on why you would like to replace the S3 client? Best regards, Martijn On Wed, 13 Oct 2021 at 17:18, Tamir

Re: Replacing S3 Client in Hadoop plugin

2021-10-13 Thread Martijn Visser
possible, there is a method > setAmazonS3Client > > I think I found the solution. > > Thanks. > > Tamir. > > -- > *From:* Tamir Sagi > *Sent:* Wednesday, October 13, 2021 5:44 PM > *To:* user@flink.apache.org > *Subject:* Replacing S3 Client in Had

Re: Replacing S3 Client in Hadoop plugin

2021-10-13 Thread Tamir Sagi
@flink.apache.org Subject: Replacing S3 Client in Hadoop plugin Hey community. I would like to know if there is any way to replace the S3 client in Hadoop plugin[1] to a custom client(AmazonS3). I did notice that Hadoop plugin supports replacing the implementation of S3AFileSystem using "fs.s3a.impl

Replacing S3 Client in Hadoop plugin

2021-10-13 Thread Tamir Sagi
Hey community. I would like to know if there is any way to replace the S3 client in Hadoop plugin[1] to a custom client(AmazonS3). I did notice that Hadoop plugin supports replacing the implementation of S3AFileSystem using "fs.s3a.impl" (in flink-conf.yaml it will be "s3.impl") but not the cli