Re: Can't get Spark to interface with S3A Filesystem with correct credentials

2020-03-05 Thread Devin Boyer
doop.fs.s3a.S3AFileSystem > fs.AbstractFileSystem.s3.impl=org.apache.hadoop.fs.s3a.S3A > fs.AbstractFileSystem.s3a.impl=org.apache.hadoop.fs.s3a.S3A > > Hadoop 2.8 and above would have these set by default. > > Thanks, > Hariharan > > On Thu, Mar 5, 2020 at 2:41 AM Devin Boyer > wrote: >

Can't get Spark to interface with S3A Filesystem with correct credentials

2020-03-04 Thread Devin Boyer
d didn't see much that was particularly useful, but happy to share additional log output too. Thanks for any help you can provide! Best, Devin Boyer