Re: Access S3 buckets in multiple accounts

2016-09-28 Thread Daniel Siegmann
values is sufficient to > get access to the other account (using the s3a protocol), however I then > won't have access to the S3 bucket in the EMR cluster's AWS account. > > Is there any way for Spark to access S3 buckets in multiple accounts? If > not, is there

Re: Access S3 buckets in multiple accounts

2016-09-28 Thread Steve Loughran
ues is sufficient to get access to the other account (using the s3a protocol), however I then won't have access to the S3 bucket in the EMR cluster's AWS account. Is there any way for Spark to access S3 buckets in multiple accounts? If not, is there any best practice for how to work aroun

Re: Access S3 buckets in multiple accounts

2016-09-28 Thread Eike von Seggern
Hi Teng, 2016-09-28 10:42 GMT+02:00 Teng Qiu : > hmm, i do not believe security group can control s3 bucket access... is > this something new? or you mean IAM role? > You're right, it's not security groups but you can configure a VPC endpoint for the EMR-Cluster and grant access rights for this

Re: Access S3 buckets in multiple accounts

2016-09-28 Thread Teng Qiu
.key values is sufficient to >> get access to the other account (using the s3a protocol), however I then >> won't have access to the S3 bucket in the EMR cluster's AWS account. >> >> Is there any way for Spark to access S3 buckets in multiple accounts? If >> not

Re: Access S3 buckets in multiple accounts

2016-09-28 Thread Eike von Seggern
AWS account. > > Is there any way for Spark to access S3 buckets in multiple accounts? If > not, is there any best practice for how to work around this? > > -- > Daniel Siegmann > Senior Software Engineer > *SecurityScorecard Inc

Access S3 buckets in multiple accounts

2016-09-27 Thread Daniel Siegmann
have access to the S3 bucket in the EMR cluster's AWS account. Is there any way for Spark to access S3 buckets in multiple accounts? If not, is there any best practice for how to work around this? -- Daniel Siegmann Senior Software Engineer *SecurityScorecard Inc.* 214 W 29th Street, 5th Floo