I see. Thanks!
From: Steve Loughran mailto:ste...@hortonworks.com>>
Date: Friday, October 30, 2015 at 12:03 PM
To: William Li mailto:a-...@expedia.com>>
Cc: "Zhang, Jingyu"
mailto:jingyu.zh...@news.com.au>>, user
mailto:user@spark.apache.org>>
Subject: Re: Sav
On 30 Oct 2015, at 18:05, William Li
mailto:a-...@expedia.com>> wrote:
Thanks for your response. My secret has a back splash (/) so it didn’t work…
that's a recurrent problem with the hadoop/java s3 clients. Keep trying to
regenerate a secret until you get one that works
Thanks for your response. My secret has a back splash (/) so it didn't work...
From: "Zhang, Jingyu"
mailto:jingyu.zh...@news.com.au>>
Date: Thursday, October 29, 2015 at 5:16 PM
To: William Li mailto:a-...@expedia.com>>
Cc: user mailto:user@spark.apache.org>>
Su
Try s3://aws_key:aws_secret@bucketName/folderName with your access key and
secret to save the data.
On 30 October 2015 at 10:55, William Li wrote:
> Hi – I have a simple app running fine with Spark, it reads data from S3
> and performs calculation.
>
> When reading data from S3, I use hadoopConf
