Re: Forbidded : Error Code: 403

2015-05-18 Thread Mohammad Tariq
Tried almost all the options, but it did not work. So, I ended up creating a new IAM user and the keys of this user are working fine. I am not getting Forbidden(403) exception now, but my program seems to be running infinitely. It's not throwing any exception, but continues to run continuously with

Re: Forbidded : Error Code: 403

2015-05-17 Thread Akhil Das
I think you can try this way also: DataFrame df = sqlContext.load("s3n://ACCESS-KEY:SECRET-KEY@bucket-name/file.avro", "com.databricks.spark.avro"); Thanks Best Regards On Sat, May 16, 2015 at 2:02 AM, Mohammad Tariq wrote: > Thanks for the suggestion Steve. I'll try that out. > > Read the l

Re: Forbidded : Error Code: 403

2015-05-15 Thread Mohammad Tariq
Thanks for the suggestion Steve. I'll try that out. Read the long story last night while struggling with this :). I made sure that I don't have any '/' in my key. On Saturday, May 16, 2015, Steve Loughran wrote: > > > On 15 May 2015, at 21:20, Mohammad Tariq > wrote: > > > > Thank you Ayan and

Re: Forbidded : Error Code: 403

2015-05-15 Thread Steve Loughran
> On 15 May 2015, at 21:20, Mohammad Tariq wrote: > > Thank you Ayan and Ted for the prompt response. It isn't working with s3n > either. > > And I am able to download the file. In fact I am able to read the same file > using s3 API without any issue. > sounds like an S3n config problem.

Re: Forbidded : Error Code: 403

2015-05-15 Thread Mohammad Tariq
Thank you Ayan and Ted for the prompt response. It isn't working with s3n either. And I am able to download the file. In fact I am able to read the same file using s3 API without any issue. On Friday, May 15, 2015, Ted Yu wrote: > Have you verified that you can download the file from bucket-nam

Re: Forbidded : Error Code: 403

2015-05-15 Thread Ted Yu
Have you verified that you can download the file from bucket-name without using Spark ? Seems like permission issue. Cheers > On May 15, 2015, at 5:09 AM, Mohammad Tariq wrote: > > Hello list, > > Scenario : I am trying to read an Avro file stored in S3 and create a > DataFrame out of it

Forbidded : Error Code: 403

2015-05-15 Thread Mohammad Tariq
Hello list, *Scenario : *I am trying to read an Avro file stored in S3 and create a DataFrame out of it using *Spark-Avro* library, but unable to do so. This is the code which I am using : public class S3DataFrame { public static void main(String[] args