Re: Help with a table located on s3n

2011-12-16 Thread Ranjan Bagchi
> e: mgro...@oanda.com > > "Best Trading Platform" - World Finance's Forex Awards 2009. > "The One to Watch" - Treasury Today's Adam Smith Awards 2009. > > > - Original Message - > From: "Ranjan Bagchi" > To: user@hive.ap

Re: Help with a table located on s3n

2011-12-16 Thread Mark Grover
fxtrade.com e: mgro...@oanda.com "Best Trading Platform" - World Finance's Forex Awards 2009. "The One to Watch" - Treasury Today's Adam Smith Awards 2009. - Original Message - From: "Ranjan Bagchi" To: user@hive.apache.org Sent: Friday, Dece

Re: Help with a table located on s3n

2011-12-16 Thread Loren Siebert
It sounds like you are using Apache Hive. I don’t think it supports querying data on S3, does it? https://groups.google.com/a/cloudera.org/group/cdh-user/browse_thread/thread/34693af0fa6a9101 On Dec 16, 2011, at 10:43 AM, Ranjan Bagchi wrote: > Following up with more information: > > * The ha

Re: Help with a table located on s3n

2011-12-16 Thread Ranjan Bagchi
Following up with more information: * The hadoop cluster is on EC2, not EMR, but I'll try bringing it up on EMR. * I don't see a job conf on the tracker page -- I'm semi-suspicious it never makes it that far. * Here's the extended explain plan: it doesn't look glaringly wrong. Totally appreciate

Re: Help with a table located on s3n

2011-12-15 Thread Igor Tatarinov
R? If so, it might be worthwhile to post on > AWS forums. > > Mark > > - Original Message - > From: "Ranjan Bagchi" > To: user@hive.apache.org > Sent: Thursday, December 15, 2011 8:30:42 PM > Subject: Help with a table located on s3n > > Hi, > > I

Re: Help with a table located on s3n

2011-12-15 Thread Mark Grover
uot;Ranjan Bagchi" To: user@hive.apache.org Sent: Thursday, December 15, 2011 8:30:42 PM Subject: Help with a table located on s3n Hi, I'm experiencing the following: I've a file on s3 -- s3n://my.bucket/hive/ranjan_test. It's got fields (separated by \001) and records (sepa

Help with a table located on s3n

2011-12-15 Thread Ranjan Bagchi
Hi, I'm experiencing the following: I've a file on s3 -- s3n://my.bucket/hive/ranjan_test. It's got fields (separated by \001) and records (separated by \n). I want it to be accessible on hive, the ddl is: CREATE EXTERNAL TABLE IF NOT EXISTS ranjan_test ( ip_address string, num_counted int )