AMAZON EMR : Using Client Side Encryption for files in S3 buckets and Hive

Hi guys I have a file in S3 bucket that I have encrypted using client encryption. How do I pass the KEY to Hive so that it can decrypt the file in S3 and then use those for the MR jobs ? Thanks Warm Regards Sanjay From: Blaine Elliott mailto:bla...@chegg.com>> Reply-To: mailto:user@hive.apa

Re: Joins between databases

Noted for future queries, and thanks for the help! Works like a charm :). Best, -- Oliver Keyes Product Analyst Wikimedia Foundation On 6 February 2014 17:09, Stephen Sprague wrote: > ahh. we got ourselves a bona-fide head banger. Welcome to the club!! :) > > select > a.col1 as foo, >

distributed cache

Hi, My all hive jobs require "mongodb-java-driver, mongo-hadoop-core, mongo-hadoop-hive" jars to successfully execute. I don't have cluster access to copy these jars. So I use distributed cache (add jar ) for every job to make available these jars for M/R tasks. Because of this approach my use

Re: Joins between databases

ahh. we got ourselves a bona-fide head banger. Welcome to the club!! :) select a.col1 as foo, a.col2 as bar, a.col3 as baz from database1.table1 a INNER JOIN database2.table2 b on a.col1 = b.col1 where a.year = 2014 and a.month = 1 and a.day = 20 so lose the 'A

Joins between databases

Hey all, So, I'm new to hive (I come to it from MySQL/MariaDB) and I've spent the last couple of days banging my head against the problem of trying to retrieve data from a join of two tables in different databases. I understand that the db.table.column syntax is not supported in hive, and that ins

Re: How can I just find out the physical location of a partitioned table in Hive

Thank you. That worked perfect for me. Sent from my iPhone > On Feb 6, 2014, at 1:45 PM, Edward Capriolo wrote: > > Describe formatted gives you information on the location. > > I believe you can do > describe formatted > describe formated partition > > >> On Thu, Feb 6, 2014 at 1:43 P

Re: How can I just find out the physical location of a partitioned table in Hive

That doesn't show the hdfs location . Isn't it ? I tried . Sent from my iPhone > On Feb 6, 2014, at 1:24 PM, Brad Ruderman wrote: > > desc extended "table name" > > Thanks, > Brad > > >> On Thu, Feb 6, 2014 at 10:23 AM, Raj Hadoop wrote: >> Hi, >> >> How can I just find out the physical lo

Re: How can I just find out the physical location of a partitioned table in Hive

Describe formatted gives you information on the location. I believe you can do describe formatted describe formated partition On Thu, Feb 6, 2014 at 1:43 PM, Hadoop Raj wrote: > That doesn't show the hdfs location . Isn't it ? I tried . > > Sent from my iPhone > > On Feb 6, 2014, at 1:24 PM

Re: How can I just find out the physical location of a partitioned table in Hive

desc extended "table name" Thanks, Brad On Thu, Feb 6, 2014 at 10:23 AM, Raj Hadoop wrote: > Hi, > > How can I just find out the physical location of a partitioned table in > Hive. > > Show partitions > > gives me just the partition column info. > > I want the location of the hdfs directory

How can I just find out the physical location of a partitioned table in Hive

Hi, How can I just find out the physical location of a partitioned table in Hive. Show partitions gives me just the partition column info. I want the location of the hdfs directory / files where the table is created. Please advise. Thanks, Raj

Fwd: Coonecting Apache Hive using Kerberos authentication

I want to connect Apache Hive using kerberos authentication. I've successfully connected PostgreSQL database with kerberos, and followed similar steps for Apache Hive, but getting exception. If someone has tried this, Please share the configuration files and steps. Below are the details: Connecti