Re: hive/hbase integration

Brian, I'm successfully using Hive/Hbase integration on CDH5 (Hive 0.12.0 and Hbase 0.96.1) Can you explain your setup and configuration in details? Cheers, Andre' On 24 June 2014 02:14, Brian Jeltema wrote: > I’m running Hive 0.12 on Hadoop V2 (Ambari installation) and have been > trying to

Re: [ANNOUNCE] New Hive Committers - Gopal Vijayaraghavan and Szehon Ho

Congrats! On Sun, Jun 22, 2014 at 8:42 PM, Carl Steinbach wrote: > The Apache Hive PMC has voted to make Gopal Vijayaraghavan and Szehon Ho > committers on the Apache Hive Project. > > Please join me in congratulating Gopal and Szehon! > > Thanks. > > - Carl >

Re: how to load json with nested array into hive?

Hi, Use 1.9.3 Jason serde with dependencies jar. Its the latest one I suppose. Thanks Swagatika On Jun 23, 2014 11:57 PM, "Roberto Congiu" wrote: > Hi, > 1.1.4 is a oldish version of the JSON serde, have you tried with the most > recent from the master branch ? > > > On Mon, Jun 23, 2014 at 10:2

Re: how to load json with nested array into hive?

Hi, 1.1.4 is a oldish version of the JSON serde, have you tried with the most recent from the master branch ? On Mon, Jun 23, 2014 at 10:23 AM, Christian Link wrote: > Hi, > > thanks...but I need to sort things out with ONE SerDe/strategy... > I've started with André's idea by using Roberto Con

Re: [ANNOUNCE] New Hive Committers - Gopal Vijayaraghavan and Szehon Ho

Congrats Gopal and Szehon! On Mon, Jun 23, 2014 at 10:34 AM, Jason Dere wrote: > Congrats! > > On Jun 23, 2014, at 10:28 AM, Hari Subramaniyan < > hsubramani...@hortonworks.com> wrote: > > > congrats to Gopal and Szehon! > > > > Thanks > > Hari > > > > > > On Mon, Jun 23, 2014 at 9:59 AM, Xiaob

Re: [ANNOUNCE] New Hive Committers - Gopal Vijayaraghavan and Szehon Ho

Congrats! On Jun 23, 2014, at 10:28 AM, Hari Subramaniyan wrote: > congrats to Gopal and Szehon! > > Thanks > Hari > > > On Mon, Jun 23, 2014 at 9:59 AM, Xiaobing Zhou > wrote: > >> Congrats! >> >> >> >> On Mon, Jun 23, 2014 at 9:52 AM, Vaibhav Gumashta < >> vgumas...@hortonworks.com >>

Re: [ANNOUNCE] New Hive Committers - Gopal Vijayaraghavan and Szehon Ho

congrats to Gopal and Szehon! Thanks Hari On Mon, Jun 23, 2014 at 9:59 AM, Xiaobing Zhou wrote: > Congrats! > > > > On Mon, Jun 23, 2014 at 9:52 AM, Vaibhav Gumashta < > vgumas...@hortonworks.com > > wrote: > > > Congrats Gopal and Szehon! > > > > --Vaibhav > > > > > > On Mon, Jun 23, 2014 at

Re: how to load json with nested array into hive?

Hi, thanks...but I need to sort things out with ONE SerDe/strategy... I've started with André's idea by using Roberto Congiu's SerDe and André's template to create a table with the right schema and loading the data aftrerwards. But it's not completely working... I did the following (sorry for sp

Re: how to load json with nested array into hive?

You can also use hive-json-schema to automate Hive schema generation from JSON: https://github.com/quux00/hive-json-schema From: Nitin Pawar mailto:nitinpawar...@gmail.com>> Reply-To: "user@hive.apache.org" mailto:user@hive.apache.org>> Date: Monday, June 23, 2014 a

Re: [ANNOUNCE] New Hive Committers - Gopal Vijayaraghavan and Szehon Ho

Congrats Gopal and Szehon! --Vaibhav On Mon, Jun 23, 2014 at 8:48 AM, Szehon Ho wrote: > Thank you all very much, and congrats Gopal! > Szehon > > > On Sun, Jun 22, 2014 at 8:42 PM, Carl Steinbach wrote: > > > The Apache Hive PMC has voted to make Gopal Vijayaraghavan and Szehon Ho > > commit

RE: Rebuild HCatalog

I tried to follow the instructions at the link for a Hadoop 0.23 install but when I run the mvn command, it is looking for something in the hive/target directory which does not exist. I will assume the svn command was supposed to create this location. Not sure what to do next. I still need to

hive/hbase integration

I’m running Hive 0.12 on Hadoop V2 (Ambari installation) and have been trying to use HBase integration. Hive generated Map/Reduce jobs are failing with: Error: java.lang.ClassNotFoundException: org.apache.hadoop.hbase.mapreduce.TableSplit this is discussed in several discussion threads, but

Re: [ANNOUNCE] New Hive Committers - Gopal Vijayaraghavan and Szehon Ho

Thank you all very much, and congrats Gopal! Szehon On Sun, Jun 22, 2014 at 8:42 PM, Carl Steinbach wrote: > The Apache Hive PMC has voted to make Gopal Vijayaraghavan and Szehon Ho > committers on the Apache Hive Project. > > Please join me in congratulating Gopal and Szehon! > > Thanks. > > -

Re: HCatalog access from a Java app

Missed the last line for the # 2 HCatSchema schema = HCatInputFormat.getTableSchema(job.getConfiguration()) On Mon, Jun 23, 2014 at 8:11 AM, Dmitry Vasilenko wrote: > Hi Brian, > > 1. To enumerate databases and tables and to get the Hive table schema you > can use the code I provided earlier.

Re: HCatalog access from a Java app

Hi Brian, 1. To enumerate databases and tables and to get the Hive table schema you can use the code I provided earlier. 2. To get the HCatalog flavor of the table schema you will use something like this: import org.apache.hadoop.conf.Configuration; import org.apache.hadoop.mapreduce.InputSplit;

Re: subscribe

https://hive.apache.org/mailing_lists.html François Langelier Étudiant en génie Logiciel - École de Technologie Supérieure Capitaine Club Capra VP-Communication - CS Games 2014 Jeux de Génie 2011 à 20

Query execution time for Hive queries in Hue Web UI

Hi all, I have created the Hive table ( million of records). I am using Hue Web UI to run the Hive queires I am running the same queries in both Hive UI ( Beeswax) and Cloudera Impala ( Web UI) in Hue to find our the performance. In the Hue, I am not able to find the query execution tim

Re: how to load json with nested array into hive?

I think you can just take a look at jsonserde It does take care of nested json documents. (though you will need to know entire json structure upfront) Here is example of using it http://blog.cloudera.com/blog/2012/12/how-to-use-a-serde-in-apache-hive/ On Mon, Jun 23, 2014 at 2:28 PM, Christia

Hive 0.13 map 100 % reduce 100% and the reduce decrise to 75 % ( in join or lag function)

My HDFS space is so big I dont thiks this isthe cause of the problem. I will test to increase java heap memory in hive-env.sh file 2014-06-23 11:06 GMT+02:00 Nagarjuna Vissarapu : > Can you please check your hdfs space once? If it is fine please increase > java heap memory in hive-env.sh file >

Re: Hive 0.12 Mapjoin and MapJoinMemoryExhaustionException

Can you please check your hdfs space once? If it is fine please increase java heap memory in hive-env.sh file On Mon, Jun 23, 2014 at 2:00 AM, Dima Machlin wrote: > I don't see how this is "same" or even remotely related to my issue. > > It would be better for you to send it with a different a

Re: how to load json with nested array into hive?

Hi Jerome, thanks...I've already found "Brickhouse" and the Hive UDFs, but it didn't help. Today I'll try again to process the json file after going through all my mails...maybe I'll find a solution. Best, Chris On Fri, Jun 20, 2014 at 7:16 PM, Jerome Banks wrote: > Christian, >Sorry to

Hive 0.12 Mapjoin and MapJoinMemoryExhaustionException

Hello, We are running Hive 0.12 and using the hive.auto.convert.join feature when : hive.auto.convert.join.noconditionaltask.size = 5000 hive.mapjoin.followby.gby.localtask.max.memory.usage = 0.7 The query is a mapjoin with a group by afterwards like so : select id,x,max(y) from ( select t1.i