relationship between a hive query and a tez dag

2014-12-15 Thread Xiaoyong Zhu
Hi experts I know that Hive could be run on Tez in a DAG "format" - if I have a complex Hive script which is consisted of several Hive queries, will it be translated to 1 Tez DAG? Or several Tez DAGs? Thanks! Xiaoyong

Re: issue with Tez execution engine in HDP 2.2

2014-12-15 Thread Vikram Dixit
Hi Kristen, I discussed this with tez folks and they tell me the version of tez you have should work with that version of hive. It seems like the request for container could have been very large (or -1 perhaps). Can you share the hive logs as well as the application logs for this issue. Probably w

Re: issue with Tez execution engine in HDP 2.2

2014-12-15 Thread Vikram Dixit
Hi Kristen, I discussed this with tez folks and they tell me the version of tez you have should work with that version of hive. It seems like the request for container could have been very large (or -1 perhaps). Can you share the hive logs as well as the application logs for this issue. Probably w

Re: Question on varchar in 0.12.0 version of nive

2014-12-15 Thread Jason Dere
Varchar was only added to Hive in 0.12, before that there was only string if you wanted to deal with string types. Varchar will enforce the max character length, truncating the string value if necessary. We've tried to make it as compatible with string as possible. One thing about varchars, if y

Re: issue with Tez execution engine in HDP 2.2

2014-12-15 Thread Kristen Hardwick
Vikram, Thanks for the quick response. I am using the following versions: Hive 0.14.0.2.2.0.0 Tez 0.5.2.2.2.0.0 Do you know where I can find a Hortonworks RPM for Tez 0.5.3 so that I can upgrade manually? I used the Ambari installation from the Hortonworks site, so I think the version conflict

Re: issue with Tez execution engine in HDP 2.2

2014-12-15 Thread Vikram Dixit
Hi Kristen, Can you share the version of tez you are using? Hive 0.14 (in HDP 2.2) needs tez 0.5.3 or beyond. Not sure if there was an earlier installation of tez that is being used here. Thanks Vikram. On Mon, Dec 15, 2014 at 10:13 AM, Kristen Hardwick wrote: > Hi all, > > We recently created

issue with Tez execution engine in HDP 2.2

2014-12-15 Thread Kristen Hardwick
Hi all, We recently created a new Amazon cluster with an installation of GA HDP 2.2 from the Hortonworks website. One of the main reasons we wanted to try this version was to use Hive with Tez with the new cost based optimizer. However, running simple queries with Tez as the execution engine does

Re: Question on varchar in 0.12.0 version of nive

2014-12-15 Thread Gayathri Swaroop
> > I am a newbie to hive. I am trying to query an oracle table in hive. The > data is in hadoop and i have created similar varchar columns in my external > table. Would like to know what are the limitations of varchar over string. > And why people prefer string over varchar. > > Thanks, > Gayathri

Question on varchar in 0.12.0 version of nive

2014-12-15 Thread Gayathri Swaroop
I am a newbie to hive. I am trying to query an oracle table in hive. The data is in hadoop and i have created similar varchar columns in my external table. Would like to know what are the limitations of varchar over string. And why people prefer string over varchar. Thanks, Gayathri

HiveServer2 multiple instances

2014-12-15 Thread arali tech
Hi, Has anybody tried to run multiple instances of HiveServer2 on same node with differeent port numbers OR multiple instances of HiverServer2 on different nodes with loadbalancing between the different instances. Will HiveServer2 scale with single instance no matter what is the size of load or