How can I see the operator tree of hive ?

2015-06-29 Thread canan chen
Is there any way to see the operator tree of hive before and after optimization ? Thanks

RE: Hive indexing optimization

2015-06-29 Thread Bennie Leo
I've attached the output. Thanks. B Subject: Re: Hive indexing optimization From: jpullokka...@hortonworks.com To: user@hive.apache.org Date: Mon, 29 Jun 2015 19:17:44 + Could you post explain extended output? From: Bennie Leo Reply-To: "user@hive.apache.org

Is hive 0.13 index working fine on partition tables?

2015-06-29 Thread Jim Green
Hi Team, On hive 0.13, I have a minimum reproduce for index on partition table issue: CREATE TABLE test_partition_index( id1 bigint, id2 bigint, id3 bigint) PARTITIONED BY ( dt string) row format delimited fields terminated by ','; cat sampledata 111,222,333 LOAD DATA LOCAL INPATH 'sampledata' O

Re: Hive indexing optimization

2015-06-29 Thread John Pullokkaran
Could you post explain extended output? From: Bennie Leo mailto:tben...@hotmail.com>> Reply-To: "user@hive.apache.org" mailto:user@hive.apache.org>> Date: Monday, June 29, 2015 at 10:35 AM To: "user@hive.apache.org" mailto:user@hive.apach

RE: Hive indexing optimization

2015-06-29 Thread Bennie Leo
Here is the explain output: STAGE PLANS: Stage: Stage-1 Tez Edges: Reducer 2 <- Map 1 (SIMPLE_EDGE), Map 3 (SIMPLE_EDGE) Vertices: Map 1 Map Operator Tree: TableScan alias: logontable filterExpr: is

Re: Hive and elasticsearch-hadoop-2.1.0 : NoClassDefFoundError

2015-06-29 Thread Nitin Pawar
great it helped On Mon, Jun 29, 2015 at 7:29 PM, Erwan Queffélec wrote: > [continued] > A dependency for a custom UDF seems not to be properly shaded, as I could > see in an excerpt of the maven build output: > [INFO] Including org.apache.httpcomponents:httpclient:jar:4.1.2 in the > shaded jar.

Re: Hive and elasticsearch-hadoop-2.1.0 : NoClassDefFoundError

2015-06-29 Thread Erwan Queffélec
[continued] A dependency for a custom UDF seems not to be properly shaded, as I could see in an excerpt of the maven build output: [INFO] Including org.apache.httpcomponents:httpclient:jar:4.1.2 in the shaded jar. [INFO] Including org.apache.httpcomponents:httpcore:jar:4.1.2 in the shaded jar. I'm

Re: Hive and elasticsearch-hadoop-2.1.0 : NoClassDefFoundError

2015-06-29 Thread Erwan Queffélec
Hi Nitin, Digging up a bit I discovered that the error is probably on our end : On Mon, Jun 29, 2015 at 3:54 PM, Nitin Pawar wrote: > I am using 2.2.4-2.2 but did not get any error. > > can you check what all services are installed on the node where hive > client is running > > On Mon, Jun 29

Re: Hive and elasticsearch-hadoop-2.1.0 : NoClassDefFoundError

2015-06-29 Thread Nitin Pawar
I am using 2.2.4-2.2 but did not get any error. can you check what all services are installed on the node where hive client is running On Mon, Jun 29, 2015 at 7:18 PM, Erwan Queffélec wrote: > Hi Nitin, > > No, I didn't do such a thing. I'm using the stock 0.14 version from HDP > 2.2.4 (said 2.

Re: Hive and elasticsearch-hadoop-2.1.0 : NoClassDefFoundError

2015-06-29 Thread Erwan Queffélec
Hi Nitin, No, I didn't do such a thing. I'm using the stock 0.14 version from HDP 2.2.4 (said 2.2.6 earlier but that was wrong) # hive --version Hive 0.14.0.2.2.4.2-2 Subversion git://ip-10-0-0-5.ec2.internal/grid/0/jenkins/workspace/HDP-2.2.4.1-centos6/bigtop/build/hive/rpm/BUILD/hive-0.14.0.2.2

Re: Hive and elasticsearch-hadoop-2.1.0 : NoClassDefFoundError

2015-06-29 Thread Nitin Pawar
by any chance you built hive yourself ? On Mon, Jun 29, 2015 at 7:11 PM, Erwan Queffélec wrote: > Additional info : it works when I manually add the jar with ADD JAR ; > > hive> ADD JAR ' > /usr/hdp/current/hive-server2/lib/commons-httpclient-3.0.1.jar' > > I'm quite new to hive and hadoop in g

Re: Hive and elasticsearch-hadoop-2.1.0 : NoClassDefFoundError

2015-06-29 Thread Erwan Queffélec
Additional info : it works when I manually add the jar with ADD JAR ; hive> ADD JAR ' /usr/hdp/current/hive-server2/lib/commons-httpclient-3.0.1.jar' I'm quite new to hive and hadoop in general. This is my first post on this mailing list, so please excuse me if the folowing question has been aske

Hive and elasticsearch-hadoop-2.1.0 : NoClassDefFoundError

2015-06-29 Thread Erwan Queffélec
Hello, I'm running HortonWorks HDP 2.2.6, hive 0.14 alongside an ElasticSearch cluster For some reason Hive can't seem to connect to my ES cluster Using the ES SerDe (I'm using elasticsearch-hadoop-2.1.0.jar). When time comes for my job to insert the my query result in an ES resources, I get this

Re: Re: hive -e run tez query error

2015-06-29 Thread r7raul1...@163.com
BTW , my hadoop version is 2.3.0-cdh5.0.2 r7raul1...@163.com From: Jeff Zhang Date: 2015-06-29 13:23 To: user Subject: Re: hive -e run tez query error > But keeping that client cache disabled when running against trunk generally > kills queries all the time with occasional errors like these.

ORCStruct Constructor

2015-06-29 Thread vengatesh.babu
Hi, Now ORCStruct constructor have only package level access. If i want use ORCStruct constructor to insert data to orc file from outside of hive, then ORCStruct should be public. 1. why is ORCStruct constructor not public ?. 2. How to write to ORC File without using hive ?. Than