Re: HIVE:1.2, Query taking huge time

Additionally, although it is a PoC you should have a realistic data model. Furthermore, following good data modeling practices should be taken into account. Joining on a double is not one of them. It should be int. Furthermore, double is a type that is in most scenarios rarely used. In the business

[jira] [Created] (HIVE-11615) Create test for max thrift message setting

Jason Dere created HIVE-11615: - Summary: Create test for max thrift message setting Key: HIVE-11615 URL: https://issues.apache.org/jira/browse/HIVE-11615 Project: Hive Issue Type: Test

[jira] [Created] (HIVE-11614) CBO: Calcite Operator To Hive Operator (Calcite Return Path): ctas after order by have problem

Pengcheng Xiong created HIVE-11614: -- Summary: CBO: Calcite Operator To Hive Operator (Calcite Return Path): ctas after order by have problem Key: HIVE-11614 URL: https://issues.apache.org/jira/browse/HIVE-11614

Re: hiveserver2 hangs

Sanjeev, One possibility is that you are running into[1] which affects hive 0.13. Is it possible for you to apply the patch on [1] and see if it fixes your problem? [1] https://issues.apache.org/jira/browse/HIVE-10410 On Thu, Aug 20, 2015 at 6:12 PM, Sanjeev Verma wrote: > We are using hive-0.

Re: hiveserver2 hangs

We are using hive-0.13 with hadoop1. On Thu, Aug 20, 2015 at 11:49 AM, kulkarni.swar...@gmail.com < kulkarni.swar...@gmail.com> wrote: > Sanjeev, > > Can you tell me more details about your hive version/hadoop version etc. > > On Wed, Aug 19, 2015 at 1:35 PM, Sanjeev Verma > wrote: > >> Can some

Re: Review Request 37635: HIVE-11607

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/37635/ --- (Updated Aug. 20, 2015, 10:12 p.m.) Review request for hive, Sergio Pena and Su

Re: Review Request 37660: HiveServer2 should store connection params in ZK when using dynamic service discovery for simpler client connection string.

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/37660/ --- (Updated Aug. 20, 2015, 10:04 p.m.) Review request for hive and Thejas Nair.

[jira] [Created] (HIVE-11613) schematool should return non zero exit status for info command, if state is inconsistent

Thejas M Nair created HIVE-11613: Summary: schematool should return non zero exit status for info command, if state is inconsistent Key: HIVE-11613 URL: https://issues.apache.org/jira/browse/HIVE-11613

Re: Request for Review & Commit

Hi, just a quick bump. I believe both of them should be quick to review. I'm happy to put up a Review Board request as well if you think that's needed. Cheers, Lars On Tue, Aug 18, 2015 at 12:38 PM, Lars Francke wrote: > Hi, > > would anyone mind taking a look at > >

Re: Review Request 37591: HIVE-11586 ObjectInspectorFactory.getReflectionObjectInspector is not thread-safe

> On Aug. 19, 2015, 6:17 p.m., Xuefu Zhang wrote: > > Thanks, guys. However, I do see that the solution seems complicated and > > error-prone. It will be great if we can simplify this. > > Jimmy Xiang wrote: > To support recursive type, so far, I don't see a better solution. We can > enhan

[jira] [Created] (HIVE-11612) Allow wait queue comparator to be specified as a classname

Siddharth Seth created HIVE-11612: - Summary: Allow wait queue comparator to be specified as a classname Key: HIVE-11612 URL: https://issues.apache.org/jira/browse/HIVE-11612 Project: Hive Iss

Re: Review Request 37591: HIVE-11586 ObjectInspectorFactory.getReflectionObjectInspector is not thread-safe

> On Aug. 19, 2015, 6:17 p.m., Xuefu Zhang wrote: > > Thanks, guys. However, I do see that the solution seems complicated and > > error-prone. It will be great if we can simplify this. > > Jimmy Xiang wrote: > To support recursive type, so far, I don't see a better solution. We can > enhan

Re: Review Request 37591: HIVE-11586 ObjectInspectorFactory.getReflectionObjectInspector is not thread-safe

> On Aug. 19, 2015, 6:17 p.m., Xuefu Zhang wrote: > > Thanks, guys. However, I do see that the solution seems complicated and > > error-prone. It will be great if we can simplify this. > > Jimmy Xiang wrote: > To support recursive type, so far, I don't see a better solution. We can > enhan

Re: Review Request 37591: HIVE-11586 ObjectInspectorFactory.getReflectionObjectInspector is not thread-safe

> On Aug. 19, 2015, 6:17 p.m., Xuefu Zhang wrote: > > Thanks, guys. However, I do see that the solution seems complicated and > > error-prone. It will be great if we can simplify this. > > Jimmy Xiang wrote: > To support recursive type, so far, I don't see a better solution. We can > enhan

Re: Review Request 37591: HIVE-11586 ObjectInspectorFactory.getReflectionObjectInspector is not thread-safe

> On Aug. 19, 2015, 6:17 p.m., Xuefu Zhang wrote: > > Thanks, guys. However, I do see that the solution seems complicated and > > error-prone. It will be great if we can simplify this. To support recursive type, so far, I don't see a better solution. We can enhance it if someone comes up a bet

[jira] [Created] (HIVE-11611) A bad performance regression issue with Parquet happens if Hive does not select any columns

Sergio Peña created HIVE-11611: -- Summary: A bad performance regression issue with Parquet happens if Hive does not select any columns Key: HIVE-11611 URL: https://issues.apache.org/jira/browse/HIVE-11611

Re: hiveserver2 hangs

Sanjeev, Can you tell me more details about your hive version/hadoop version etc. On Wed, Aug 19, 2015 at 1:35 PM, Sanjeev Verma wrote: > Can somebody gives me some pointer to looked upon? > > On Wed, Aug 19, 2015 at 9:26 AM, Sanjeev Verma > wrote: > >> Hi >> We are experiencing a strange prob

Review Request 37660: HiveServer2 should store connection params in ZK when using dynamic service discovery for simpler client connection string.

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/37660/ --- Review request for hive and Thejas Nair. Bugs: HIVE-11581 https://issues.ap

Re: Review Request 37635: HIVE-11607

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/37635/#review95957 --- shims/0.20S/src/main/java/org/apache/hadoop/hive/shims/Hadoop20SShi

Re: hiveserver2 hangs

We had a case of retrieving a record which is bigger than the GC limit, for example a column with Array or Map type that has 1M cells. On Wed, Aug 19, 2015 at 9:35 PM, Sanjeev Verma wrote: > Can somebody gives me some pointer to looked upon? > > On Wed, Aug 19, 2015 at 9:26 AM, Sanjeev Verma >

Re: HIVE:1.2, Query taking huge time

Thanks for the reply Noam. I have already tried the later point of dividing the query. But the challenge comes during the joining of the table. Thanks and Regards Nishant Aggarwal, PMP Cell No:- +91 99588 94305 On Thu, Aug 20, 2015 at 2:19 PM, Noam Hasson wrote: > Hi, > > Have you look at cou

Re: HIVE:1.2, Query taking huge time

Hi, Have you look at counters in Hadoop side? It's possible you are dealing with a bad join which causes multiplication of items, if you see huge number of record input/output in map/reduce phase and keeps increasing that's probably the case. Another thing I would try is to divide the job into se

Re: HIVE:1.2, Query taking huge time

Please check out HIVE-11502. For your poc, you can simply get around using other data types instead of double. On Thu, Aug 20, 2015 at 2:08 AM, Nishant Aggarwal wrote: > Thanks for the reply Noam. I have already tried the later point of > dividing the query. But the challenge comes during the jo

question on ThriftCLIService.java

hi all, I’ve a request for adding some action when thrift to hiveserver2 and before call ExcuteStatement, for example, execute some other hql before hqls from python thrift client executed. My solution is modifying the ThriftCLIService.java, public TExecuteStatementResp ExecuteStatement(TExecu

[jira] [Created] (HIVE-11610) Remove push down expressions from FilterJoinRule and create a new rule for it

Jesus Camacho Rodriguez created HIVE-11610: -- Summary: Remove push down expressions from FilterJoinRule and create a new rule for it Key: HIVE-11610 URL: https://issues.apache.org/jira/browse/HIVE-11610

Review Request 37638: HIVE-11353 Map env does not reflect in the Local Map Join

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/37638/ --- Review request for hive. Repository: hive-git Description --- mapreduce.

Review Request 37635: HIVE-11607

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/37635/ --- Review request for hive, Sergio Pena and Sushanth Sowmyan. Bugs: HIVE-11607