Re: Review Request 37156: HIVE-7476 : CTAS does not work properly for s3

2015-08-05 Thread Lenni Kuff
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/37156/#review94354 --- Ship it! ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java

RE: issue while reading parquet file in hive

2015-08-05 Thread Santlal J Gupta
Hi, Int96 is not supported in the cascading parquet. It supports Int32 and Int64. So that's why I have used binary instead of Int96. Thanks, Santlal J. Gupta -Original Message- From: Sergio Pena [mailto:sergio.p...@cloudera.com] Sent: Wednesday, August 5, 2015 11:00 PM To: dev@hive.apa

Re: Review Request 37128: Enable native vectorized map join for spark [Spark Branch]

2015-08-05 Thread Xuefu Zhang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/37128/#review94339 --- Ship it! Ship It! - Xuefu Zhang On Aug. 6, 2015, 2:09 a.m., Rui

Re: Review Request 37128: Enable native vectorized map join for spark [Spark Branch]

2015-08-05 Thread Rui Li
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/37128/ --- (Updated Aug. 6, 2015, 2:09 a.m.) Review request for hive and Xuefu Zhang. Bu

Review Request 37156: HIVE-7476 : CTAS does not work properly for s3

2015-08-05 Thread Szehon Ho
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/37156/ --- Review request for hive. Bugs: HIVE-7476 https://issues.apache.org/jira/bro

Re: Review Request 37128: Enable native vectorized map join for spark [Spark Branch]

2015-08-05 Thread Xuefu Zhang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/37128/#review94336 --- Ship it! Ship It! - Xuefu Zhang On Aug. 5, 2015, 11:28 a.m., Rui

[jira] [Created] (HIVE-11481) hive incorrectly set extended ACLs for unnamed group for new databases/tables with inheritPerms enabled

2015-08-05 Thread Carita Ou (JIRA)
Carita Ou created HIVE-11481: Summary: hive incorrectly set extended ACLs for unnamed group for new databases/tables with inheritPerms enabled Key: HIVE-11481 URL: https://issues.apache.org/jira/browse/HIVE-11481

[jira] [Created] (HIVE-11480) CBO: Calcite Operator To Hive Operator (Calcite Return Path): char/varchar as input to GenericUDAF

2015-08-05 Thread Pengcheng Xiong (JIRA)
Pengcheng Xiong created HIVE-11480: -- Summary: CBO: Calcite Operator To Hive Operator (Calcite Return Path): char/varchar as input to GenericUDAF Key: HIVE-11480 URL: https://issues.apache.org/jira/browse/HIVE-11

[jira] [Created] (HIVE-11479) LLAP: ORC-related refactoring changes broke something

2015-08-05 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created HIVE-11479: --- Summary: LLAP: ORC-related refactoring changes broke something Key: HIVE-11479 URL: https://issues.apache.org/jira/browse/HIVE-11479 Project: Hive Issu

Review Request 37150: HIVE-11375 Broken processing of queries containing NOT (x IS NOT NULL and x <> 0)

2015-08-05 Thread Aihua Xu
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/37150/ --- Review request for hive. Repository: hive-git Description --- HIVE-11375

[jira] [Created] (HIVE-11478) StatsUtils::getWritableSize does not treat non-primitive data types correctly

2015-08-05 Thread Hari Sankar Sivarama Subramaniyan (JIRA)
Hari Sankar Sivarama Subramaniyan created HIVE-11478: Summary: StatsUtils::getWritableSize does not treat non-primitive data types correctly Key: HIVE-11478 URL: https://issues.apache.org/jira/

[jira] [Created] (HIVE-11477) CBO inserts a UDF cast for integer type promotion

2015-08-05 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created HIVE-11477: Summary: CBO inserts a UDF cast for integer type promotion Key: HIVE-11477 URL: https://issues.apache.org/jira/browse/HIVE-11477 Project: Hive

[jira] [Created] (HIVE-11476) TypeInfoParser cannot handle column names with spaces in them

2015-08-05 Thread Gopal V (JIRA)
Gopal V created HIVE-11476: -- Summary: TypeInfoParser cannot handle column names with spaces in them Key: HIVE-11476 URL: https://issues.apache.org/jira/browse/HIVE-11476 Project: Hive Issue Type: B

[jira] [Created] (HIVE-11475) Bad rename of directory during commit, when using HCat dynamic-partitioning.

2015-08-05 Thread Mithun Radhakrishnan (JIRA)
Mithun Radhakrishnan created HIVE-11475: --- Summary: Bad rename of directory during commit, when using HCat dynamic-partitioning. Key: HIVE-11475 URL: https://issues.apache.org/jira/browse/HIVE-11475

[jira] [Created] (HIVE-11474) LLAP: merge master into branch

2015-08-05 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created HIVE-11474: --- Summary: LLAP: merge master into branch Key: HIVE-11474 URL: https://issues.apache.org/jira/browse/HIVE-11474 Project: Hive Issue Type: Sub-task

Re: Review Request 36877: CBO: Calcite Operator To Hive Operator (Calcite Return Path) : fix reduce_deduplicate optimization

2015-08-05 Thread pengcheng xiong
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/36877/ --- (Updated Aug. 5, 2015, 9:50 p.m.) Review request for hive, Hari Sankar Sivarama

[jira] [Created] (HIVE-11473) Failed to create spark client with Spark 1.5

2015-08-05 Thread Jimmy Xiang (JIRA)
Jimmy Xiang created HIVE-11473: -- Summary: Failed to create spark client with Spark 1.5 Key: HIVE-11473 URL: https://issues.apache.org/jira/browse/HIVE-11473 Project: Hive Issue Type: Bug

[jira] [Created] (HIVE-11472) ORC StringDirectTreeReader is thrashing the GC due to byte[] allocation per row

2015-08-05 Thread Gopal V (JIRA)
Gopal V created HIVE-11472: -- Summary: ORC StringDirectTreeReader is thrashing the GC due to byte[] allocation per row Key: HIVE-11472 URL: https://issues.apache.org/jira/browse/HIVE-11472 Project: Hive

[jira] [Created] (HIVE-11471) Expose query cost estimates (from CBO?) in explain plan

2015-08-05 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created HIVE-11471: --- Summary: Expose query cost estimates (from CBO?) in explain plan Key: HIVE-11471 URL: https://issues.apache.org/jira/browse/HIVE-11471 Project: Hive Is

[jira] [Created] (HIVE-11470) NPE in DynamicPartFileRecordWriterContainer on null part-keys.

2015-08-05 Thread Mithun Radhakrishnan (JIRA)
Mithun Radhakrishnan created HIVE-11470: --- Summary: NPE in DynamicPartFileRecordWriterContainer on null part-keys. Key: HIVE-11470 URL: https://issues.apache.org/jira/browse/HIVE-11470 Project: H

[jira] [Created] (HIVE-11469) InstanceCache does not have proper implementation of equals or hashcode

2015-08-05 Thread Swarnim Kulkarni (JIRA)
Swarnim Kulkarni created HIVE-11469: --- Summary: InstanceCache does not have proper implementation of equals or hashcode Key: HIVE-11469 URL: https://issues.apache.org/jira/browse/HIVE-11469 Project:

Re: Precommit tests are failing

2015-08-05 Thread Prasanth Jayachandran
I saw bunch of failures related to disk space issue https://issues.apache.org/jira/browse/HIVE-11416?focusedCommentId=14650616&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14650616 http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-B

[jira] [Created] (HIVE-11468) Vectorize: Struct IN() clauses

2015-08-05 Thread Matt McCline (JIRA)
Matt McCline created HIVE-11468: --- Summary: Vectorize: Struct IN() clauses Key: HIVE-11468 URL: https://issues.apache.org/jira/browse/HIVE-11468 Project: Hive Issue Type: Bug Component

Re: Precommit tests are failing

2015-08-05 Thread Xuefu Zhang
Prasanth, Could you send me a URL that shows the warning msg that you were seeing? I'm not sure if it's related to the thrift version that were used to regenerate the code. Thanks, Xuefu On Wed, Aug 5, 2015 at 10:54 AM, Prasanth Jayachandran < pjayachand...@hortonworks.com> wrote: > Thanks Serg

[jira] [Created] (HIVE-11467) WriteBuffers rounding wbSize to next power of 2 may cause OOM

2015-08-05 Thread Wei Zheng (JIRA)
Wei Zheng created HIVE-11467: Summary: WriteBuffers rounding wbSize to next power of 2 may cause OOM Key: HIVE-11467 URL: https://issues.apache.org/jira/browse/HIVE-11467 Project: Hive Issue Typ

Re: Precommit tests are failing

2015-08-05 Thread Prasanth Jayachandran
Thanks Sergio for creating a follow up JIRA! > On Aug 5, 2015, at 10:49 AM, Sergio Pena wrote: > > Thanks Prasanth. > > I run the same test you did, and I found the following sizes: > > BEFORE HIVE-10166 > *13M* Aug 5 11:57 ./hive-unit/target/tmp/log/hive.log > > WITH HIVE-10166 > *2.4G* Aug

Re: Precommit tests are failing

2015-08-05 Thread Sergio Pena
Thanks Prasanth. I run the same test you did, and I found the following sizes: BEFORE HIVE-10166 *13M* Aug 5 11:57 ./hive-unit/target/tmp/log/hive.log WITH HIVE-10166 *2.4G* Aug 5 12:07 ./hive-unit/target/tmp/log/hive.log CURRENT HEAD *3.2G* Aug 5 12:36 ./hive-unit/target/tmp/log/hive.log H

[jira] [Created] (HIVE-11466) HIVE-10166 generates more data on hive.log causing Jenkins to fill all the disk.

2015-08-05 Thread JIRA
Sergio Peña created HIVE-11466: -- Summary: HIVE-10166 generates more data on hive.log causing Jenkins to fill all the disk. Key: HIVE-11466 URL: https://issues.apache.org/jira/browse/HIVE-11466 Project: H

HIVE-11433: NPE for a multiple inner join query

2015-08-05 Thread Xuefu Zhang
Hi folks, I just committed the patch, which fixes the problem that I found. While the patch doesn't seem to be fixing the root of the problem, it's safe, harmless, and more importantly fixes the issue. However, if you know more about that part of the code, and knows about the root cause, it would

Re: issue while reading parquet file in hive

2015-08-05 Thread Sergio Pena
Hi Santlal, Hive uses parquet int96 type to write and read timestamps. Probably the error is because of that. You can try with int96 instead of binary. - Sergio On Tue, Jul 21, 2015 at 1:54 AM, Santlal J Gupta < santlal.gu...@bitwiseglobal.com> wrote: > Hello, > > > > I have following issue. >

[jira] [Created] (HIVE-11465) CBO: Calcite Operator To Hive Operator (Calcite Return Path): fix stringToMap

2015-08-05 Thread Pengcheng Xiong (JIRA)
Pengcheng Xiong created HIVE-11465: -- Summary: CBO: Calcite Operator To Hive Operator (Calcite Return Path): fix stringToMap Key: HIVE-11465 URL: https://issues.apache.org/jira/browse/HIVE-11465 Proje

Hive-0.14 - Build # 1034 - Still Failing

2015-08-05 Thread Apache Jenkins Server
Changes for Build #1013 Changes for Build #1014 Changes for Build #1015 Changes for Build #1016 Changes for Build #1017 Changes for Build #1018 Changes for Build #1019 Changes for Build #1020 Changes for Build #1021 Changes for Build #1022 Changes for Build #1023 Changes for Build #1024

Re: Issue while working with parquet hive

2015-08-05 Thread Sergio Pena
Hi Santlal, The problem is that BIGDECIMAL is not a Hive keyword for data types. DECIMAL is the one you should use as this uses 'bigdecimal' java type internally. You can read more information on this wiki: https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Types#LanguageManualTypes-D

[jira] [Created] (HIVE-11464) lineage info missing if there are multiple outputs

2015-08-05 Thread Jimmy Xiang (JIRA)
Jimmy Xiang created HIVE-11464: -- Summary: lineage info missing if there are multiple outputs Key: HIVE-11464 URL: https://issues.apache.org/jira/browse/HIVE-11464 Project: Hive Issue Type: Bug

Re: Hive column mapping to hbase

2015-08-05 Thread kulkarni.swar...@gmail.com
Sunile, Starting hive 0.12, you can use prefixes to pull the columns corresponding to the column families. So in your case as long as you have sensible prefixes, for example for everything in july, if you use "july-DATE-speed", then you can simply do something like WITH SERDEPROPERTIES ('hbase.col

Review Request 37128: Enable native vectorized map join for spark [Spark Branch]

2015-08-05 Thread Rui Li
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/37128/ --- Review request for hive and Xuefu Zhang. Bugs: HIVE-11180 https://issues.ap