Request to add to contributor list

2014-12-11 Thread Binglin Chang
Hi, I fire some jira related to hiveserver2(HIVE-9005, HIVE-9006, HIVE-9013), please help adding me to contributor list so I can assign jira and create review requests. id: decster Thanks Binglin

[jira] [Created] (HIVE-9080) ORC Concatenate fails on: Column has wrong number of index entries found: 0 expected: 1

2014-12-11 Thread Daniel Haviv (JIRA)
Daniel Haviv created HIVE-9080: -- Summary: ORC Concatenate fails on: Column has wrong number of index entries found: 0 expected: 1 Key: HIVE-9080 URL: https://issues.apache.org/jira/browse/HIVE-9080 Proje

[jira] [Updated] (HIVE-9080) ORC Concatenate fails on: Column has wrong number of index entries found: 0 expected: 1

2014-12-11 Thread Daniel Haviv (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Haviv updated HIVE-9080: --- Attachment: ORC_TABLE.sql test_table.sql test_table.txt To reproduce: 1

Re: Review Request 28936: Set completer in CliDriver is not working

2014-12-11 Thread cheng xu
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28936/#review64714 --- cli/src/java/org/apache/hadoop/hive/cli/CliDriver.java

Re: Review Request 28934: HIVE-9078 Hive should not submit second SparkTask while previous one has failed.[Spark Branch]

2014-12-11 Thread Xuefu Zhang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28934/#review64717 --- Ship it! Ship It! - Xuefu Zhang On Dec. 11, 2014, 6:51 a.m., che

[jira] [Updated] (HIVE-9046) Skip child tasks if parent task failed [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9046: -- Issue Type: Sub-task (was: Bug) Parent: HIVE-7292 > Skip child tasks if parent task failed [Spar

[jira] [Resolved] (HIVE-9046) Skip child tasks if parent task failed [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved HIVE-9046. --- Resolution: Duplicate Dupe of HIVE-9078. > Skip child tasks if parent task failed [Spark Branch] > ---

[jira] [Commented] (HIVE-9078) Hive should not submit second SparkTask while previous one has failed.[Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242447#comment-14242447 ] Xuefu Zhang commented on HIVE-9078: --- +1 pending on tests. > Hive should not submit secon

[jira] [Updated] (HIVE-8508) UT: fix bucketsort_insert tests - related to SMBMapJoinOperator

2014-12-11 Thread Chinna Rao Lalam (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinna Rao Lalam updated HIVE-8508: --- Attachment: HIVE-8508.1-spark.patch > UT: fix bucketsort_insert tests - related to SMBMapJoinOp

[jira] [Updated] (HIVE-8508) UT: fix bucketsort_insert tests - related to SMBMapJoinOperator

2014-12-11 Thread Chinna Rao Lalam (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinna Rao Lalam updated HIVE-8508: --- Status: Patch Available (was: Open) Verified these tests and these are working on current code

[jira] [Commented] (HIVE-8508) UT: fix bucketsort_insert tests - related to SMBMapJoinOperator

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242455#comment-14242455 ] Xuefu Zhang commented on HIVE-8508: --- +1 pending on tests. > UT: fix bucketsort_insert te

[jira] [Commented] (HIVE-9079) Hive hangs while failed to get executorCount[Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242456#comment-14242456 ] Xuefu Zhang commented on HIVE-9079: --- Hi [~chengxiang li], are you sure that you uploaded

How to find Optimize query plan for given Query?

2014-12-11 Thread Akash Mishra
Hi All, I am trying to understand the details of how query is optimize in the system? Is there anything other than EXPLAIN system. As per my understanding Abstract Syntax tree is not optimize. Is the plan in stage is the optimize physical plan ? -- With Sincere Regards, Your's Sincerely, Akas

[jira] [Commented] (HIVE-8508) UT: fix bucketsort_insert tests - related to SMBMapJoinOperator

2014-12-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242544#comment-14242544 ] Hive QA commented on HIVE-8508: --- {color:red}Overall{color}: -1 at least one tests failed H

Review Request 28941: HIVE-8988

2014-12-11 Thread Jesús Camacho Rodríguez
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28941/ --- Review request for hive, John Pullokkaran and Julian Hyde. Bugs: HIVE-8988

[jira] [Work started] (HIVE-8988) Support advanced aggregation in Hive to Calcite path

2014-12-11 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-8988 started by Jesus Camacho Rodriguez. - > Support advanced aggregation in Hive to Calcite path > --

Re: Review Request 28941: HIVE-8988

2014-12-11 Thread Jesús Camacho Rodríguez
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28941/ --- (Updated Dec. 11, 2014, 2:24 p.m.) Review request for hive, John Pullokkaran an

[jira] [Updated] (HIVE-8988) Support advanced aggregation in Hive to Calcite path

2014-12-11 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-8988: -- Attachment: HIVE-8988.patch > Support advanced aggregation in Hive to Calcite pat

[jira] [Updated] (HIVE-8988) Support advanced aggregation in Hive to Calcite path

2014-12-11 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-8988: -- Status: Patch Available (was: In Progress) The patch implements the AST->Calcite

[jira] [Commented] (HIVE-8988) Support advanced aggregation in Hive to Calcite path

2014-12-11 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242596#comment-14242596 ] Jesus Camacho Rodriguez commented on HIVE-8988: --- [~jpullokkaran], [~julianhyd

[jira] [Updated] (HIVE-8508) UT: fix bucketsort_insert tests - related to SMBMapJoinOperator

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8508: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available)

[jira] [Commented] (HIVE-8508) UT: fix bucketsort_insert tests - related to SMBMapJoinOperator

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242646#comment-14242646 ] Xuefu Zhang commented on HIVE-8508: --- Committed to Spark branch. Thanks, Chinna. > UT: fi

[jira] [Commented] (HIVE-8578) Investigate test failures related to HIVE-8545 [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242649#comment-14242649 ] Xuefu Zhang commented on HIVE-8578: --- Another occurrence of the problem: http://ec2-174-12

[jira] [Commented] (HIVE-4847) add rename database functionality

2014-12-11 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242674#comment-14242674 ] Aaron Dossett commented on HIVE-4847: - Hi -- Is it expected that this patch will be inc

[jira] [Updated] (HIVE-9078) Hive should not submit second SparkTask while previous one has failed.[Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9078: -- Attachment: HIVE-9078.1-spark.patch Reload the same patch to trigger test run. > Hive should not submit

[jira] [Resolved] (HIVE-8751) Null Pointer Exception when counter is used for stats during inserting overwrite partitioned tables [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved HIVE-8751. --- Resolution: Cannot Reproduce Cannot reproduce the problem in the latest branch. It must have been fixed

[jira] [Resolved] (HIVE-8405) Research Bucket Map Join [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved HIVE-8405. --- Resolution: Fixed Fix Version/s: spark-branch Research is done with the attached doc. Implemenat

[jira] [Resolved] (HIVE-7382) Create a MiniSparkCluster and set up a testing framework [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved HIVE-7382. --- Resolution: Fixed Fix Version/s: spark-branch Fixed via HIVE-8836. > Create a MiniSparkCluster

[jira] [Comment Edited] (HIVE-7382) Create a MiniSparkCluster and set up a testing framework [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242715#comment-14242715 ] Xuefu Zhang edited comment on HIVE-7382 at 12/11/14 3:53 PM: - F

[jira] [Commented] (HIVE-7593) Instantiate SparkClient per user session [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242726#comment-14242726 ] Xuefu Zhang commented on HIVE-7593: --- [~chengxiang li], With RSC, this shouldn't be a prob

[jira] [Resolved] (HIVE-7516) Add capacity control over queries running on Spark cluster [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved HIVE-7516. --- Resolution: Won't Fix This and HIVE-7768 seem to be duplicates. Close this one and let work start on H

[jira] [Assigned] (HIVE-7768) Integrate with Spark executor scaling [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang reassigned HIVE-7768: - Assignee: Chengxiang Li (was: Szehon Ho) Since Szehon is busy with SMB->MJ conversion and Chengxi

[jira] [Commented] (HIVE-9078) Hive should not submit second SparkTask while previous one has failed.[Spark Branch]

2014-12-11 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242736#comment-14242736 ] Chao commented on HIVE-9078: {quote} We may need to move all spark branch issues as subtask of

[jira] [Commented] (HIVE-7816) Enable map-join tests which Tez executes [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242744#comment-14242744 ] Xuefu Zhang commented on HIVE-7816: --- It seems that not all test in the list are added for

[jira] [Resolved] (HIVE-7613) Research optimization of auto convert join to map join [Spark branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved HIVE-7613. --- Resolution: Fixed Fix Version/s: spark-branch Since MJ is already in place (via HIVE-8699) and I

[jira] [Updated] (HIVE-7816) Enable map-join tests which Tez executes [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7816: -- Assignee: Rui Li > Enable map-join tests which Tez executes [Spark Branch] >

[jira] [Assigned] (HIVE-7874) Support multiple concurrent users

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang reassigned HIVE-7874: - Assignee: Chengxiang Li With RSC, this shouldn't be a problem any more. [~chengxiang li], could yo

[jira] [Commented] (HIVE-8982) IndexOutOfBounds exception in mapjoin [Spark Branch]

2014-12-11 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242786#comment-14242786 ] Chao commented on HIVE-8982: This one is quite interesting: in {{MapJoinEagerRowContainer#first

[jira] [Commented] (HIVE-8913) Make SparkMapJoinResolver handle runtime skew join [Spark Branch]

2014-12-11 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242788#comment-14242788 ] Jimmy Xiang commented on HIVE-8913: --- bq. maybe IOContext.inputNameIOContextMap should be

[jira] [Commented] (HIVE-9078) Hive should not submit second SparkTask while previous one has failed.[Spark Branch]

2014-12-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242795#comment-14242795 ] Hive QA commented on HIVE-9078: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-8913) Make SparkMapJoinResolver handle runtime skew join [Spark Branch]

2014-12-11 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242813#comment-14242813 ] Chao commented on HIVE-8913: different record handler threads should process different partitio

[jira] [Updated] (HIVE-9062) Explain plan doesn't print join keys for Tez shuffle join

2014-12-11 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-9062: --- Resolution: Fixed Fix Version/s: 0.15.0 Status: Resolved (was: Patch Availabl

[jira] [Commented] (HIVE-9078) Hive should not submit second SparkTask while previous one has failed.[Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242834#comment-14242834 ] Xuefu Zhang commented on HIVE-9078: --- I'm wondering if, by removing the trying logic, we a

[jira] [Assigned] (HIVE-8849) Hive/Spark/Yarn integration [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang reassigned HIVE-8849: - Assignee: Chengxiang Li Assign to Chengxiang as he is taking care of all integration related issue

[jira] [Updated] (HIVE-9043) HiveException: Conflict on row inspector for {table}

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9043: -- Attachment: HIVE-9043.1.patch Attache the same patch to trigger test run. > HiveException: Conflict on

[jira] [Commented] (HIVE-8639) Convert SMBJoin to MapJoin [Spark Branch]

2014-12-11 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242858#comment-14242858 ] Jimmy Xiang commented on HIVE-8639: --- [~szehon], looked into the auto_sortmerge_join_9 fai

[jira] [Created] (HIVE-9081) Bucket mapjoin should use the new alias in posToAliasMap [Spark Branch]

2014-12-11 Thread Jimmy Xiang (JIRA)
Jimmy Xiang created HIVE-9081: - Summary: Bucket mapjoin should use the new alias in posToAliasMap [Spark Branch] Key: HIVE-9081 URL: https://issues.apache.org/jira/browse/HIVE-9081 Project: Hive

[jira] [Commented] (HIVE-9081) Bucket mapjoin should use the new alias in posToAliasMap [Spark Branch]

2014-12-11 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242872#comment-14242872 ] Chao commented on HIVE-9081: Maybe we can do it in {{MapJoinProcessor#convertJoinOpMapJoinOp}}

[jira] [Commented] (HIVE-8639) Convert SMBJoin to MapJoin [Spark Branch]

2014-12-11 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242891#comment-14242891 ] Szehon Ho commented on HIVE-8639: - Thanks a lot, Jimmy. > Convert SMBJoin to MapJoin [Spar

[jira] [Updated] (HIVE-9081) Bucket mapjoin should use the new alias in posToAliasMap [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9081: -- Issue Type: Sub-task (was: Bug) Parent: HIVE-7292 > Bucket mapjoin should use the new alias in p

[jira] [Commented] (HIVE-9037) Improve explain plan to show joining keys for shuffle join

2014-12-11 Thread Laljo John Pullokkaran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242914#comment-14242914 ] Laljo John Pullokkaran commented on HIVE-9037: -- +1 > Improve explain plan to

[jira] [Updated] (HIVE-9060) Fix child operator references after NonBlockingOpDeDupProc

2014-12-11 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho updated HIVE-9060: Attachment: HIVE-9060.3.patch Ptest framework had some intermittent issues, submitting again. > Fix child op

[jira] [Updated] (HIVE-9025) join38.q (without map join) produces incorrect result when testing with multiple reducers

2014-12-11 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-9025: --- Resolution: Fixed Fix Version/s: 0.14.1 0.15.0 Status: Reso

[jira] [Commented] (HIVE-9025) join38.q (without map join) produces incorrect result when testing with multiple reducers

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242956#comment-14242956 ] Xuefu Zhang commented on HIVE-9025: --- Also merged to Spark branch. > join38.q (without ma

[jira] [Commented] (HIVE-9026) Re-enable remaining tests after HIVE-8970 [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242957#comment-14242957 ] Xuefu Zhang commented on HIVE-9026: --- [~csun] HIVE-9025 is fixed and merged to Spark branc

[jira] [Commented] (HIVE-9026) Re-enable remaining tests after HIVE-8970 [Spark Branch]

2014-12-11 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242958#comment-14242958 ] Chao commented on HIVE-9026: [~xuefuz] OK, I'll do that now. > Re-enable remaining tests after

[jira] [Commented] (HIVE-8609) Move beeline to jline2

2014-12-11 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242978#comment-14242978 ] Thejas M Nair commented on HIVE-8609: - Adding the exception that gets thrown, so that s

[jira] [Comment Edited] (HIVE-8609) Move beeline to jline2

2014-12-11 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242978#comment-14242978 ] Thejas M Nair edited comment on HIVE-8609 at 12/11/14 7:16 PM: --

[jira] [Updated] (HIVE-9066) temporarily disable CBO for non-deterministic functions

2014-12-11 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-9066: --- Resolution: Invalid Status: Resolved (was: Patch Available) > temporarily disable CBO

[jira] [Commented] (HIVE-9035) CBO: Disable PPD when functions are non-deterministic (ppd_random.q - non-deterministic udf rand() pushed above join)

2014-12-11 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242996#comment-14242996 ] Sergey Shelukhin commented on HIVE-9035: +1; one nit on RB > CBO: Disable PPD when

[jira] [Commented] (HIVE-8395) CBO: enable by default

2014-12-11 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243002#comment-14243002 ] Sergey Shelukhin commented on HIVE-8395: Hmm... I saw this in HiveQA queue, and now

[jira] [Commented] (HIVE-9026) Re-enable remaining tests after HIVE-8970 [Spark Branch]

2014-12-11 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243014#comment-14243014 ] Chao commented on HIVE-9026: Hmm.. {{subquery_in}} is still giving different result, and {{ppd

[jira] [Resolved] (HIVE-9056) Describe Avro Table Partition Fails

2014-12-11 Thread Chaoyu Tang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chaoyu Tang resolved HIVE-9056. --- Resolution: Cannot Reproduce > Describe Avro Table Partition Fails > --

HiveQA is broken

2014-12-11 Thread Sergey Shelukhin
It looks like all the builds are failing and nothing gets posted to the JIRAs, random example: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2040/console -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity t

Review Request 28963: HIVE-8121 Create micro-benchmarks for ParquetSerde and evaluate performance

2014-12-11 Thread Sergio Pena
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28963/ --- Review request for hive. Bugs: HIVE-8121 None Description --- This i

Re: Review Request 28963: HIVE-8121 Create micro-benchmarks for ParquetSerde and evaluate performance

2014-12-11 Thread Sergio Pena
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28963/ --- (Updated Dic. 11, 2014, 7:46 p.m.) Review request for hive. Bugs: HIVE-8121

[jira] [Commented] (HIVE-9043) HiveException: Conflict on row inspector for {table}

2014-12-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243018#comment-14243018 ] Hive QA commented on HIVE-9043: --- {color:red}Overall{color}: -1 at least one tests failed H

Re: HiveQA is broken

2014-12-11 Thread Szehon Ho
Yea we looked at that, it was stuck seems due to some EC2 issues. Now Brock reset it this morning, and it's going now. People in that interval (last night to now) might need to re-submit the patch. Thanks Szehon On Thu, Dec 11, 2014 at 11:41 AM, Sergey Shelukhin wrote: > It looks like all the

Review Request 28964: HIVE-8121 Create micro-benchmarks for ParquetSerde and evaluate performance

2014-12-11 Thread Sergio Pena
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28964/ --- Review request for hive. Bugs: HIVE-8121 https://issues.apache.org/jira/bro

[jira] [Updated] (HIVE-9034) CBO: type change in literal_ints.q

2014-12-11 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-9034: --- Attachment: HIVE-9034.03.patch Exact same file again, HiveQA was busted > CBO: type change in

[jira] [Updated] (HIVE-8395) CBO: enable by default

2014-12-11 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-8395: --- Attachment: HIVE-8395.31.patch Exact same file, HiveQA was busted > CBO: enable by default > -

[jira] [Commented] (HIVE-8121) Create micro-benchmarks for ParquetSerde and evaluate performance

2014-12-11 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-8121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243031#comment-14243031 ] Sergio Peña commented on HIVE-8121: --- You can run ORC and PARQUET tests in the patch attac

[jira] [Commented] (HIVE-8911) Enable mapjoin hints [Spark Branch]

2014-12-11 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243034#comment-14243034 ] Szehon Ho commented on HIVE-8911: - Hi Chao, patch looks great. My only preference would be

[jira] [Commented] (HIVE-8955) alter partition should check for "hive.stats.autogather" in hiveConf

2014-12-11 Thread Pankit Thapar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243037#comment-14243037 ] Pankit Thapar commented on HIVE-8955: - [~ashutoshc] , do you have any insight on this?

[jira] [Commented] (HIVE-8911) Enable mapjoin hints [Spark Branch]

2014-12-11 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243042#comment-14243042 ] Chao commented on HIVE-8911: [~szehon] Thanks for the review. You mean create some class like

[jira] [Updated] (HIVE-8988) Support advanced aggregation in Hive to Calcite path

2014-12-11 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-8988: -- Attachment: HIVE-8988.patch > Support advanced aggregation in Hive to Calcite pat

[jira] [Updated] (HIVE-8988) Support advanced aggregation in Hive to Calcite path

2014-12-11 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-8988: -- Attachment: (was: HIVE-8988.patch) > Support advanced aggregation in Hive to

Re: Review Request 28964: HIVE-8121 Create micro-benchmarks for ParquetSerde and evaluate performance

2014-12-11 Thread Brock Noland
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28964/#review64785 --- Hi, This is absolutely awesome! Your code is very clean and cuts ri

[jira] [Updated] (HIVE-9037) Improve explain plan to show joining keys for shuffle join

2014-12-11 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-9037: --- Resolution: Fixed Fix Version/s: 0.15.0 Status: Resolved (was: Patch Availabl

[jira] [Created] (HIVE-9082) Update Accumulo storage handler to build against Accumulo 1.7

2014-12-11 Thread Josh Elser (JIRA)
Josh Elser created HIVE-9082: Summary: Update Accumulo storage handler to build against Accumulo 1.7 Key: HIVE-9082 URL: https://issues.apache.org/jira/browse/HIVE-9082 Project: Hive Issue Type:

[jira] [Updated] (HIVE-9043) HiveException: Conflict on row inspector for {table}

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9043: -- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk and merged to Spark

[jira] [Commented] (HIVE-9060) Fix child operator references after NonBlockingOpDeDupProc

2014-12-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243139#comment-14243139 ] Hive QA commented on HIVE-9060: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-8121) Create micro-benchmarks for ParquetSerde and evaluate performance

2014-12-11 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243141#comment-14243141 ] Sergey Shelukhin commented on HIVE-8121: Have you considered using some standard mi

[jira] [Commented] (HIVE-8121) Create micro-benchmarks for ParquetSerde and evaluate performance

2014-12-11 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243152#comment-14243152 ] Prasanth Jayachandran commented on HIVE-8121: - IMO, there are many pitfalls of

Re: Review Request 28964: HIVE-8121 Create micro-benchmarks for ParquetSerde and evaluate performance

2014-12-11 Thread Sergio Pena
> On Dic. 11, 2014, 8:16 p.m., Brock Noland wrote: > > ql/src/test/org/apache/hadoop/hive/ql/io/TestHiveStoragePerformance.java, > > line 105 > > > > > > Since we don't actually use the data, should we just re-use the

[jira] [Updated] (HIVE-8866) Vectorization on partitioned table throws ArrayIndexOutOfBoundsException when partitions are not of same #of columns

2014-12-11 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-8866: --- Status: In Progress (was: Patch Available) Builds are not running... > Vectorization on partitioned t

Re: Review Request 28964: HIVE-8121 Create micro-benchmarks for ParquetSerde and evaluate performance

2014-12-11 Thread Brock Noland
> On Dec. 11, 2014, 8:16 p.m., Brock Noland wrote: > > ql/src/test/org/apache/hadoop/hive/ql/io/TestHiveStoragePerformance.java, > > line 105 > > > > > > Since we don't actually use the data, should we just re-use the

[jira] [Updated] (HIVE-9033) Fix ordering differences due to Java8 (part 2)

2014-12-11 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-9033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergio Peña updated HIVE-9033: -- Status: Open (was: Patch Available) > Fix ordering differences due to Java8 (part 2) > -

[jira] [Updated] (HIVE-9033) Fix ordering differences due to Java8 (part 2)

2014-12-11 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-9033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergio Peña updated HIVE-9033: -- Attachment: HIVE-9033.3.patch > Fix ordering differences due to Java8 (part 2) >

[jira] [Updated] (HIVE-9033) Fix ordering differences due to Java8 (part 2)

2014-12-11 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-9033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergio Peña updated HIVE-9033: -- Status: Patch Available (was: Open) > Fix ordering differences due to Java8 (part 2) > -

[jira] [Comment Edited] (HIVE-9043) HiveException: Conflict on row inspector for {table}

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243125#comment-14243125 ] Xuefu Zhang edited comment on HIVE-9043 at 12/11/14 10:19 PM: --

Re: Review Request 28964: HIVE-8121 Create micro-benchmarks for ParquetSerde and evaluate performance

2014-12-11 Thread Sergio Pena
> On Dic. 11, 2014, 8:16 p.m., Brock Noland wrote: > > ql/src/test/org/apache/hadoop/hive/ql/io/TestHiveStoragePerformance.java, > > line 379 > > > > > > Since we don't care about the data output, would it be useful t

[jira] [Commented] (HIVE-9034) CBO: type change in literal_ints.q

2014-12-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243262#comment-14243262 ] Hive QA commented on HIVE-9034: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-8395) CBO: enable by default

2014-12-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243263#comment-14243263 ] Hive QA commented on HIVE-8395: --- {color:red}Overall{color}: -1 no tests executed Here are

[jira] [Updated] (HIVE-9060) Fix child operator references after NonBlockingOpDeDupProc

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9060: -- Resolution: Fixed Fix Version/s: 0.15.0 Status: Resolved (was: Patch Available) Commit

[jira] [Commented] (HIVE-8911) Enable mapjoin hints [Spark Branch]

2014-12-11 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243269#comment-14243269 ] Chao commented on HIVE-8911: BTW, I saw {{mapjoin_filter_onejoin.q.out}} and {{mapjoin_tester.q

[jira] [Commented] (HIVE-8988) Support advanced aggregation in Hive to Calcite path

2014-12-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243272#comment-14243272 ] Hive QA commented on HIVE-8988: --- {color:red}Overall{color}: -1 no tests executed Here are

[jira] [Updated] (HIVE-8911) Enable mapjoin hints [Spark Branch]

2014-12-11 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao updated HIVE-8911: --- Attachment: HIVE-8911.3-spark.patch Addressing comments. > Enable mapjoin hints [Spark Branch] > -

Re: Review Request 28889: HIVE-8911 - Enable mapjoin hints [Spark Branch]

2014-12-11 Thread Chao Sun
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28889/ --- (Updated Dec. 11, 2014, 10:36 p.m.) Review request for hive, Szehon Ho and Xuef

Re: Review Request 28964: HIVE-8121 Create micro-benchmarks for ParquetSerde and evaluate performance

2014-12-11 Thread Sergio Pena
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28964/ --- (Updated Dic. 11, 2014, 10:42 p.m.) Review request for hive. Changes ---

  1   2   3   >