[jira] [Commented] (HIVE-4629) HS2 should support an API to retrieve query logs

2014-08-19 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103519#comment-14103519 ] Thejas M Nair commented on HIVE-4629: - [~dongc] Earlier patch also had a method in Hive

[jira] [Updated] (HIVE-7730) Extend ReadEntity to add column access information from query

2014-08-19 Thread Xiaomeng Huang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaomeng Huang updated HIVE-7730: - Summary: Extend ReadEntity to add column access information from query (was: Get instance of Hive

[jira] [Commented] (HIVE-7254) Enhance Ptest framework config to auto-pick up list of MiniXXXDriver's test

2014-08-19 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103518#comment-14103518 ] Szehon Ho commented on HIVE-7254: - I think Brock was working on the PTest server and made s

Re: Review Request 24498: A method to extrapolate the missing column status for the partitions.

2014-08-19 Thread pengcheng xiong
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/24498/ --- (Updated Aug. 20, 2014, 6:52 a.m.) Review request for hive. Changes ---

[jira] [Updated] (HIVE-7654) A method to extrapolate columnStats for partitions of a table

2014-08-19 Thread pengcheng xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] pengcheng xiong updated HIVE-7654: -- Attachment: HIVE-7654.4.patch reduce # of queries follow Ashutosh's comments > A method to extr

Re: Review Request 24293: HIVE-4629: HS2 should support an API to retrieve query logs

2014-08-19 Thread Thejas Nair
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/24293/#review51071 --- service/src/test/org/apache/hive/service/cli/operation/TestOperatio

[jira] [Commented] (HIVE-7254) Enhance Ptest framework config to auto-pick up list of MiniXXXDriver's test

2014-08-19 Thread Gunther Hagleitner (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103411#comment-14103411 ] Gunther Hagleitner commented on HIVE-7254: -- [~szehon] I think the minitez.query.fi

[jira] [Updated] (HIVE-7796) Provide subquery pushdown facility for storage handlers

2014-08-19 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated HIVE-7796: Status: Patch Available (was: Open) > Provide subquery pushdown facility for storage handlers > ---

[jira] [Updated] (HIVE-7796) Provide subquery pushdown facility for storage handlers

2014-08-19 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated HIVE-7796: Attachment: HIVE-7796.1.patch.txt > Provide subquery pushdown facility for storage handlers > --

[jira] [Created] (HIVE-7796) Provide subquery pushdown facility for storage handlers

2014-08-19 Thread Navis (JIRA)
Navis created HIVE-7796: --- Summary: Provide subquery pushdown facility for storage handlers Key: HIVE-7796 URL: https://issues.apache.org/jira/browse/HIVE-7796 Project: Hive Issue Type: Improvement

[jira] [Updated] (HIVE-7738) tez select sum(decimal) from union all of decimal and null throws NPE

2014-08-19 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7738: -- Resolution: Fixed Fix Version/s: 0.14.0 Release Note: tez select sum(decimal) from union all of decim

[jira] [Created] (HIVE-7795) Enable ptf.q and ptf_streaming.q.[Spark Branch]

2014-08-19 Thread Chengxiang Li (JIRA)
Chengxiang Li created HIVE-7795: --- Summary: Enable ptf.q and ptf_streaming.q.[Spark Branch] Key: HIVE-7795 URL: https://issues.apache.org/jira/browse/HIVE-7795 Project: Hive Issue Type: Bug

[jira] [Assigned] (HIVE-7793) Enable tests on Spark branch (3) [Sparch Branch]

2014-08-19 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li reassigned HIVE-7793: --- Assignee: Chengxiang Li > Enable tests on Spark branch (3) [Sparch Branch] > -

[jira] [Updated] (HIVE-7767) hive.optimize.union.remove does not work properly [Spark Branch]

2014-08-19 Thread Na Yang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Na Yang updated HIVE-7767: -- Attachment: HIVE-7767.2-spark.patch union_remove_2.q.out was missing in the first patch. Add it to the second p

[jira] [Commented] (HIVE-7646) Modify parser to support new grammar for Insert,Update,Delete

2014-08-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103356#comment-14103356 ] Eugene Koifman commented on HIVE-7646: -- TestCliDriver.testCliDriver_auto_sortmerge_joi

[jira] [Assigned] (HIVE-7792) Enable tests on Spark branch (2) [Sparch Branch]

2014-08-19 Thread Venki Korukanti (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venki Korukanti reassigned HIVE-7792: - Assignee: Venki Korukanti > Enable tests on Spark branch (2) [Sparch Branch] > ---

[jira] [Assigned] (HIVE-7791) Enable tests on Spark branch (1) [Sparch Branch]

2014-08-19 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland reassigned HIVE-7791: -- Assignee: Brock Noland > Enable tests on Spark branch (1) [Sparch Branch] >

[jira] [Created] (HIVE-7794) Enable tests on Spark branch (4) [Sparch Branch]

2014-08-19 Thread Brock Noland (JIRA)
Brock Noland created HIVE-7794: -- Summary: Enable tests on Spark branch (4) [Sparch Branch] Key: HIVE-7794 URL: https://issues.apache.org/jira/browse/HIVE-7794 Project: Hive Issue Type: Sub-task

[jira] [Updated] (HIVE-7793) Enable tests on Spark branch (3) [Sparch Branch]

2014-08-19 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-7793: --- Description: This jira is to enable *most* of the tests below. If tests don't pass because of some un

[jira] [Updated] (HIVE-7792) Enable tests on Spark branch (2) [Sparch Branch]

2014-08-19 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-7792: --- Description: This jira is to enable *most* of the tests below. If tests don't pass because of some un

[jira] [Updated] (HIVE-7791) Enable tests on Spark branch (1) [Sparch Branch]

2014-08-19 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-7791: --- Description: This jira is to enable *most* of the tests below. If tests don't pass because of some un

[jira] [Created] (HIVE-7793) Enable tests on Spark branch (3) [Sparch Branch]

2014-08-19 Thread Brock Noland (JIRA)
Brock Noland created HIVE-7793: -- Summary: Enable tests on Spark branch (3) [Sparch Branch] Key: HIVE-7793 URL: https://issues.apache.org/jira/browse/HIVE-7793 Project: Hive Issue Type: Sub-task

[jira] [Commented] (HIVE-7747) Submitting a query to Spark from HiveServer2 fails

2014-08-19 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103354#comment-14103354 ] Hive QA commented on HIVE-7747: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Created] (HIVE-7792) Enable tests on Spark branch (2) [Sparch Branch]

2014-08-19 Thread Brock Noland (JIRA)
Brock Noland created HIVE-7792: -- Summary: Enable tests on Spark branch (2) [Sparch Branch] Key: HIVE-7792 URL: https://issues.apache.org/jira/browse/HIVE-7792 Project: Hive Issue Type: Sub-task

[jira] [Created] (HIVE-7791) Enable tests on Spark branch (1) [Sparch Branch]

2014-08-19 Thread Brock Noland (JIRA)
Brock Noland created HIVE-7791: -- Summary: Enable tests on Spark branch (1) [Sparch Branch] Key: HIVE-7791 URL: https://issues.apache.org/jira/browse/HIVE-7791 Project: Hive Issue Type: Sub-task

[jira] [Updated] (HIVE-7791) Enable tests on Spark branch (1) [Sparch Branch]

2014-08-19 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-7791: --- Description: {noformat} alter_merge_orc.q,\ alter_merge_stats_orc.q,\ auto_join0.q,\ auto_join1

[jira] [Commented] (HIVE-7767) hive.optimize.union.remove does not work properly [Spark Branch]

2014-08-19 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103345#comment-14103345 ] Hive QA commented on HIVE-7767: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Updated] (HIVE-7292) Hive on Spark

2014-08-19 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-7292: --- Labels: Spark-M1 Spark-M2 Spark-M3 Spark-M4 Spark-M5 (was: ) > Hive on Spark > - > >

[jira] [Updated] (HIVE-5799) session/operation timeout for hiveserver2

2014-08-19 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated HIVE-5799: Attachment: HIVE-5799.12.patch.txt Changed waiting time from 5sec to 7sec > session/operation timeout for hiveserve

[jira] [Commented] (HIVE-4629) HS2 should support an API to retrieve query logs

2014-08-19 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103336#comment-14103336 ] Thejas M Nair commented on HIVE-4629: - [~dongc] Thanks for the clean and well documente

Re: Review Request 24293: HIVE-4629: HS2 should support an API to retrieve query logs

2014-08-19 Thread Thejas Nair
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/24293/#review51047 --- service/src/java/org/apache/hive/service/cli/ICLIService.java

[jira] [Commented] (HIVE-7373) Hive should not remove trailing zeros for decimal numbers

2014-08-19 Thread Lefty Leverenz (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103327#comment-14103327 ] Lefty Leverenz commented on HIVE-7373: -- Should this change in behavior be mentioned in

[jira] [Updated] (HIVE-7384) Research into reduce-side join [Spark Branch]

2014-08-19 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho updated HIVE-7384: Attachment: (was: Hive on Spark Reduce Side Join.docx) > Research into reduce-side join [Spark Branch] >

[jira] [Updated] (HIVE-7384) Research into reduce-side join [Spark Branch]

2014-08-19 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho updated HIVE-7384: Attachment: Hive on Spark Reduce Side Join.docx > Research into reduce-side join [Spark Branch] > --

[jira] [Commented] (HIVE-7341) Support for Table replication across HCatalog instances

2014-08-19 Thread Lefty Leverenz (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103325#comment-14103325 ] Lefty Leverenz commented on HIVE-7341: -- Okay, thanks again. > Support for Table repli

[jira] [Updated] (HIVE-7786) add --SORT_BEFORE_DIFF to union all tez .q.out files

2014-08-19 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-7786: --- Resolution: Fixed Fix Version/s: 0.14.0 Status: Resolved (was: Patch Available) Tha

[jira] [Commented] (HIVE-7767) hive.optimize.union.remove does not work properly [Spark Branch]

2014-08-19 Thread Na Yang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103314#comment-14103314 ] Na Yang commented on HIVE-7767: --- Review Board link: https://reviews.apache.org/r/24881/ > hi

[jira] [Updated] (HIVE-7767) hive.optimize.union.remove does not work properly [Spark Branch]

2014-08-19 Thread Na Yang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Na Yang updated HIVE-7767: -- Status: Patch Available (was: In Progress) > hive.optimize.union.remove does not work properly [Spark Branch] >

Review Request 24881: HIVE-7767: hive.optimize.union.remove does not work properly [Spark Branch]

2014-08-19 Thread Na Yang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/24881/ --- Review request for hive, Brock Noland, Szehon Ho, and Xuefu Zhang. Bugs: HIVE-7

[jira] [Updated] (HIVE-7767) hive.optimize.union.remove does not work properly [Spark Branch]

2014-08-19 Thread Na Yang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Na Yang updated HIVE-7767: -- Attachment: HIVE-7767.1-spark.patch > hive.optimize.union.remove does not work properly [Spark Branch] > ---

[jira] [Commented] (HIVE-7405) Vectorize GROUP BY on the Reduce-Side (Part 1 – Basic)

2014-08-19 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103312#comment-14103312 ] Hive QA commented on HIVE-7405: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Created] (HIVE-7790) Update privileges to check for update and delete

2014-08-19 Thread Alan Gates (JIRA)
Alan Gates created HIVE-7790: Summary: Update privileges to check for update and delete Key: HIVE-7790 URL: https://issues.apache.org/jira/browse/HIVE-7790 Project: Hive Issue Type: Sub-task

[jira] [Updated] (HIVE-7771) ORC PPD fails for some decimal predicates

2014-08-19 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated HIVE-7771: Resolution: Fixed Fix Version/s: 0.14.0 Status: Resolved (was: Patch Available) Committed to trun

Re: Dropping support for JDK6 in Apache Hadoop

2014-08-19 Thread Deepak Vohra
Java 7 has been adopted by 65% of developers according to a 2014 survey.  Java Tools and Technologies Landscape for 2014               Java Tools and Technologies Landscape for 2014 For the 5th time, ZeroTurnaround's tech detectives at RebelLabs revisit the tools & technologies landscape in Ja

[jira] [Commented] (HIVE-7068) Integrate AccumuloStorageHandler

2014-08-19 Thread Josh Elser (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103266#comment-14103266 ] Josh Elser commented on HIVE-7068: -- Certainly -- created HIVE-7789. > Integrate AccumuloS

[jira] [Created] (HIVE-7789) Documentation for AccumuloStorageHandler

2014-08-19 Thread Josh Elser (JIRA)
Josh Elser created HIVE-7789: Summary: Documentation for AccumuloStorageHandler Key: HIVE-7789 URL: https://issues.apache.org/jira/browse/HIVE-7789 Project: Hive Issue Type: Task Compon

[jira] [Commented] (HIVE-7664) VectorizedBatchUtil.addRowToBatchFrom is not optimized for Vectorized execution and takes 25% CPU

2014-08-19 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103254#comment-14103254 ] Gopal V commented on HIVE-7664: --- Sure [~navis], thanks for the work, I didn't want you to dup

[jira] [Commented] (HIVE-7646) Modify parser to support new grammar for Insert,Update,Delete

2014-08-19 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103249#comment-14103249 ] Hive QA commented on HIVE-7646: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Updated] (HIVE-7664) VectorizedBatchUtil.addRowToBatchFrom is not optimized for Vectorized execution and takes 25% CPU

2014-08-19 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated HIVE-7664: Assignee: Gopal V (was: Navis) > VectorizedBatchUtil.addRowToBatchFrom is not optimized for Vectorized > execution

[jira] [Commented] (HIVE-7664) VectorizedBatchUtil.addRowToBatchFrom is not optimized for Vectorized execution and takes 25% CPU

2014-08-19 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103244#comment-14103244 ] Navis commented on HIVE-7664: - [~gopalv] Then, could you take this issue? I didn't know Vector

[jira] [Updated] (HIVE-7788) Generate plans for insert, update, and delete

2014-08-19 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-7788: - Attachment: HIVE-7788.WIP.patch Attaching a work in progress patch. This is lacking a couple of things: *

[jira] [Commented] (HIVE-7664) VectorizedBatchUtil.addRowToBatchFrom is not optimized for Vectorized execution and takes 25% CPU

2014-08-19 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103238#comment-14103238 ] Gopal V commented on HIVE-7664: --- [~navis]: I was originally planning to use VectorColumnAssig

[jira] [Commented] (HIVE-7664) VectorizedBatchUtil.addRowToBatchFrom is not optimized for Vectorized execution and takes 25% CPU

2014-08-19 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103231#comment-14103231 ] Navis commented on HIVE-7664: - Changes applied only to ReduceRecordProcessor (Might be applied

[jira] [Assigned] (HIVE-7664) VectorizedBatchUtil.addRowToBatchFrom is not optimized for Vectorized execution and takes 25% CPU

2014-08-19 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis reassigned HIVE-7664: --- Assignee: Navis > VectorizedBatchUtil.addRowToBatchFrom is not optimized for Vectorized > execution and takes

[jira] [Created] (HIVE-7788) Generate plans for insert, update, and delete

2014-08-19 Thread Alan Gates (JIRA)
Alan Gates created HIVE-7788: Summary: Generate plans for insert, update, and delete Key: HIVE-7788 URL: https://issues.apache.org/jira/browse/HIVE-7788 Project: Hive Issue Type: Sub-task

[jira] [Updated] (HIVE-7664) VectorizedBatchUtil.addRowToBatchFrom is not optimized for Vectorized execution and takes 25% CPU

2014-08-19 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated HIVE-7664: Attachment: (was: HIVE-7664.2.patch.txt) > VectorizedBatchUtil.addRowToBatchFrom is not optimized for Vectorized

[jira] [Updated] (HIVE-7664) VectorizedBatchUtil.addRowToBatchFrom is not optimized for Vectorized execution and takes 25% CPU

2014-08-19 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated HIVE-7664: Attachment: HIVE-7664.2.patch.txt > VectorizedBatchUtil.addRowToBatchFrom is not optimized for Vectorized > executi

Review Request 24876: VectorizedBatchUtil.addRowToBatchFrom is not optimized for Vectorized execution and takes 25% CPU

2014-08-19 Thread Navis Ryu
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/24876/ --- Review request for hive. Bugs: HIVE-7664 https://issues.apache.org/jira/bro

[jira] [Updated] (HIVE-7664) VectorizedBatchUtil.addRowToBatchFrom is not optimized for Vectorized execution and takes 25% CPU

2014-08-19 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated HIVE-7664: Attachment: HIVE-7664.2.patch.txt > VectorizedBatchUtil.addRowToBatchFrom is not optimized for Vectorized > executi

[jira] [Commented] (HIVE-7773) Union all query finished with errors [Spark Branch]

2014-08-19 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103208#comment-14103208 ] Rui Li commented on HIVE-7773: -- Thank you [~brocknoland] > Union all query finished with erro

[jira] [Updated] (HIVE-7384) Research into reduce-side join [Spark Branch]

2014-08-19 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho updated HIVE-7384: Attachment: Hive on Spark Reduce Side Join.docx Attaching a simple design doc with the idea so far. > Resea

[jira] [Commented] (HIVE-7785) CBO: Projection Pruning needs to handle cross Joins

2014-08-19 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103178#comment-14103178 ] Hive QA commented on HIVE-7785: --- {color:red}Overall{color}: -1 no tests executed Here are

[jira] [Commented] (HIVE-7664) VectorizedBatchUtil.addRowToBatchFrom is not optimized for Vectorized execution and takes 25% CPU

2014-08-19 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103177#comment-14103177 ] Navis commented on HIVE-7664: - Sorry, it's not yet completed. I was hurry to go home yesterday.

[jira] [Commented] (HIVE-7786) add --SORT_BEFORE_DIFF to union all tez .q.out files

2014-08-19 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103176#comment-14103176 ] Hive QA commented on HIVE-7786: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Updated] (HIVE-7646) Modify parser to support new grammar for Insert,Update,Delete

2014-08-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-7646: - Attachment: HIVE-7646.3.patch patch 2 accidentally include 'extra' stuff > Modify parser to suppo

[jira] [Updated] (HIVE-7646) Modify parser to support new grammar for Insert,Update,Delete

2014-08-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-7646: - Status: Patch Available (was: Open) > Modify parser to support new grammar for Insert,Update,Dele

Re: Dropping support for JDK6 in Apache Hadoop

2014-08-19 Thread Matt Foley
Yes, in terms of forward compatibility, my company has been certifying the current Hadoop-related stack on JDK7 (both Oracle and OpenJDK) for some time. No problems there, in our experience. For stopping supporting JDK6 in the near future, and enabling JDK7 feature usage, +1. --Matt On Tue, Au

[jira] [Updated] (HIVE-7646) Modify parser to support new grammar for Insert,Update,Delete

2014-08-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-7646: - Status: Open (was: Patch Available) > Modify parser to support new grammar for Insert,Update,Dele

[jira] [Updated] (HIVE-7717) Add .q tests coverage for "union all" [Spark Branch]

2014-08-19 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-7717: --- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Commented] (HIVE-7717) Add .q tests coverage for "union all" [Spark Branch]

2014-08-19 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103167#comment-14103167 ] Brock Noland commented on HIVE-7717: +1 those union tests failures are due to HIVE-778

[jira] [Commented] (HIVE-7747) Submitting a query to Spark from HiveServer2 fails

2014-08-19 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103150#comment-14103150 ] Brock Noland commented on HIVE-7747: +1 I think we can apply this to trunk if the test

[jira] [Updated] (HIVE-7405) Vectorize GROUP BY on the Reduce-Side (Part 1 – Basic)

2014-08-19 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-7405: --- Status: Patch Available (was: Open) > Vectorize GROUP BY on the Reduce-Side (Part 1 – Basic) > --

[jira] [Updated] (HIVE-7405) Vectorize GROUP BY on the Reduce-Side (Part 1 – Basic)

2014-08-19 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-7405: --- Attachment: HIVE-7405.9.patch > Vectorize GROUP BY on the Reduce-Side (Part 1 – Basic) > -

[jira] [Updated] (HIVE-7747) Submitting a query to Spark from HiveServer2 fails

2014-08-19 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-7747: --- Summary: Submitting a query to Spark from HiveServer2 fails (was: Submitting a query to Spark from Hi

[jira] [Updated] (HIVE-7747) Submitting a query to Spark from HiveServer2 fails [Spark Branch]

2014-08-19 Thread Venki Korukanti (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venki Korukanti updated HIVE-7747: -- Attachment: (was: HIVE-7747.1.patch) > Submitting a query to Spark from HiveServer2 fails [S

[jira] [Updated] (HIVE-7747) Submitting a query to Spark from HiveServer2 fails [Spark Branch]

2014-08-19 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-7747: --- Affects Version/s: (was: spark-branch) 0.13.1 Status: Patch A

[jira] [Commented] (HIVE-7767) hive.optimize.union.remove does not work properly [Spark Branch]

2014-08-19 Thread Na Yang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103146#comment-14103146 ] Na Yang commented on HIVE-7767: --- By looking into this issue, I find out the reason that cause

[jira] [Updated] (HIVE-7747) Submitting a query to Spark from HiveServer2 fails [Spark Branch]

2014-08-19 Thread Venki Korukanti (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venki Korukanti updated HIVE-7747: -- Attachment: HIVE-7747.1.patch > Submitting a query to Spark from HiveServer2 fails [Spark Branch

[jira] [Updated] (HIVE-7747) Submitting a query to Spark from HiveServer2 fails [Spark Branch]

2014-08-19 Thread Venki Korukanti (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venki Korukanti updated HIVE-7747: -- Attachment: HIVE-7747.1.patch Problem is that we ship a wrong jar to Spark cluster. Instead of h

[jira] [Updated] (HIVE-7747) Submitting a query to Spark from HiveServer2 fails [Spark Branch]

2014-08-19 Thread Venki Korukanti (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venki Korukanti updated HIVE-7747: -- Fix Version/s: (was: spark-branch) > Submitting a query to Spark from HiveServer2 fails [Spa

[jira] [Work started] (HIVE-7767) hive.optimize.union.remove does not work properly [Spark Branch]

2014-08-19 Thread Na Yang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-7767 started by Na Yang. > hive.optimize.union.remove does not work properly [Spark Branch] >

[jira] [Commented] (HIVE-7723) Explain plan for complex query with lots of partitions is slow due to in-efficient collection used to find a matching ReadEntity

2014-08-19 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103060#comment-14103060 ] Hive QA commented on HIVE-7723: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-7717) Add .q tests coverage for "union all" [Spark Branch]

2014-08-19 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103023#comment-14103023 ] Hive QA commented on HIVE-7717: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-7787) Reading Parquet file with enum in Thrift Encoding throws NoSuchFieldError

2014-08-19 Thread Raymond Lau (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103025#comment-14103025 ] Raymond Lau commented on HIVE-7787: --- This issue does not occur in Hive 0.12 CDH 5.0.0.

[jira] [Updated] (HIVE-7223) Support generic PartitionSpecs in Metastore partition-functions

2014-08-19 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-7223: --- Attachment: HIVE-7223.3.patch Here's the updated patch. I've removed some dead code an

[jira] [Updated] (HIVE-7646) Modify parser to support new grammar for Insert,Update,Delete

2014-08-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-7646: - Description: need parser to recognize constructs such as : {code:sql} INSERT INTO Cust (Customer_N

[jira] [Updated] (HIVE-7646) Modify parser to support new grammar for Insert,Update,Delete

2014-08-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-7646: - Attachment: HIVE-7646.2.patch HIVE-7646.2.patch - make sure 'values' is still a valid identifier,

[jira] [Commented] (HIVE-7341) Support for Table replication across HCatalog instances

2014-08-19 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14102989#comment-14102989 ] Sushanth Sowmyan commented on HIVE-7341: This would be used by tool developers, lik

[jira] [Updated] (HIVE-7068) Integrate AccumuloStorageHandler

2014-08-19 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushanth Sowmyan updated HIVE-7068: --- Resolution: Fixed Release Note: Introduces accumulo-handler Status: Resolved (

[jira] [Updated] (HIVE-7787) Reading Parquet file with enum in Thrift Encoding throws NoSuchFieldError

2014-08-19 Thread Raymond Lau (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Lau updated HIVE-7787: -- Affects Version/s: 0.14.0 0.13.0 0.13.1 > Reading Parquet

[jira] [Commented] (HIVE-7784) Created the needed indexes on Hive.PART_COL_STATS for CBO

2014-08-19 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14102984#comment-14102984 ] Hive QA commented on HIVE-7784: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-7068) Integrate AccumuloStorageHandler

2014-08-19 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14102981#comment-14102981 ] Sushanth Sowmyan commented on HIVE-7068: Confirmed on my end as well on hadoop-2, c

[jira] [Updated] (HIVE-7223) Support generic PartitionSpecs in Metastore partition-functions

2014-08-19 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-7223: --- Attachment: (was: HIVE-7223.3.patch) > Support generic PartitionSpecs in Metastore

[jira] [Updated] (HIVE-7785) CBO: Projection Pruning needs to handle cross Joins

2014-08-19 Thread Laljo John Pullokkaran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Laljo John Pullokkaran updated HIVE-7785: - Status: Patch Available (was: Open) > CBO: Projection Pruning needs to handle cro

[jira] [Updated] (HIVE-7785) CBO: Projection Pruning needs to handle cross Joins

2014-08-19 Thread Laljo John Pullokkaran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Laljo John Pullokkaran updated HIVE-7785: - Attachment: HIVE-7785.patch > CBO: Projection Pruning needs to handle cross Joins

[jira] [Updated] (HIVE-7373) Hive should not remove trailing zeros for decimal numbers

2014-08-19 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-7373: --- Resolution: Fixed Fix Version/s: 0.14.0 Status: Resolved (was: Patch Available) Tha

[jira] [Updated] (HIVE-7787) Reading Parquet file with enum in Thrift Encoding throws NoSuchFieldError

2014-08-19 Thread Raymond Lau (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Lau updated HIVE-7787: -- Description: When reading Parquet file, where the original Thrift schema contains a struct with an enum

Re: Timeline for release of Hive 0.14

2014-08-19 Thread Thejas Nair
+1 Sounds good to me. Its already almost 4 months since the last release. It is time to start preparing for the next one. Thanks for volunteering! On Tue, Aug 19, 2014 at 2:02 PM, Vikram Dixit wrote: > Hi Folks, > > I was thinking that it was about time that we had a release of hive 0.14 > given

[jira] [Updated] (HIVE-7787) Reading Parquet file with enum in Thrift Encoding throws NoSuchFieldError

2014-08-19 Thread Raymond Lau (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Lau updated HIVE-7787: -- Environment: Hive 0.12 CDH 5.1.0, Hadoop 2.3.0 CDH 5.1.0 (was: Hive 0.12 CDH 5.1.0, Hadoop 0.23) > Rea

[jira] [Updated] (HIVE-7787) Reading Parquet file with enum in Thrift Encoding throws NoSuchFieldError

2014-08-19 Thread Raymond Lau (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Lau updated HIVE-7787: -- Affects Version/s: 0.12.1 > Reading Parquet file with enum in Thrift Encoding throws NoSuchFieldError >

  1   2   3   >