[jira] [Commented] (HIVE-7405) Vectorize GROUP BY on the Reduce-Side (Part 1 – Basic)

2014-08-04 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085895#comment-14085895 ] Hive QA commented on HIVE-7405: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-7540) NotSerializableException encountered when using sortByKey transformation

2014-08-04 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085889#comment-14085889 ] Brock Noland commented on HIVE-7540: bq. the proposed workaround mentioned above seems

[jira] [Created] (HIVE-7613) Research and verify optimization of auto convert join to map join[Spark branch]

2014-08-04 Thread Chengxiang Li (JIRA)
Chengxiang Li created HIVE-7613: --- Summary: Research and verify optimization of auto convert join to map join[Spark branch] Key: HIVE-7613 URL: https://issues.apache.org/jira/browse/HIVE-7613 Project: Hi

[jira] [Resolved] (HIVE-7612) Add link to parent vertex to mapjoin in explain

2014-08-04 Thread Gunther Hagleitner (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gunther Hagleitner resolved HIVE-7612. -- Resolution: Fixed Committed to branch. > Add link to parent vertex to mapjoin in explai

Re: Review Request 24297: Spark "Explain" should give useful information on dependencies

2014-08-04 Thread Chao Sun
> On Aug. 5, 2014, 6:15 a.m., Brock Noland wrote: > > Hi Chao, > > > > Can you share what the output looks like with the patch? > > > > Hive has thousands of ".q" file tests > > (https://github.com/apache/hive/tree/trunk/ql/src/test/queries/clientpositive) > > and most of them do an EXPLAIN.

[jira] [Commented] (HIVE-7540) NotSerializableException encountered when using sortByKey transformation

2014-08-04 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085875#comment-14085875 ] Xuefu Zhang commented on HIVE-7540: --- Here is what I have in mind: 1. per-row serializatio

[jira] [Updated] (HIVE-7612) Add link to parent vertex to mapjoin in explain

2014-08-04 Thread Gunther Hagleitner (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gunther Hagleitner updated HIVE-7612: - Attachment: HIVE-7612.1.patch > Add link to parent vertex to mapjoin in explain >

[jira] [Created] (HIVE-7612) Add link to parent vertex to mapjoin in explain

2014-08-04 Thread Gunther Hagleitner (JIRA)
Gunther Hagleitner created HIVE-7612: Summary: Add link to parent vertex to mapjoin in explain Key: HIVE-7612 URL: https://issues.apache.org/jira/browse/HIVE-7612 Project: Hive Issue Type

[jira] [Updated] (HIVE-7589) Some fixes and improvements to statistics annotation rules

2014-08-04 Thread Prasanth J (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth J updated HIVE-7589: - Attachment: HIVE-7589.4.patch Rebased patch after HIVE-7587 commit. > Some fixes and improvements to stat

Re: Review Request 24221: HIVE-7567, support automatic adjusting reducer number for hive on spark job

2014-08-04 Thread Lars Francke
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/24221/#review49565 --- Ship it! A few more minor code style issues, apart from that it loo

[jira] [Commented] (HIVE-7584) Change SparkCompiler to generate a SparkWork that contains UnionWork from logical operator tree

2014-08-04 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085860#comment-14085860 ] Szehon Ho commented on HIVE-7584: - Hi Na, as per my understanding the patch has to be label

Re: Review Request 24297: Spark "Explain" should give useful information on dependencies

2014-08-04 Thread Brock Noland
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/24297/#review49570 --- Hi Chao, Can you share what the output looks like with the patch?

Re: Review Request 24297: Spark "Explain" should give useful information on dependencies

2014-08-04 Thread Chao Sun
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/24297/ --- (Updated Aug. 5, 2014, 6:09 a.m.) Review request for hive and Brock Noland. B

[jira] [Commented] (HIVE-7606) Design SparkSession, SparkSessionManager

2014-08-04 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085853#comment-14085853 ] Xuefu Zhang commented on HIVE-7606: --- Yes, smaller tasks make sense as long as the scope o

[jira] [Updated] (HIVE-7607) Spark "Explain" should give useful information on dependencies

2014-08-04 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao updated HIVE-7607: --- Status: Patch Available (was: Open) > Spark "Explain" should give useful information on dependencies > --

Re: Review Request 23351: Support direct fetch for lateral views, sub queries, etc.

2014-08-04 Thread Gopal V
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/23351/#review49569 --- Ship it! Ship It! - Gopal V On July 9, 2014, 6:55 a.m., Navis Ry

Re: Review Request 23351: Support direct fetch for lateral views, sub queries, etc.

2014-08-04 Thread Gopal V
> On Aug. 1, 2014, 6:21 a.m., Gopal V wrote: > > ql/src/java/org/apache/hadoop/hive/ql/optimizer/SimpleFetchOptimizer.java, > > line 161 > > > > > > This needs some comments, because I'm lost on what this exactly does

[jira] [Commented] (HIVE-5718) Support direct fetch for lateral views, sub queries, etc.

2014-08-04 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085851#comment-14085851 ] Gopal V commented on HIVE-5718: --- +1, LGTM. I suggest leaving some comments about the alias.s

[jira] [Updated] (HIVE-7587) Fetch aggregated stats from MetaStore

2014-08-04 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-7587: --- Resolution: Fixed Fix Version/s: 0.14.0 Status: Resolved (was: Patch Availab

[jira] [Commented] (HIVE-7587) Fetch aggregated stats from MetaStore

2014-08-04 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085838#comment-14085838 ] Hive QA commented on HIVE-7587: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-7527) Support order by and sort by on Spark

2014-08-04 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085836#comment-14085836 ] Rui Li commented on HIVE-7527: -- Thanks [~brocknoland] for the review :-) > Support order by a

[jira] [Commented] (HIVE-7567) support automatic calculating reduce task number [Spark Branch]

2014-08-04 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085833#comment-14085833 ] Brock Noland commented on HIVE-7567: I have committed HIVE-7527 so this patch can be re

[jira] [Updated] (HIVE-7527) Support order by and sort by on Spark

2014-08-04 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-7527: --- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Commented] (HIVE-7527) Support order by and sort by on Spark

2014-08-04 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085831#comment-14085831 ] Brock Noland commented on HIVE-7527: Actually since we don't yet have any tests that ca

Re: Review Request 24293: HIVE-4629: HS2 should support an API to retrieve query logs

2014-08-04 Thread Brock Noland
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/24293/#review49563 --- This is awesome! I have two minor comments and I will let others do

Re: Review Request 24221: HIVE-7567, support automatic adjusting reducer number for hive on spark job

2014-08-04 Thread chengxiang li
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/24221/ --- (Updated Aug. 5, 2014, 5:32 a.m.) Review request for hive, Brock Noland, Lars F

[jira] [Updated] (HIVE-7567) support automatic calculating reduce task number [Spark Branch]

2014-08-04 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7567: Attachment: HIVE-7567.4-spark.patch > support automatic calculating reduce task number [Spark Branch

[jira] [Commented] (HIVE-7527) Support order by and sort by on Spark

2014-08-04 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085823#comment-14085823 ] Brock Noland commented on HIVE-7527: +1 I'll let the tests run and then commit this.

[jira] [Commented] (HIVE-7567) support automatic calculating reduce task number [Spark Branch]

2014-08-04 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085824#comment-14085824 ] Brock Noland commented on HIVE-7567: Hi [~chengxiang li], HIVE-7527 is a bit smaller s

[jira] [Commented] (HIVE-7540) NotSerializableException encountered when using sortByKey transformation

2014-08-04 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085821#comment-14085821 ] Brock Noland commented on HIVE-7540: Thanks Sandy. For the specific RangePartitioner ca

[jira] [Commented] (HIVE-7527) Support order by and sort by on Spark

2014-08-04 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085817#comment-14085817 ] Rui Li commented on HIVE-7527: -- Hi [~brocknoland] I've updated the patch. Please help to revie

[jira] [Updated] (HIVE-7527) Support order by and sort by on Spark

2014-08-04 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-7527: - Attachment: HIVE-7527.2-spark.patch > Support order by and sort by on Spark >

Re: Review Request 23674: Handle db qualified names consistently across all HiveQL statements

2014-08-04 Thread Thejas Nair
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/23674/#review49498 --- ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java

[jira] [Commented] (HIVE-4064) Handle db qualified names consistently across all HiveQL statements

2014-08-04 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085813#comment-14085813 ] Thejas M Nair commented on HIVE-4064: - Added some comments in review board. > Handle

Review Request 24295: Change SparkCompiler to generate a SparkWork that contains UnionWork from logical operator tree

2014-08-04 Thread Na Yang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/24295/ --- Review request for hive, Brock Noland, Szehon Ho, and Xuefu Zhang. Bugs: HIVE-7

[jira] [Commented] (HIVE-7446) Add support to ALTER TABLE .. ADD COLUMN to Avro backed tables

2014-08-04 Thread Ashish Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085794#comment-14085794 ] Ashish Kumar Singh commented on HIVE-7446: -- [~szehon] Do you something like this w

[jira] [Commented] (HIVE-7540) NotSerializableException encountered when using sortByKey transformation

2014-08-04 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085786#comment-14085786 ] Sandy Ryza commented on HIVE-7540: -- In general a Spark closure is a Serializable object.

[jira] [Updated] (HIVE-4629) HS2 should support an API to retrieve query logs

2014-08-04 Thread Dong Chen (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Chen updated HIVE-4629: Attachment: HIVE-4629.4.patch A patch HIVE-4629.4.patch is attached, which trying to address the comments in

[jira] [Commented] (HIVE-7540) NotSerializableException encountered when using sortByKey transformation

2014-08-04 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085766#comment-14085766 ] Brock Noland commented on HIVE-7540: Thx Sandy. The performance discussion here relates

[jira] [Commented] (HIVE-7592) List Jars or Files are not supported by Beeline

2014-08-04 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085759#comment-14085759 ] Ferdinand Xu commented on HIVE-7592: Thanks for your patch. Can you create an review bo

[jira] [Commented] (HIVE-7540) NotSerializableException encountered when using sortByKey transformation

2014-08-04 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085755#comment-14085755 ] Sandy Ryza commented on HIVE-7540: -- There are two main cases where serialization occurs in

[jira] [Updated] (HIVE-7567) support automatic calculating reduce task number [Spark Branch]

2014-08-04 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7567: Attachment: HIVE-7567.3-spark.patch > support automatic calculating reduce task number [Spark Branch

Re: Review Request 24221: HIVE-7567, support automatic adjusting reducer number for hive on spark job

2014-08-04 Thread chengxiang li
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/24221/ --- (Updated Aug. 5, 2014, 3:53 a.m.) Review request for hive, Brock Noland, Lars F

[jira] [Updated] (HIVE-7567) support automatic calculating reduce task number [Spark Branch]

2014-08-04 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7567: Attachment: (was: HIVE-7567.3-spark.patch) > support automatic calculating reduce task number [S

Re: Review Request 24221: HIVE-7567, support automatic adjusting reducer number for hive on spark job

2014-08-04 Thread Brock Noland
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/24221/#review49557 --- This looks great! I've made a few comments below, all of which are m

Review Request 24293: HIVE-4629: HS2 should support an API to retrieve query logs

2014-08-04 Thread Dong Chen
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/24293/ --- Review request for hive. Repository: hive-git Description --- HIVE-4629:

Re: Review Request 24221: HIVE-7567, support automatic adjusting reducer number for hive on spark job

2014-08-04 Thread chengxiang li
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/24221/ --- (Updated Aug. 5, 2014, 3:43 a.m.) Review request for hive, Brock Noland, Lars F

[jira] [Updated] (HIVE-7567) support automatic calculating reduce task number [Spark Branch]

2014-08-04 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7567: Attachment: HIVE-7567.3-spark.patch > support automatic calculating reduce task number [Spark Branch

[jira] [Commented] (HIVE-7606) Design SparkSession, SparkSessionManager

2014-08-04 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085724#comment-14085724 ] Brock Noland commented on HIVE-7606: Hi [~xuefuz], HIVE-7516 is a very large task. Do

[jira] [Commented] (HIVE-7540) NotSerializableException encountered when using sortByKey transformation

2014-08-04 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085717#comment-14085717 ] Brock Noland commented on HIVE-7540: Hi [~xuefuz], I agree it will cause performance t

[jira] [Commented] (HIVE-7519) Refactor QTestUtil to remove its duplication with QFileClient for qtest setup and teardown

2014-08-04 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085709#comment-14085709 ] Hive QA commented on HIVE-7519: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-7426) ClassCastException: ...IntWritable cannot be cast to ...Text involving ql.udf.generic.GenericUDFBasePad.evaluate

2014-08-04 Thread Hari Sankar Sivarama Subramaniyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085698#comment-14085698 ] Hari Sankar Sivarama Subramaniyan commented on HIVE-7426: - +1 for t

[jira] [Commented] (HIVE-6245) HS2 creates DBs/Tables with wrong ownership when HMS setugi is true

2014-08-04 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085692#comment-14085692 ] Alexander Pivovarov commented on HIVE-6245: --- I applied patch HIVE-6245.3.patch.tx

[jira] [Commented] (HIVE-7540) NotSerializableException encountered when using sortByKey transformation

2014-08-04 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085695#comment-14085695 ] Xuefu Zhang commented on HIVE-7540: --- It's good to try this out. However, I still think th

[jira] [Commented] (HIVE-7527) Support order by and sort by on Spark

2014-08-04 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085691#comment-14085691 ] Xuefu Zhang commented on HIVE-7527: --- [~lirui] It should be okay, if the conflicts are jus

[jira] [Resolved] (HIVE-7611) Workaround for pom issue with optiq-avatica

2014-08-04 Thread Gunther Hagleitner (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gunther Hagleitner resolved HIVE-7611. -- Resolution: Fixed Committed to branch. > Workaround for pom issue with optiq-avatica >

[jira] [Updated] (HIVE-7608) Add log stmt to print Optiq Optimized AST

2014-08-04 Thread Gunther Hagleitner (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gunther Hagleitner updated HIVE-7608: - Resolution: Fixed Status: Resolved (was: Patch Available) Committed to branch. Th

[jira] [Created] (HIVE-7611) Workaround for pom issue with optiq-avatica

2014-08-04 Thread Gunther Hagleitner (JIRA)
Gunther Hagleitner created HIVE-7611: Summary: Workaround for pom issue with optiq-avatica Key: HIVE-7611 URL: https://issues.apache.org/jira/browse/HIVE-7611 Project: Hive Issue Type: Su

[jira] [Updated] (HIVE-7611) Workaround for pom issue with optiq-avatica

2014-08-04 Thread Gunther Hagleitner (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gunther Hagleitner updated HIVE-7611: - Attachment: HIVE-7611.1.patch > Workaround for pom issue with optiq-avatica >

[jira] [Commented] (HIVE-7527) Support order by and sort by on Spark

2014-08-04 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085680#comment-14085680 ] Rui Li commented on HIVE-7527: -- I also noticed that the numPartitions stuff has some conflicts

[jira] [Commented] (HIVE-7527) Support order by and sort by on Spark

2014-08-04 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085675#comment-14085675 ] Rui Li commented on HIVE-7527: -- Thanks [~brocknoland], I've created the request at: https://re

[jira] [Commented] (HIVE-7426) ClassCastException: ...IntWritable cannot be cast to ...Text involving ql.udf.generic.GenericUDFBasePad.evaluate

2014-08-04 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085677#comment-14085677 ] Matt McCline commented on HIVE-7426: Thanks Jason !!! > ClassCastException: ...IntWrit

[jira] [Commented] (HIVE-7540) NotSerializableException encountered when using sortByKey transformation

2014-08-04 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085670#comment-14085670 ] Rui Li commented on HIVE-7540: -- OK got it. Let me try it out. > NotSerializableException enco

[jira] [Commented] (HIVE-7606) Design SparkSession, SparkSessionManager

2014-08-04 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085669#comment-14085669 ] Xuefu Zhang commented on HIVE-7606: --- This seems a little duplicating HIVE-7516. > Design

[jira] [Commented] (HIVE-7540) NotSerializableException encountered when using sortByKey transformation

2014-08-04 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085668#comment-14085668 ] Brock Noland commented on HIVE-7540: Hi, I am hoping we don't have to transform back s

[jira] [Commented] (HIVE-7426) ClassCastException: ...IntWritable cannot be cast to ...Text involving ql.udf.generic.GenericUDFBasePad.evaluate

2014-08-04 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085665#comment-14085665 ] Jason Dere commented on HIVE-7426: -- +1 > ClassCastException: ...IntWritable cannot be cas

[jira] [Commented] (HIVE-7540) NotSerializableException encountered when using sortByKey transformation

2014-08-04 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085662#comment-14085662 ] Rui Li commented on HIVE-7540: -- Hi [~brocknoland], we're using BytesWritable because the key o

[jira] [Updated] (HIVE-7426) ClassCastException: ...IntWritable cannot be cast to ...Text involving ql.udf.generic.GenericUDFBasePad.evaluate

2014-08-04 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-7426: --- Status: Patch Available (was: In Progress) > ClassCastException: ...IntWritable cannot be cast to ...

[jira] [Commented] (HIVE-7463) Add rule for transitive inference

2014-08-04 Thread Harish Butani (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085658#comment-14085658 ] Harish Butani commented on HIVE-7463: - Depends on OPTIQ-360 > Add rule for transitive

[jira] [Updated] (HIVE-7426) ClassCastException: ...IntWritable cannot be cast to ...Text involving ql.udf.generic.GenericUDFBasePad.evaluate

2014-08-04 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-7426: --- Status: In Progress (was: Patch Available) > ClassCastException: ...IntWritable cannot be cast to ...

[jira] [Updated] (HIVE-7426) ClassCastException: ...IntWritable cannot be cast to ...Text involving ql.udf.generic.GenericUDFBasePad.evaluate

2014-08-04 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-7426: --- Attachment: HIVE-7426.2.patch > ClassCastException: ...IntWritable cannot be cast to ...Text involving

[jira] [Commented] (HIVE-7527) Support order by and sort by on Spark

2014-08-04 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085654#comment-14085654 ] Brock Noland commented on HIVE-7527: Hi, You can leave that empty and then post the RB

[jira] [Commented] (HIVE-7527) Support order by and sort by on Spark

2014-08-04 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085642#comment-14085642 ] Rui Li commented on HIVE-7527: -- Hi [~brocknoland], how to specify reviewer/group to publish a

Review Request 24289: MetadataUpdater: provide a mechanism to edit the statistics of a column in a table (or a partition of a table)

2014-08-04 Thread pengcheng xiong
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/24289/ --- Review request for hive. Repository: hive-git Description --- This patch

[jira] [Created] (HIVE-7610) Hive should not define a committer for Tez if the committer is a no-op

2014-08-04 Thread Hitesh Shah (JIRA)
Hitesh Shah created HIVE-7610: - Summary: Hive should not define a committer for Tez if the committer is a no-op Key: HIVE-7610 URL: https://issues.apache.org/jira/browse/HIVE-7610 Project: Hive

[jira] [Updated] (HIVE-7506) MetadataUpdater: provide a mechanism to edit the statistics of a column in a table (or a partition of a table)

2014-08-04 Thread pengcheng xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] pengcheng xiong updated HIVE-7506: -- Attachment: HIVE-7506.3.patch a version without changing thrift auto-generated code. > Metadata

[jira] [Updated] (HIVE-7441) Custom partition scheme gets rewritten with hive scheme upon concatenate

2014-08-04 Thread Chaoyu Tang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chaoyu Tang updated HIVE-7441: -- Fix Version/s: 0.14.0 Status: Patch Available (was: Open) > Custom partition scheme gets rew

[jira] [Updated] (HIVE-7441) Custom partition scheme gets rewritten with hive scheme upon concatenate

2014-08-04 Thread Chaoyu Tang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chaoyu Tang updated HIVE-7441: -- Attachment: HIVE-7441.patch Please review the attached patch in https://reviews.apache.org/r/24284/, tha

Review Request 24284: HIVE-7441:Custom partition scheme gets rewritten with hive scheme upon concatenate

2014-08-04 Thread Chaoyu Tang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/24284/ --- Review request for hive. Bugs: HIVE-7441 https://issues.apache.org/jira/bro

Re: Why does SMB join generate hash table locally, even if input tables are large?

2014-08-04 Thread Pala M Muthaia
Thanks for the response Navis. I tried the repro again from the beginning, and it doesn't result in hash table generation. I may have had some setting that enforced map join. The plan generated shows a conditional stage pointing to a simple map and reduce stage. At runtime, however, the query res

[jira] [Commented] (HIVE-7609) Collect partition level stats by default

2014-08-04 Thread Prasanth J (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085602#comment-14085602 ] Prasanth J commented on HIVE-7609: -- LGTM +1 > Collect partition level stats by default >

[jira] [Commented] (HIVE-7561) StarterProject: Move from assert to Guava Preconditions.* in Hive on Spark

2014-08-04 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085578#comment-14085578 ] Brock Noland commented on HIVE-7561: +1 > StarterProject: Move from assert to Guava Pr

[jira] [Updated] (HIVE-7561) StarterProject: Move from assert to Guava Preconditions.* in Hive on Spark

2014-08-04 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-7561: --- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

Re: Review Request 24195: StarterProject: Move from assert to Guava Preconditions.* in Hive on Spark

2014-08-04 Thread Brock Noland
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/24195/#review49546 --- Ship it! Ship It! - Brock Noland On Aug. 4, 2014, 9:50 p.m., Cha

[jira] [Commented] (HIVE-7561) StarterProject: Move from assert to Guava Preconditions.* in Hive on Spark

2014-08-04 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085566#comment-14085566 ] Hive QA commented on HIVE-7561: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-7554) Parquet Hive should resolve column names in case insensitive manner

2014-08-04 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085548#comment-14085548 ] Hive QA commented on HIVE-7554: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Updated] (HIVE-7589) Some fixes and improvements to statistics annotation rules

2014-08-04 Thread Prasanth J (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth J updated HIVE-7589: - Attachment: HIVE-7589.3.patch More test case failure fixes. > Some fixes and improvements to statistics a

[jira] [Commented] (HIVE-7540) NotSerializableException encountered when using sortByKey transformation

2014-08-04 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085539#comment-14085539 ] Brock Noland commented on HIVE-7540: Hi [~lirui], It seems this related to serializing

[jira] [Updated] (HIVE-7607) Spark "Explain" should give useful information on dependencies

2014-08-04 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao updated HIVE-7607: --- Attachment: HIVE-7607.2-spark.patch In the last patch I overlooked that the code is already in the "".. instanceof Li

[jira] [Commented] (HIVE-7513) Add ROW__ID VirtualColumn

2014-08-04 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085504#comment-14085504 ] Eugene Koifman commented on HIVE-7513: -- [~navis], I'm not sure how it would work with

[jira] [Updated] (HIVE-7426) ClassCastException: ...IntWritable cannot be cast to ...Text involving ql.udf.generic.GenericUDFBasePad.evaluate

2014-08-04 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-7426: --- Status: Patch Available (was: Open) > ClassCastException: ...IntWritable cannot be cast to ...Text in

[jira] [Updated] (HIVE-7426) ClassCastException: ...IntWritable cannot be cast to ...Text involving ql.udf.generic.GenericUDFBasePad.evaluate

2014-08-04 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-7426: --- Attachment: HIVE-7426.1.patch > ClassCastException: ...IntWritable cannot be cast to ...Text involving

[jira] [Commented] (HIVE-7426) ClassCastException: ...IntWritable cannot be cast to ...Text involving ql.udf.generic.GenericUDFBasePad.evaluate

2014-08-04 Thread Hari Sankar Sivarama Subramaniyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085482#comment-14085482 ] Hari Sankar Sivarama Subramaniyan commented on HIVE-7426: - One of t

[jira] [Updated] (HIVE-7608) Add log stmt to print Optiq Optimized AST

2014-08-04 Thread Laljo John Pullokkaran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Laljo John Pullokkaran updated HIVE-7608: - Issue Type: Sub-task (was: Bug) Parent: HIVE-5775 > Add log stmt to print

Review Request 24274: Collect partition level stats by default

2014-08-04 Thread Ashutosh Chauhan
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/24274/ --- Review request for hive and Prasanth_J. Bugs: HIVE-7609 https://issues.apac

[jira] [Updated] (HIVE-7609) Collect partition level stats by default

2014-08-04 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-7609: --- Affects Version/s: 0.12.0 0.13.0 0.13.1

[jira] [Updated] (HIVE-7607) Spark "Explain" should give useful information on dependencies

2014-08-04 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao updated HIVE-7607: --- Attachment: HIVE-7607.1-spark.patch Modified ExplainWork to make it work for the case {{Map>}} in general. > Spark "E

[jira] [Updated] (HIVE-7609) Collect partition level stats by default

2014-08-04 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-7609: --- Attachment: HIVE-7609.1.patch > Collect partition level stats by default > ---

[jira] [Updated] (HIVE-7513) Add ROW__ID VirtualColumn

2014-08-04 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-7513: - Attachment: HIVE-7513.5.patch HIVE-7513.5.patch - fix a few more tests > Add ROW__ID VirtualColu

[jira] [Updated] (HIVE-7608) Add log stmt to print Optiq Optimized AST

2014-08-04 Thread Laljo John Pullokkaran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Laljo John Pullokkaran updated HIVE-7608: - Status: Patch Available (was: Open) > Add log stmt to print Optiq Optimized AST >

  1   2   3   >