[jira] [Commented] (HIVE-8836) Enable automatic tests with remote spark client [Spark Branch]

2014-11-25 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225860#comment-14225860 ] Rui Li commented on HIVE-8836: -- Shall we use same #reducers as before for now? So that we can

[jira] [Created] (HIVE-8973) Add support for pulling HBase columns with regex matching

2014-11-25 Thread Sucaz Moshe (JIRA)
Sucaz Moshe created HIVE-8973: - Summary: Add support for pulling HBase columns with regex matching Key: HIVE-8973 URL: https://issues.apache.org/jira/browse/HIVE-8973 Project: Hive Issue Type: Im

[jira] [Commented] (HIVE-8836) Enable automatic tests with remote spark client [Spark Branch]

2014-11-25 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225849#comment-14225849 ] Hive QA commented on HIVE-8836: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Updated] (HIVE-8970) Enable map join optimization only when hive.auto.convert.join is true [Spark Branch]

2014-11-25 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao updated HIVE-8970: --- Attachment: HIVE-8970.1-spark.patch > Enable map join optimization only when hive.auto.convert.join is true [Spark > B

[jira] [Updated] (HIVE-8970) Enable map join optimization only when hive.auto.convert.join is true [Spark Branch]

2014-11-25 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao updated HIVE-8970: --- Status: Patch Available (was: Open) > Enable map join optimization only when hive.auto.convert.join is true [Spark >

[jira] [Commented] (HIVE-8961) Remove unnecessary dependency collection task [Spark Branch]

2014-11-25 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225826#comment-14225826 ] Rui Li commented on HIVE-8961: -- Thanks [~xuefuz] for the work. > Remove unnecessary dependenc

[jira] [Commented] (HIVE-8398) ExprNodeColumnDesc cannot be cast to ExprNodeConstantDesc

2014-11-25 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225825#comment-14225825 ] Szehon Ho commented on HIVE-8398: - Patch looks ok to me. It would be great if you could ad

[jira] [Commented] (HIVE-6361) Un-fork Sqlline

2014-11-25 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225817#comment-14225817 ] Hive QA commented on HIVE-6361: --- {color:red}Overall{color}: -1 no tests executed Here are

[jira] [Updated] (HIVE-8961) Remove unnecessary dependency collection task [Spark Branch]

2014-11-25 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8961: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available)

[jira] [Commented] (HIVE-6421) abs() should preserve precision/scale of decimal input

2014-11-25 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225812#comment-14225812 ] Hive QA commented on HIVE-6421: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-8961) Remove unnecessary dependency collection task [Spark Branch]

2014-11-25 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225810#comment-14225810 ] Xuefu Zhang commented on HIVE-8961: --- alter_partition_coltype.q failure doesn't seem relat

[jira] [Commented] (HIVE-8836) Enable automatic tests with remote spark client [Spark Branch]

2014-11-25 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225803#comment-14225803 ] Xuefu Zhang commented on HIVE-8836: --- Yeah. but it also means that when dev generates the

[jira] [Commented] (HIVE-8961) Remove unnecessary dependency collection task [Spark Branch]

2014-11-25 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225804#comment-14225804 ] Hive QA commented on HIVE-8961: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-8836) Enable automatic tests with remote spark client [Spark Branch]

2014-11-25 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225795#comment-14225795 ] Brock Noland commented on HIVE-8836: bq. This is not good, because every time we change

[jira] [Updated] (HIVE-8836) Enable automatic tests with remote spark client [Spark Branch]

2014-11-25 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-8836: --- Attachment: HIVE-8836.6-spark.patch Running tests on the patch again. > Enable automatic tests with re

[jira] [Commented] (HIVE-8924) Investigate test failure for join_empty.q [Spark Branch]

2014-11-25 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225789#comment-14225789 ] Xuefu Zhang commented on HIVE-8924: --- Thanks for the explanation. +1 pending on test. > I

[jira] [Commented] (HIVE-8971) HIVE-8965 exposed some classes which start with Test but are not tests

2014-11-25 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225787#comment-14225787 ] Xuefu Zhang commented on HIVE-8971: --- Looks like the patch is about renaming. +1 pending o

[jira] [Updated] (HIVE-8971) HIVE-8965 exposed some classes which start with Test but are not tests

2014-11-25 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-8971: --- Attachment: HIVE-8971.patch > HIVE-8965 exposed some classes which start with Test but are not tests >

[jira] [Updated] (HIVE-8971) HIVE-8965 exposed some classes which start with Test but are not tests

2014-11-25 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-8971: --- Assignee: Brock Noland Status: Patch Available (was: Open) > HIVE-8965 exposed some classes whic

[jira] [Commented] (HIVE-8836) Enable automatic tests with remote spark client [Spark Branch]

2014-11-25 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225779#comment-14225779 ] Xuefu Zhang commented on HIVE-8836: --- Many test failures above are shown as plan diff, som

[jira] [Commented] (HIVE-8956) Hive hangs while some error/exception happens beyond job execution [Spark Branch]

2014-11-25 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225763#comment-14225763 ] Rui Li commented on HIVE-8956: -- Yeah I created HIVE-8972 as a follow up. As for retry failed j

[jira] [Updated] (HIVE-8972) Implement more fine-grained remote client-level events [Spark Branch]

2014-11-25 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8972: -- Issue Type: Sub-task (was: Improvement) Parent: HIVE-8548 > Implement more fine-grained remote c

[jira] [Created] (HIVE-8972) Implement more fine-grained remote client-level events [Spark Branch]

2014-11-25 Thread Rui Li (JIRA)
Rui Li created HIVE-8972: Summary: Implement more fine-grained remote client-level events [Spark Branch] Key: HIVE-8972 URL: https://issues.apache.org/jira/browse/HIVE-8972 Project: Hive Issue Type:

[jira] [Commented] (HIVE-8836) Enable automatic tests with remote spark client [Spark Branch]

2014-11-25 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225754#comment-14225754 ] Brock Noland commented on HIVE-8836: {noformat} TestSparkCliDriver-join11.q-join18.q-gr

[jira] [Commented] (HIVE-8965) Enhance PTest to kill all processes between tests and to report when a TEST*.xml file is not generated

2014-11-25 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225753#comment-14225753 ] Brock Noland commented on HIVE-8965: FYI this exposed HIVE-8971. > Enhance PTest to ki

[jira] [Updated] (HIVE-8956) Hive hangs while some error/exception happens beyond job execution [Spark Branch]

2014-11-25 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-8956: --- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available)

[jira] [Commented] (HIVE-8956) Hive hangs while some error/exception happens beyond job execution [Spark Branch]

2014-11-25 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225750#comment-14225750 ] Brock Noland commented on HIVE-8956: [~lirui] can you create a follow-on ticket for [~v

[jira] [Commented] (HIVE-8836) Enable automatic tests with remote spark client [Spark Branch]

2014-11-25 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225751#comment-14225751 ] Rui Li commented on HIVE-8836: -- OK I'll try out the failed tests. > Enable automatic tests wi

[jira] [Updated] (HIVE-8971) HIVE-8965 exposed some classes which start with Test but are not tests

2014-11-25 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-8971: --- Description: >From the output here: >https://issues.apache.org/jira/browse/HIVE-8836?focusedCommentId=

[jira] [Created] (HIVE-8971) HIVE-8965 exposed some classes which start with Test but are not tests

2014-11-25 Thread Brock Noland (JIRA)
Brock Noland created HIVE-8971: -- Summary: HIVE-8965 exposed some classes which start with Test but are not tests Key: HIVE-8971 URL: https://issues.apache.org/jira/browse/HIVE-8971 Project: Hive

[jira] [Commented] (HIVE-8836) Enable automatic tests with remote spark client [Spark Branch]

2014-11-25 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225742#comment-14225742 ] Hive QA commented on HIVE-8836: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-8956) Hive hangs while some error/exception happens beyond job execution [Spark Branch]

2014-11-25 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225734#comment-14225734 ] Brock Noland commented on HIVE-8956: Based on what we are seeing in HIVE-8836 I wonder

[jira] [Commented] (HIVE-8836) Enable automatic tests with remote spark client [Spark Branch]

2014-11-25 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225732#comment-14225732 ] Brock Noland commented on HIVE-8836: [~lirui] that does look like it might be related!

[jira] [Updated] (HIVE-8956) Hive hangs while some error/exception happens beyond job execution [Spark Branch]

2014-11-25 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-8956: --- Summary: Hive hangs while some error/exception happens beyond job execution [Spark Branch] (was: Hive

[jira] [Commented] (HIVE-8924) Investigate test failure for join_empty.q [Spark Branch]

2014-11-25 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225729#comment-14225729 ] Szehon Ho commented on HIVE-8924: - Clarification: currently SparkMapJoinResolver.containsOp

[jira] [Commented] (HIVE-8836) Enable automatic tests with remote spark client [Spark Branch]

2014-11-25 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225730#comment-14225730 ] Brock Noland commented on HIVE-8836: Looks like it's: {noformat} Begin query: optimize

[jira] [Commented] (HIVE-8924) Investigate test failure for join_empty.q [Spark Branch]

2014-11-25 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225724#comment-14225724 ] Szehon Ho commented on HIVE-8924: - In SparkMapJoinResolver.containsOp, it calls MapWork.get

[jira] [Comment Edited] (HIVE-8836) Enable automatic tests with remote spark client [Spark Branch]

2014-11-25 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225716#comment-14225716 ] Brock Noland edited comment on HIVE-8836 at 11/26/14 4:30 AM: --

[jira] [Assigned] (HIVE-8962) Add SORT_QUERY_RESULTS for join tests that do not guarantee order #2

2014-11-25 Thread Chinna Rao Lalam (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinna Rao Lalam reassigned HIVE-8962: -- Assignee: Chao (was: Chinna Rao Lalam) > Add SORT_QUERY_RESULTS for join tests that do

[jira] [Commented] (HIVE-8836) Enable automatic tests with remote spark client [Spark Branch]

2014-11-25 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225721#comment-14225721 ] Rui Li commented on HIVE-8836: -- Hi [~brocknoland], this may be related to HIVE-8956. Do you kn

[jira] [Commented] (HIVE-8836) Enable automatic tests with remote spark client [Spark Branch]

2014-11-25 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225716#comment-14225716 ] Brock Noland commented on HIVE-8836: Again with the latest patch two tests are stuck. I

[jira] [Assigned] (HIVE-8970) Enable map join optimization only when hive.auto.convert.join is true [Spark Branch]

2014-11-25 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao reassigned HIVE-8970: -- Assignee: Chao > Enable map join optimization only when hive.auto.convert.join is true [Spark > Branch] > -

[jira] [Commented] (HIVE-8934) Investigate test failure on bucketmapjoin10.q and bucketmapjoin11.q [Spark Branch]

2014-11-25 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225701#comment-14225701 ] Chao commented on HIVE-8934: Xuefu, the change on MapJoinTableContainerSerDe is for Spark only,

[jira] [Comment Edited] (HIVE-8934) Investigate test failure on bucketmapjoin10.q and bucketmapjoin11.q [Spark Branch]

2014-11-25 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225688#comment-14225688 ] Xuefu Zhang edited comment on HIVE-8934 at 11/26/14 4:07 AM: - N

[jira] [Commented] (HIVE-8934) Investigate test failure on bucketmapjoin10.q and bucketmapjoin11.q [Spark Branch]

2014-11-25 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225688#comment-14225688 ] Xuefu Zhang commented on HIVE-8934: --- Nice work. Just curious, since the changes are in co

[jira] [Commented] (HIVE-8924) Investigate test failure for join_empty.q [Spark Branch]

2014-11-25 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225680#comment-14225680 ] Xuefu Zhang commented on HIVE-8924: --- Not sure if I understand the problem and the fix. Wh

[jira] [Commented] (HIVE-8536) Enable SkewJoinResolver for spark [Spark Branch]

2014-11-25 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225677#comment-14225677 ] Rui Li commented on HIVE-8536: -- Thanks [~csun], I can verify this later. For now, let's stick

[jira] [Updated] (HIVE-4766) Support HS2 client login timeout when the thrift thread max# is reached

2014-11-25 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho updated HIVE-4766: Resolution: Fixed Fix Version/s: (was: 0.14.1) Status: Resolved (was: Patch Available)

[jira] [Commented] (HIVE-4766) Support HS2 client login timeout when the thrift thread max# is reached

2014-11-25 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225664#comment-14225664 ] Szehon Ho commented on HIVE-4766: - Properties need to be documented at: [https://cwiki.apa

[jira] [Updated] (HIVE-8924) Investigate test failure for join_empty.q [Spark Branch]

2014-11-25 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho updated HIVE-8924: Status: Patch Available (was: Open) > Investigate test failure for join_empty.q [Spark Branch] > ---

[jira] [Updated] (HIVE-8924) Investigate test failure for join_empty.q [Spark Branch]

2014-11-25 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho updated HIVE-8924: Attachment: HIVE-8924-spark.patch Attaching a fix. For this case, there was a NPE in execution as SparkMapJ

[jira] [Created] (HIVE-8970) Enable map join optimization only when hive.auto.convert.join is true [Spark Branch]

2014-11-25 Thread Chao (JIRA)
Chao created HIVE-8970: -- Summary: Enable map join optimization only when hive.auto.convert.join is true [Spark Branch] Key: HIVE-8970 URL: https://issues.apache.org/jira/browse/HIVE-8970 Project: Hive

[jira] [Commented] (HIVE-8934) Investigate test failure on bucketmapjoin10.q and bucketmapjoin11.q [Spark Branch]

2014-11-25 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225654#comment-14225654 ] Szehon Ho commented on HIVE-8934: - +1, Looked at test with Chao, for this test the table is

[jira] [Commented] (HIVE-4766) Support HS2 client login timeout when the thrift thread max# is reached

2014-11-25 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225655#comment-14225655 ] Hive QA commented on HIVE-4766: --- {color:red}Overall{color}: -1 at least one tests failed H

Review Request 28464: HIVE-8934 - Investigate test failure on bucketmapjoin10.q and bucketmapjoin11.q [Spark Branch]

2014-11-25 Thread Chao Sun
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28464/ --- Review request for hive, Jimmy Xiang, Szehon Ho, and Xuefu Zhang. Bugs: HIVE-89

[jira] [Commented] (HIVE-8536) Enable SkewJoinResolver for spark [Spark Branch]

2014-11-25 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225643#comment-14225643 ] Chao commented on HIVE-8536: [~lirui] I couldn't think up a query that has skewjoin AND multi-i

[jira] [Commented] (HIVE-8934) Investigate test failure on bucketmapjoin10.q and bucketmapjoin11.q [Spark Branch]

2014-11-25 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225640#comment-14225640 ] Chao commented on HIVE-8934: The reason for this issue is that {{MapJoinTableContainerSerDe#loa

[jira] [Commented] (HIVE-7329) Create SparkWork [Spark Branch]

2014-11-25 Thread yuemeng (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225635#comment-14225635 ] yuemeng commented on HIVE-7329: --- hi,XueFu. i builted hive on spark (spark branch on https:/

[jira] [Updated] (HIVE-8934) Investigate test failure on bucketmapjoin10.q and bucketmapjoin11.q [Spark Branch]

2014-11-25 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao updated HIVE-8934: --- Status: Patch Available (was: Open) > Investigate test failure on bucketmapjoin10.q and bucketmapjoin11.q [Spark > Br

[jira] [Updated] (HIVE-8934) Investigate test failure on bucketmapjoin10.q and bucketmapjoin11.q [Spark Branch]

2014-11-25 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao updated HIVE-8934: --- Attachment: HIVE-8934.1-spark.patch > Investigate test failure on bucketmapjoin10.q and bucketmapjoin11.q [Spark > Bra

[jira] [Commented] (HIVE-8961) Remove unnecessary dependency collection task [Spark Branch]

2014-11-25 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225619#comment-14225619 ] Xuefu Zhang commented on HIVE-8961: --- [~ruili], no problem. I just wanted to get this in a

[jira] [Commented] (HIVE-8956) Hive hangs while some error/exception happens beyond job execution[Spark Branch]

2014-11-25 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225614#comment-14225614 ] Rui Li commented on HIVE-8956: -- Thanks [~vanzin] for your input! Adding {{JobReceived}} and {{

[jira] [Updated] (HIVE-8943) Fix memory limit check for combine nested mapjoins [Spark Branch]

2014-11-25 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho updated HIVE-8943: Attachment: HIVE-8943.1-spark.patch Attaching patch again as the Ptest framework was undergoing upgrade. > F

[jira] [Issue Comment Deleted] (HIVE-8836) Enable automatic tests with remote spark client [Spark Branch]

2014-11-25 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-8836: --- Comment: was deleted (was: {color:red}Overall{color}: -1 no tests executed Here are the results of t

[jira] [Updated] (HIVE-8961) Remove unnecessary dependency collection task [Spark Branch]

2014-11-25 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8961: -- Attachment: HIVE-8961.3-spark.patch Reattach the same patch to trigger test. > Remove unnecessary depend

[jira] [Issue Comment Deleted] (HIVE-8836) Enable automatic tests with remote spark client [Spark Branch]

2014-11-25 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-8836: --- Comment: was deleted (was: {color:red}Overall{color}: -1 no tests executed Here are the results of t

[jira] [Updated] (HIVE-8836) Enable automatic tests with remote spark client [Spark Branch]

2014-11-25 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-8836: --- Attachment: HIVE-8836.6-spark.patch > Enable automatic tests with remote spark client [Spark Branch] >

[jira] [Comment Edited] (HIVE-8957) Remote spark context needs to clean up itself in case of connection timeout [Spark Branch]

2014-11-25 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225525#comment-14225525 ] Xuefu Zhang edited comment on HIVE-8957 at 11/26/14 2:09 AM: - -

[jira] [Commented] (HIVE-8965) Enhance PTest to kill all processes between tests and to report when a TEST*.xml file is not generated

2014-11-25 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225597#comment-14225597 ] Szehon Ho commented on HIVE-8965: - +1 on latest patch > Enhance PTest to kill all processe

[jira] [Updated] (HIVE-8965) Enhance PTest to kill all processes between tests and to report when a TEST*.xml file is not generated

2014-11-25 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-8965: --- Attachment: HIVE-8965.patch > Enhance PTest to kill all processes between tests and to report when a >

[jira] [Commented] (HIVE-8957) Remote spark context needs to clean up itself in case of connection timeout [Spark Branch]

2014-11-25 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225580#comment-14225580 ] Szehon Ho commented on HIVE-8957: - [~vanzin] tagged the wrong person? > Remote spark conte

[jira] [Commented] (HIVE-8836) Enable automatic tests with remote spark client [Spark Branch]

2014-11-25 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225578#comment-14225578 ] Hive QA commented on HIVE-8836: --- {color:red}Overall{color}: -1 no tests executed Here are

[jira] [Commented] (HIVE-8961) Remove unnecessary dependency collection task [Spark Branch]

2014-11-25 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225570#comment-14225570 ] Rui Li commented on HIVE-8961: -- Thanks [~xuefuz] for taking care of this. I'll rebase and run

[jira] [Created] (HIVE-8969) getChildPrivileges should in one transaction with revoke

2014-11-25 Thread Xiaomeng Huang (JIRA)
Xiaomeng Huang created HIVE-8969: Summary: getChildPrivileges should in one transaction with revoke Key: HIVE-8969 URL: https://issues.apache.org/jira/browse/HIVE-8969 Project: Hive Issue Typ

[jira] [Commented] (HIVE-8536) Enable SkewJoinResolver for spark [Spark Branch]

2014-11-25 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225565#comment-14225565 ] Rui Li commented on HIVE-8536: -- Hi [~csun] thanks for your input. I'm removing the dependency

[jira] [Updated] (HIVE-8836) Enable automatic tests with remote spark client [Spark Branch]

2014-11-25 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-8836: --- Attachment: HIVE-8836.6-spark.patch > Enable automatic tests with remote spark client [Spark Branch] >

[jira] [Commented] (HIVE-8836) Enable automatic tests with remote spark client [Spark Branch]

2014-11-25 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225535#comment-14225535 ] Hive QA commented on HIVE-8836: --- {color:red}Overall{color}: -1 no tests executed Here are

[jira] [Commented] (HIVE-8961) Remove unnecessary dependency collection task [Spark Branch]

2014-11-25 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225534#comment-14225534 ] Hive QA commented on HIVE-8961: --- {color:red}Overall{color}: -1 no tests executed Here are

[jira] [Updated] (HIVE-8836) Enable automatic tests with remote spark client [Spark Branch]

2014-11-25 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-8836: --- Summary: Enable automatic tests with remote spark client [Spark Branch] (was: Enable automatic tests w

[jira] [Commented] (HIVE-8957) Remote spark context needs to clean up itself in case of connection timeout [Spark Branch]

2014-11-25 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225525#comment-14225525 ] Xuefu Zhang commented on HIVE-8957: --- [~mvalleavila], could you advise what is right thing

[jira] [Created] (HIVE-8968) Changing hive metastore to sql server causes an error

2014-11-25 Thread Colman Madden (JIRA)
Colman Madden created HIVE-8968: --- Summary: Changing hive metastore to sql server causes an error Key: HIVE-8968 URL: https://issues.apache.org/jira/browse/HIVE-8968 Project: Hive Issue Type: Bu

[jira] [Updated] (HIVE-8895) bugs in mergejoin

2014-11-25 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-8895: --- Resolution: Fixed Fix Version/s: 0.14.0 Status: Resolved (was: Patch Availabl

[jira] [Updated] (HIVE-8836) Enable automatic tests with remote spark client.[Spark Branch]

2014-11-25 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-8836: --- Attachment: HIVE-8836.5-spark.patch I talked with Marcelo and he noted an odd config of {{spark.akka.h

[jira] [Commented] (HIVE-8797) Simultaneous dynamic inserts can result in "partition already exists" error

2014-11-25 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225510#comment-14225510 ] Thejas M Nair commented on HIVE-8797: - Regarding {code} +if (CheckJDOExcep

[jira] [Commented] (HIVE-8943) Fix memory limit check for combine nested mapjoins [Spark Branch]

2014-11-25 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225506#comment-14225506 ] Hive QA commented on HIVE-8943: --- {color:red}Overall{color}: -1 no tests executed Here are

[jira] [Commented] (HIVE-8889) JDBC Driver ResultSet.getXXXXXX(String columnLabel) methods Broken

2014-11-25 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225503#comment-14225503 ] Hive QA commented on HIVE-8889: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Resolved] (HIVE-8965) Enhance PTest to kill all processes between tests and to report when a TEST*.xml file is not generated

2014-11-25 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland resolved HIVE-8965. Resolution: Fixed Fix Version/s: 0.15.0 > Enhance PTest to kill all processes between tests an

[jira] [Commented] (HIVE-8965) Enhance PTest to kill all processes between tests and to report when a TEST*.xml file is not generated

2014-11-25 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225501#comment-14225501 ] Brock Noland commented on HIVE-8965: Since this is causing some issues I am going to co

[jira] [Commented] (HIVE-8967) Fix bucketmapjoin7.q determinism

2014-11-25 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225498#comment-14225498 ] Xuefu Zhang commented on HIVE-8967: --- +1 pending on test. > Fix bucketmapjoin7.q determin

[jira] [Commented] (HIVE-8836) Enable automatic tests with remote spark client.[Spark Branch]

2014-11-25 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225492#comment-14225492 ] Hive QA commented on HIVE-8836: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Updated] (HIVE-8967) Fix bucketmapjoin7.q determinism

2014-11-25 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jimmy Xiang updated HIVE-8967: -- Fix Version/s: 0.15.0 Status: Patch Available (was: Open) > Fix bucketmapjoin7.q determinism

[jira] [Updated] (HIVE-8967) Fix bucketmapjoin7.q determinism

2014-11-25 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jimmy Xiang updated HIVE-8967: -- Attachment: HIVE-8967.patch > Fix bucketmapjoin7.q determinism > > >

[jira] [Commented] (HIVE-8963) Investigate test failure on bucketmapjoin7.q [Spark Branch]

2014-11-25 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225455#comment-14225455 ] Jimmy Xiang commented on HIVE-8963: --- Looked into it. Without limit 1, the output for spar

[jira] [Created] (HIVE-8967) Fix bucketmapjoin7.q determinism

2014-11-25 Thread Jimmy Xiang (JIRA)
Jimmy Xiang created HIVE-8967: - Summary: Fix bucketmapjoin7.q determinism Key: HIVE-8967 URL: https://issues.apache.org/jira/browse/HIVE-8967 Project: Hive Issue Type: Bug Reporter: J

[jira] [Commented] (HIVE-8836) Enable automatic tests with remote spark client.[Spark Branch]

2014-11-25 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225438#comment-14225438 ] Brock Noland commented on HIVE-8836: Bunch of debug logs: http://ec2-50-18-27-0.us-wes

[jira] [Commented] (HIVE-8875) hive.optimize.sort.dynamic.partition should be turned off for ACID

2014-11-25 Thread Prasanth J (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225436#comment-14225436 ] Prasanth J commented on HIVE-8875: -- LGTM, +1 > hive.optimize.sort.dynamic.partition shoul

[jira] [Commented] (HIVE-8836) Enable automatic tests with remote spark client.[Spark Branch]

2014-11-25 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225429#comment-14225429 ] Brock Noland commented on HIVE-8836: Complete log: http://ec2-50-18-27-0.us-west-1.com

[jira] [Commented] (HIVE-8850) ObjectStore:: rollbackTransaction() and getHelper class needs to be looked into further.

2014-11-25 Thread Chaoyu Tang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225426#comment-14225426 ] Chaoyu Tang commented on HIVE-8850: --- [~sushanth] The patch looks good. I left a couple of

[jira] [Commented] (HIVE-8836) Enable automatic tests with remote spark client.[Spark Branch]

2014-11-25 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225423#comment-14225423 ] Brock Noland commented on HIVE-8836: Similar warning on the other: {noformat} 2014-11-2

[jira] [Commented] (HIVE-8836) Enable automatic tests with remote spark client.[Spark Branch]

2014-11-25 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225417#comment-14225417 ] Brock Noland commented on HIVE-8836: One of the stuck processes: {noformat} 2014-11-25

  1   2   3   >