[jira] [Commented] (HIVE-10807) Invalidate basic stats for insert queries if autogather=false

2015-05-28 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564308#comment-14564308 ] Hive QA commented on HIVE-10807: {color:red}Overall{color}: -1 at least one tests failed

[jira] [Commented] (HIVE-10841) [WHERE col is not null] does not work sometimes for queries with many JOIN statements

2015-05-28 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564297#comment-14564297 ] Alexander Pivovarov commented on HIVE-10841: if I set hive.optimize.ppd=false

[jira] [Commented] (HIVE-10821) Beeline-CLI: Implement CLI source command using Beeline functionality

2015-05-28 Thread Chinna Rao Lalam (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564288#comment-14564288 ] Chinna Rao Lalam commented on HIVE-10821: - Hi [~Ferd] Please remove String trime

[jira] [Commented] (HIVE-10863) Merge trunk to Spark branch 5/28/2015 [Spark Branch]

2015-05-28 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564280#comment-14564280 ] Hive QA commented on HIVE-10863: {color:red}Overall{color}: -1 at least one tests failed

[jira] [Updated] (HIVE-10821) Beeline-CLI: Implement CLI source command using Beeline functionality

2015-05-28 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferdinand Xu updated HIVE-10821: Release Note: Examples: {noformat} #cat /root/workspace/test.sql create table test2(a string, b str

[jira] [Updated] (HIVE-10864) CBO (Calcite Return Path): auto_join2.q returning wrong results

2015-05-28 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-10864: --- Attachment: HIVE-10864.patch [~ashutoshc], could you review it? Thanks > CBO

[jira] [Commented] (HIVE-10841) [WHERE col is not null] does not work sometimes for queries with many JOIN statements

2015-05-28 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564273#comment-14564273 ] Alexander Pivovarov commented on HIVE-10841: L tables also can be removed from

[jira] [Updated] (HIVE-9069) Simplify filter predicates for CBO

2015-05-28 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-9069: -- Attachment: HIVE-9069.18.patch > Simplify filter predicates for CBO > ---

[jira] [Commented] (HIVE-10841) [WHERE col is not null] does not work sometimes for queries with many JOIN statements

2015-05-28 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564244#comment-14564244 ] Gopal V commented on HIVE-10841: can you try this with set hive.optimize.ppd=false; ?

[jira] [Commented] (HIVE-10841) [WHERE col is not null] does not work sometimes for queries with many JOIN statements

2015-05-28 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564243#comment-14564243 ] Alexander Pivovarov commented on HIVE-10841: I found that "JOIN FR" can be rem

[jira] [Commented] (HIVE-10841) [WHERE col is not null] does not work sometimes for queries with many JOIN statements

2015-05-28 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564229#comment-14564229 ] Alexander Pivovarov commented on HIVE-10841: if we change "is not null" to "is

[jira] [Commented] (HIVE-9069) Simplify filter predicates for CBO

2015-05-28 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564227#comment-14564227 ] Hive QA commented on HIVE-9069: --- {color:red}Overall{color}: -1 no tests executed Here are

[jira] [Commented] (HIVE-10761) Create codahale-based metrics system for Hive

2015-05-28 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564222#comment-14564222 ] Hive QA commented on HIVE-10761: {color:red}Overall{color}: -1 at least one tests failed

[jira] [Commented] (HIVE-10841) [WHERE col is not null] does not work sometimes for queries with many JOIN statements

2015-05-28 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564215#comment-14564215 ] Alexander Pivovarov commented on HIVE-10841: hive-0.12.0 plan {code} ABSTRACT

[jira] [Updated] (HIVE-10841) [WHERE col is not null] does not work sometimes for queries with many JOIN statements

2015-05-28 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Pivovarov updated HIVE-10841: --- Component/s: Query Planning > [WHERE col is not null] does not work sometimes for quer

[jira] [Commented] (HIVE-10841) [WHERE col is not null] does not work sometimes for queries with many JOIN statements

2015-05-28 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564213#comment-14564213 ] Alexander Pivovarov commented on HIVE-10841: if we look at hive-0.12 plan then

[jira] [Assigned] (HIVE-10863) Merge trunk to Spark branch 5/28/2015 [Spark Branch]

2015-05-28 Thread Deepesh Khandelwal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepesh Khandelwal reassigned HIVE-10863: - Assignee: Deepesh Khandelwal (was: Xuefu Zhang) > Merge trunk to Spark branch 5/

[jira] [Updated] (HIVE-10863) Merge trunk to Spark branch 5/28/2015 [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-10863: --- Attachment: HIVE-10863.0-spark.patch Patch #0 is a dummy patch to trigger a test run. > Merge trunk t

[jira] [Updated] (HIVE-10863) Merge trunk to Spark branch 5/28/2015 [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-10863: --- Attachment: mj.patch > Merge trunk to Spark branch 5/28/2015 [Spark Branch] >

[jira] [Commented] (HIVE-10863) Merge trunk to Spark branch 5/28/2015 [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564198#comment-14564198 ] Xuefu Zhang commented on HIVE-10863: Unfortunately, the patch is too big to be attache

[jira] [Commented] (HIVE-10853) Create ExplainTask in ATS hook through ExplainWork

2015-05-28 Thread Gunther Hagleitner (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564193#comment-14564193 ] Gunther Hagleitner commented on HIVE-10853: --- Minor nit: would be nice to comment

[jira] [Updated] (HIVE-10841) [WHERE col is not null] does not work sometimes for queries with many JOIN statements

2015-05-28 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Pivovarov updated HIVE-10841: --- Affects Version/s: 0.13.0 > [WHERE col is not null] does not work sometimes for querie

[jira] [Updated] (HIVE-10821) Beeline-CLI: Implement CLI source command using Beeline functionality

2015-05-28 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferdinand Xu updated HIVE-10821: Attachment: (was: HIVE-10821.1-beeline-cli.patch) > Beeline-CLI: Implement CLI source command us

[jira] [Updated] (HIVE-10821) Beeline-CLI: Implement CLI source command using Beeline functionality

2015-05-28 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferdinand Xu updated HIVE-10821: Attachment: (was: HIVE-10821.1-beeline-cli.patch) > Beeline-CLI: Implement CLI source command us

[jira] [Updated] (HIVE-10821) Beeline-CLI: Implement CLI source command using Beeline functionality

2015-05-28 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferdinand Xu updated HIVE-10821: Attachment: HIVE-10821.1-beeline-cli.patch Thanks [~chinnalalam] for review. Update the patch addres

[jira] [Updated] (HIVE-10821) Beeline-CLI: Implement CLI source command using Beeline functionality

2015-05-28 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferdinand Xu updated HIVE-10821: Attachment: HIVE-10821.1-beeline-cli.patch Thanks [~chinnalalam] for review. Update the patch addres

[jira] [Updated] (HIVE-7767) hive.optimize.union.remove does not work properly [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7767: -- Fix Version/s: (was: spark-branch) 1.1.0 > hive.optimize.union.remove does not wor

[jira] [Updated] (HIVE-9267) Ensure custom UDF works with Spark [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9267: -- Fix Version/s: (was: spark-branch) 1.1.0 > Ensure custom UDF works with Spark [Spa

[jira] [Updated] (HIVE-8352) Enable windowing.q for spark [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8352: -- Fix Version/s: (was: spark-branch) 1.1.0 > Enable windowing.q for spark [Spark Bra

[jira] [Updated] (HIVE-9040) Spark Memory can be formatted string [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9040: -- Fix Version/s: (was: spark-branch) 1.1.0 > Spark Memory can be formatted string [S

[jira] [Updated] (HIVE-8074) Merge trunk into spark 9/12/2014

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8074: -- Fix Version/s: (was: spark-branch) 1.1.0 > Merge trunk into spark 9/12/2014 >

[jira] [Updated] (HIVE-7382) Create a MiniSparkCluster and set up a testing framework [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7382: -- Fix Version/s: (was: spark-branch) 1.1.0 > Create a MiniSparkCluster and set up a

[jira] [Updated] (HIVE-8843) Release RDD cache when Hive query is done [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8843: -- Fix Version/s: (was: spark-branch) 1.1.0 > Release RDD cache when Hive query is do

[jira] [Updated] (HIVE-9110) Performance of SELECT COUNT(*) FROM store_sales WHERE ss_item_sk IS NOT NULL [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9110: -- Fix Version/s: (was: spark-branch) 1.1.0 > Performance of SELECT COUNT(*) FROM sto

[jira] [Updated] (HIVE-8908) Investigate test failure on join34.q [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8908: -- Fix Version/s: (was: spark-branch) 1.1.0 > Investigate test failure on join34.q [S

[jira] [Updated] (HIVE-8141) Refactor the GraphTran code by moving union handling logic to UnionTran [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8141: -- Fix Version/s: (was: spark-branch) 1.1.0 > Refactor the GraphTran code by moving u

[jira] [Updated] (HIVE-8913) Make SparkMapJoinResolver handle runtime skew join [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8913: -- Fix Version/s: (was: spark-branch) 1.1.0 > Make SparkMapJoinResolver handle runtim

[jira] [Updated] (HIVE-8536) Enable SkewJoinResolver for spark [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8536: -- Fix Version/s: (was: spark-branch) 1.1.0 > Enable SkewJoinResolver for spark [Spar

[jira] [Updated] (HIVE-7748) Add qfile_regex to qtest-spark pom [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7748: -- Fix Version/s: (was: spark-branch) 1.1.0 > Add qfile_regex to qtest-spark pom [Spa

[jira] [Updated] (HIVE-7755) Enable avro* tests [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7755: -- Fix Version/s: (was: spark-branch) 1.1.0 > Enable avro* tests [Spark Branch] > ---

[jira] [Updated] (HIVE-9081) Bucket mapjoin should use the new alias in posToAliasMap [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9081: -- Fix Version/s: (was: spark-branch) 1.1.0 > Bucket mapjoin should use the new alias

[jira] [Updated] (HIVE-7708) Fix qtest-spark pom.xml reference to test properties [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7708: -- Fix Version/s: (was: spark-branch) 1.1.0 > Fix qtest-spark pom.xml reference to te

[jira] [Updated] (HIVE-8029) Remove reducers number configure in SparkTask [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8029: -- Fix Version/s: (was: spark-branch) 1.1.0 > Remove reducers number configure in Spa

[jira] [Updated] (HIVE-8743) Disable MapJoin [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8743: -- Fix Version/s: (was: spark-branch) 1.1.0 > Disable MapJoin [Spark Branch] > --

[jira] [Updated] (HIVE-9054) Add additional logging to SetSparkReducerParallelism [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9054: -- Fix Version/s: (was: spark-branch) 1.1.0 > Add additional logging to SetSparkReduc

[jira] [Updated] (HIVE-8883) Investigate test failures on auto_join30.q [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8883: -- Fix Version/s: (was: spark-branch) 1.1.0 > Investigate test failures on auto_join3

[jira] [Updated] (HIVE-9378) Spark qfile tests should reuse RSC [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9378: -- Fix Version/s: (was: spark-branch) 1.1.0 > Spark qfile tests should reuse RSC [Spa

[jira] [Updated] (HIVE-8899) Merge from trunk to spark [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8899: -- Fix Version/s: (was: spark-branch) 1.1.0 > Merge from trunk to spark [Spark Branch

[jira] [Updated] (HIVE-9192) One-pass SMB Optimizations [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9192: -- Fix Version/s: (was: spark-branch) 1.1.0 > One-pass SMB Optimizations [Spark Branc

[jira] [Updated] (HIVE-7745) NullPointerException when turn on hive.optimize.union.remove, hive.merge.mapfiles and hive.merge.mapredfiles [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7745: -- Fix Version/s: (was: spark-branch) 1.1.0 > NullPointerException when turn on hive.

[jira] [Updated] (HIVE-8783) Create some tests that use Spark counter for stats collection [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8783: -- Fix Version/s: (was: spark-branch) 1.1.0 > Create some tests that use Spark counte

[jira] [Updated] (HIVE-9517) UNION ALL query failed with ArrayIndexOutOfBoundsException [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9517: -- Fix Version/s: (was: spark-branch) 1.1.0 > UNION ALL query failed with ArrayIndexO

[jira] [Updated] (HIVE-8274) Refactoring SparkPlan and SparkPlanGeneration [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8274: -- Fix Version/s: (was: spark-branch) 1.1.0 > Refactoring SparkPlan and SparkPlanGene

[jira] [Updated] (HIVE-8422) Turn on all join .q tests [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8422: -- Fix Version/s: (was: spark-branch) 1.1.0 > Turn on all join .q tests [Spark Branch

[jira] [Updated] (HIVE-8160) Upgrade Spark dependency to 1.2.0-SNAPSHOT [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8160: -- Fix Version/s: (was: spark-branch) 1.1.0 > Upgrade Spark dependency to 1.2.0-SNAPS

[jira] [Updated] (HIVE-8436) Modify SparkWork to split works with multiple child works [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8436: -- Fix Version/s: (was: spark-branch) 1.1.0 > Modify SparkWork to split works with mu

[jira] [Updated] (HIVE-8405) Research Bucket Map Join [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8405: -- Fix Version/s: (was: spark-branch) 1.1.0 > Research Bucket Map Join [Spark Branch]

[jira] [Updated] (HIVE-7793) Enable tests on Spark branch (3) [Sparch Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7793: -- Fix Version/s: (was: spark-branch) 1.1.0 > Enable tests on Spark branch (3) [Sparc

[jira] [Updated] (HIVE-7411) Exclude hadoop 1 from spark dep [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7411: -- Fix Version/s: (was: spark-branch) 1.1.0 > Exclude hadoop 1 from spark dep [Spark

[jira] [Updated] (HIVE-8540) HivePairFlatMapFunction.java missing license header [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8540: -- Fix Version/s: (was: spark-branch) 1.1.0 > HivePairFlatMapFunction.java missing li

[jira] [Updated] (HIVE-9207) Add more log information for debug RSC[Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9207: -- Fix Version/s: (was: spark-branch) 1.1.0 > Add more log information for debug RSC[

[jira] [Updated] (HIVE-8982) IndexOutOfBounds exception in mapjoin [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8982: -- Fix Version/s: (was: spark-branch) 1.1.0 > IndexOutOfBounds exception in mapjoin [

[jira] [Updated] (HIVE-7880) Support subquery [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7880: -- Fix Version/s: (was: spark-branch) 1.1.0 > Support subquery [Spark Branch] > -

[jira] [Updated] (HIVE-9568) Revert changes in two test configuration files accidently brought in by HIVE-9552 [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9568: -- Fix Version/s: (was: spark-branch) 1.1.0 > Revert changes in two test configuratio

[jira] [Updated] (HIVE-7821) StarterProject: enable groupby4.q [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7821: -- Fix Version/s: (was: spark-branch) 1.1.0 > StarterProject: enable groupby4.q [Spar

[jira] [Updated] (HIVE-9627) Add cbo_gby_empty.q.out for Spark [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9627: -- Fix Version/s: (was: spark-branch) 1.1.0 > Add cbo_gby_empty.q.out for Spark [Spar

[jira] [Updated] (HIVE-8686) Enable vectorization tests with query results sort [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8686: -- Fix Version/s: (was: spark-branch) 1.1.0 > Enable vectorization tests with query r

[jira] [Updated] (HIVE-7591) GenMapRedUtils::addStatsTask only assumes either MapredWork or TezWork

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7591: -- Fix Version/s: (was: spark-branch) 1.1.0 > GenMapRedUtils::addStatsTask only assum

[jira] [Updated] (HIVE-8507) UT: fix rcfile_bigdata test [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8507: -- Fix Version/s: (was: spark-branch) 1.1.0 > UT: fix rcfile_bigdata test [Spark Bran

[jira] [Updated] (HIVE-7781) Enable windowing and analytic function qtests [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7781: -- Fix Version/s: (was: spark-branch) 1.1.0 > Enable windowing and analytic function

[jira] [Updated] (HIVE-9216) Avoid redundant clone of JobConf [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9216: -- Fix Version/s: (was: spark-branch) 1.1.0 > Avoid redundant clone of JobConf [Spark

[jira] [Updated] (HIVE-7338) Create SparkPlanGenerator [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7338: -- Fix Version/s: (was: spark-branch) 1.1.0 > Create SparkPlanGenerator [Spark Branch

[jira] [Updated] (HIVE-9493) Failed job may not throw exceptions [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9493: -- Fix Version/s: (was: spark-branch) > Failed job may not throw exceptions [Spark Branch] > ---

[jira] [Updated] (HIVE-9101) bucket_map_join_spark4.q failed due to NPE.[Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9101: -- Fix Version/s: (was: spark-branch) 1.1.0 > bucket_map_join_spark4.q failed due to

[jira] [Updated] (HIVE-7527) Support order by and sort by on Spark [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7527: -- Fix Version/s: (was: spark-branch) 1.1.0 > Support order by and sort by on Spark [

[jira] [Updated] (HIVE-9211) Research on build mini HoS cluster on YARN for unit test[Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9211: -- Fix Version/s: (was: spark-branch) > Research on build mini HoS cluster on YARN for unit test[Spark B

[jira] [Updated] (HIVE-9135) Cache Map and Reduce works in RSC [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9135: -- Fix Version/s: (was: spark-branch) 1.1.0 > Cache Map and Reduce works in RSC [Spar

[jira] [Updated] (HIVE-7717) Add .q tests coverage for "union all" [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7717: -- Fix Version/s: (was: spark-branch) 1.1.0 > Add .q tests coverage for "union all" [

[jira] [Updated] (HIVE-8438) Clean up code introduced by HIVE-7503 and such [Spark Plan]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8438: -- Fix Version/s: (was: spark-branch) 1.1.0 > Clean up code introduced by HIVE-7503 a

[jira] [Updated] (HIVE-7584) Change SparkCompiler to generate a SparkWork that contains UnionWork from logical operator tree

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7584: -- Fix Version/s: (was: spark-branch) 1.1.0 > Change SparkCompiler to generate a Spar

[jira] [Updated] (HIVE-8777) Should only register used counters in SparkCounters[Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8777: -- Fix Version/s: (was: spark-branch) 1.1.0 > Should only register used counters in S

[jira] [Updated] (HIVE-9487) Make Remote Spark Context secure [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9487: -- Fix Version/s: (was: spark-branch) > Make Remote Spark Context secure [Spark Branch] > --

[jira] [Updated] (HIVE-9116) Add unit test for multi sessions.[Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9116: -- Fix Version/s: (was: spark-branch) 1.1.0 > Add unit test for multi sessions.[Spark

[jira] [Updated] (HIVE-8457) MapOperator initialization fails when multiple Spark threads is enabled [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8457: -- Fix Version/s: (was: spark-branch) 1.1.0 > MapOperator initialization fails when m

[jira] [Updated] (HIVE-8054) Disable hive.optimize.union.remove when hive.execution.engine=spark [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8054: -- Fix Version/s: (was: spark-branch) 1.1.0 > Disable hive.optimize.union.remove when

[jira] [Updated] (HIVE-7580) Support dynamic partitioning [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7580: -- Fix Version/s: (was: spark-branch) 1.1.0 > Support dynamic partitioning [Spark Bra

[jira] [Updated] (HIVE-7954) Investigate query failures (3)

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7954: -- Fix Version/s: (was: spark-branch) 1.1.0 > Investigate query failures (3) > --

[jira] [Updated] (HIVE-7567) support automatic calculating reduce task number [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7567: -- Fix Version/s: (was: spark-branch) 1.1.0 > support automatic calculating reduce ta

[jira] [Updated] (HIVE-7541) Support union all on Spark [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7541: -- Fix Version/s: (was: spark-branch) 1.1.0 > Support union all on Spark [Spark Branc

[jira] [Updated] (HIVE-8649) Increase level of parallelism in reduce phase [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8649: -- Fix Version/s: (was: spark-branch) 1.1.0 > Increase level of parallelism in reduce

[jira] [Updated] (HIVE-8437) Modify SparkPlan generation to set toCache flag to SparkTrans where caching is needed [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8437: -- Fix Version/s: (was: spark-branch) 1.1.0 > Modify SparkPlan generation to set toCa

[jira] [Updated] (HIVE-9007) Hive may generate wrong plan for map join queries due to IdentityProjectRemover [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9007: -- Fix Version/s: (was: spark-branch) 1.1.0 > Hive may generate wrong plan for map jo

[jira] [Updated] (HIVE-8841) Make RDD caching work for multi-insert after HIVE-8793 when map join is involved [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8841: -- Fix Version/s: (was: spark-branch) 1.1.0 > Make RDD caching work for multi-insert

[jira] [Updated] (HIVE-8788) UT: fix partition test case [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8788: -- Fix Version/s: (was: spark-branch) 1.1.0 > UT: fix partition test case [Spark Bran

[jira] [Updated] (HIVE-8924) Investigate test failure for join_empty.q [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8924: -- Fix Version/s: (was: spark-branch) 1.1.0 > Investigate test failure for join_empty

[jira] [Updated] (HIVE-7540) NotSerializableException encountered when using sortByKey transformation

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7540: -- Fix Version/s: (was: spark-branch) 1.1.0 > NotSerializableException encountered wh

[jira] [Updated] (HIVE-7613) Research optimization of auto convert join to map join [Spark branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7613: -- Fix Version/s: (was: spark-branch) 1.1.0 > Research optimization of auto convert j

[jira] [Updated] (HIVE-8842) auto_join2.q produces incorrect tree [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8842: -- Fix Version/s: (was: spark-branch) 1.1.0 > auto_join2.q produces incorrect tree [S

[jira] [Updated] (HIVE-9088) Spark counter serialization error in spark.log [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9088: -- Fix Version/s: (was: spark-branch) 1.1.0 > Spark counter serialization error in sp

[jira] [Updated] (HIVE-7816) Enable map-join tests which Tez executes [Spark Branch]

2015-05-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7816: -- Fix Version/s: (was: spark-branch) 1.1.0 > Enable map-join tests which Tez execute

  1   2   3   4   5   6   >