[jira] [Updated] (HIVE-8972) Implement more fine-grained remote client-level events [Spark Branch]

2014-12-16 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-8972: - Attachment: HIVE-8972.4-spark.patch The latest patch only consists of minor fix and clean up. I talked about this w

[jira] [Updated] (HIVE-9120) Hive Query log does not work when hive.exec.parallel is true

2014-12-16 Thread Dong Chen (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Chen updated HIVE-9120: Status: Patch Available (was: Open) > Hive Query log does not work when hive.exec.parallel is true > ---

[jira] [Commented] (HIVE-8809) Activate maven profile hadoop-2 by default

2014-12-16 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249592#comment-14249592 ] Prasanth Jayachandran commented on HIVE-8809: - Can we get [~ndimiduk] patch in?

[jira] [Updated] (HIVE-9123) Query with join fails with NPE when using join auto conversion

2014-12-16 Thread Kamil Gorlo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Gorlo updated HIVE-9123: -- Description: I have two simple tables: desc kgorlo_comm; | col_name | data_type | comment | | id

[jira] [Commented] (HIVE-9096) GenericUDF may be left unclosed in PartitionPrune#visitCall()

2014-12-16 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249576#comment-14249576 ] Navis commented on HIVE-9096: - +1 > GenericUDF may be left unclosed in PartitionPrune#visitCal

[jira] [Updated] (HIVE-9059) Remove wrappers for SparkJobInfo and SparkStageInfo

2014-12-16 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-9059: Attachment: HIVE-9059.2-spark.patch With Brock's notification, set StdInstantiatorStrategy as Kryo in

[jira] [Commented] (HIVE-7111) Extend join transitivity PPD to non-column expressions

2014-12-16 Thread Lefty Leverenz (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249587#comment-14249587 ] Lefty Leverenz commented on HIVE-7111: -- Thanks [~navis]. > Extend join transitivity P

[jira] [Commented] (HIVE-9141) HiveOnTez: mix of union all, distinct, group by generates error

2014-12-16 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249577#comment-14249577 ] Pengcheng Xiong commented on HIVE-9141: --- There is no error when it is run on MR. > H

[jira] [Commented] (HIVE-8406) Research on skewed join [Spark Branch]

2014-12-16 Thread Lefty Leverenz (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249581#comment-14249581 ] Lefty Leverenz commented on HIVE-8406: -- Does this need documentation other than "Skew

[jira] [Commented] (HIVE-9141) HiveOnTez: mix of union all, distinct, group by generates error

2014-12-16 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249580#comment-14249580 ] Pengcheng Xiong commented on HIVE-9141: --- And, the following queries got no error when

Review Request 29147: HIVE-9059 Remove wrappers for SparkJobInfo and SparkStageInfo

2014-12-16 Thread chengxiang li
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29147/ --- Review request for hive and Xuefu Zhang. Bugs: HIVE-9059 https://issues.apa

[jira] [Updated] (HIVE-9059) Remove wrappers for SparkJobInfo and SparkStageInfo

2014-12-16 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-9059: Status: Patch Available (was: Open) > Remove wrappers for SparkJobInfo and SparkStageInfo >

[jira] [Commented] (HIVE-9141) HiveOnTez: mix of union all, distinct, group by generates error

2014-12-16 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249575#comment-14249575 ] Pengcheng Xiong commented on HIVE-9141: --- This will block HIVE-9039. [~jpullokkaran] a

[jira] [Commented] (HIVE-9096) GenericUDF may be left unclosed in PartitionPrune#visitCall()

2014-12-16 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249573#comment-14249573 ] Hive QA commented on HIVE-9096: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Created] (HIVE-9141) HiveOnTez: mix of union all, distinct, group by generates error

2014-12-16 Thread Pengcheng Xiong (JIRA)
Pengcheng Xiong created HIVE-9141: - Summary: HiveOnTez: mix of union all, distinct, group by generates error Key: HIVE-9141 URL: https://issues.apache.org/jira/browse/HIVE-9141 Project: Hive

[jira] [Commented] (HIVE-7111) Extend join transitivity PPD to non-column expressions

2014-12-16 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249569#comment-14249569 ] Navis commented on HIVE-7111: - [~leftylev] Seemed not need any documentation. And it's extensio

[jira] [Updated] (HIVE-8816) Create unit test join of two encrypted tables with different keys

2014-12-16 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferdinand Xu updated HIVE-8816: --- Status: Open (was: Patch Available) > Create unit test join of two encrypted tables with different key

[jira] [Commented] (HIVE-7999) Hive metastore query too long when select * on table with large number of partitions

2014-12-16 Thread David Schorow (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249562#comment-14249562 ] David Schorow commented on HIVE-7999: - I believe this issue will be resolved by HIVE-82

[jira] [Updated] (HIVE-9076) incompatFileSet in AbstractFileMergeOperator should be marked to skip task id check

2014-12-16 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated HIVE-9076: Attachment: HIVE-9076.4.patch.txt Fixed NPE > incompatFileSet in AbstractFileMergeOperator should be marked to skip

[jira] [Commented] (HIVE-7977) Avoid creating serde for partitions if possible in FetchTask

2014-12-16 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249556#comment-14249556 ] Navis commented on HIVE-7977: - I think it's ready. But I cannot update/upload git diff file to

[jira] [Resolved] (HIVE-9107) Non-lowercase field names in structs causes NullPointerException

2014-12-16 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis resolved HIVE-9107. - Resolution: Duplicate Feel free open this issue if it happens again in hive-0.14.0 > Non-lowercase field names in

[jira] [Updated] (HIVE-7024) Escape control characters for explain result

2014-12-16 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated HIVE-7024: Attachment: HIVE-7024.5.patch.txt IntelliJ ate all trailing spaces. Resubmitting. > Escape control characters for ex

[jira] [Updated] (HIVE-9094) TimeoutException when trying get executor count from RSC [Spark Branch]

2014-12-16 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-9094: Status: Patch Available (was: Open) > TimeoutException when trying get executor count from RSC [Spar

Review Request 29145: HIVE-9094 TimeoutException when trying get executor count from RSC [Spark Branch]

2014-12-16 Thread chengxiang li
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29145/ --- Review request for hive and Xuefu Zhang. Bugs: HIVE-9094 https://issues.apa

[jira] [Updated] (HIVE-9094) TimeoutException when trying get executor count from RSC [Spark Branch]

2014-12-16 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-9094: Attachment: HIVE-9094.1-spark.patch > TimeoutException when trying get executor count from RSC [Spark

[jira] [Updated] (HIVE-9130) vector_partition_diff_num_cols result is not updated after CBO upgrade

2014-12-16 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated HIVE-9130: Resolution: Fixed Fix Version/s: 0.15.0 Status: Resolved (was: Patch Available) Committed to trunk

[jira] [Commented] (HIVE-9130) vector_partition_diff_num_cols result is not updated after CBO upgrade

2014-12-16 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249524#comment-14249524 ] Hive QA commented on HIVE-9130: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-9000) LAST_VALUE Window function returns wrong results

2014-12-16 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249520#comment-14249520 ] Navis commented on HIVE-9000: - [~mgrover] I think it's correct. You can acquire expected result

[jira] [Updated] (HIVE-8816) Create unit test join of two encrypted tables with different keys

2014-12-16 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferdinand Xu updated HIVE-8816: --- Attachment: HIVE-8816.1.patch > Create unit test join of two encrypted tables with different keys > ---

[jira] [Commented] (HIVE-8843) Release RDD cache when Hive query is done [Spark Branch]

2014-12-16 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249506#comment-14249506 ] Hive QA commented on HIVE-8843: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Updated] (HIVE-8815) Create unit test join of encrypted and unencrypted table

2014-12-16 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferdinand Xu updated HIVE-8815: --- Attachment: HIVE-8815.1.patch > Create unit test join of encrypted and unencrypted table >

[jira] [Updated] (HIVE-9009) order by (limit) meaning for the last subquery of union in Hive is different from other main stream RDBMS

2014-12-16 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong updated HIVE-9009: -- Attachment: HIVE-9002-WIP.patch > order by (limit) meaning for the last subquery of union in Hive

[jira] [Updated] (HIVE-8815) Create unit test join of encrypted and unencrypted table

2014-12-16 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferdinand Xu updated HIVE-8815: --- Attachment: (was: HIVE-8815.1.patch) > Create unit test join of encrypted and unencrypted table > -

[jira] [Updated] (HIVE-8815) Create unit test join of encrypted and unencrypted table

2014-12-16 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferdinand Xu updated HIVE-8815: --- Attachment: HIVE-8815.1.patch Thank [~brocknoland] for your review comments. Update the patch by reusin

[jira] [Commented] (HIVE-9127) Improve CombineHiveInputFormat.getSplit performance

2014-12-16 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249481#comment-14249481 ] Rui Li commented on HIVE-9127: -- [~xuefuz] - Oh I see. Thanks for the explanation! > Improve C

[jira] [Updated] (HIVE-9113) Explain on query failed with NPE

2014-12-16 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated HIVE-9113: Attachment: HIVE-9113.1.patch.txt > Explain on query failed with NPE > > >

[jira] [Updated] (HIVE-9113) Explain on query failed with NPE

2014-12-16 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated HIVE-9113: Assignee: Navis Status: Patch Available (was: Open) > Explain on query failed with NPE > -

[jira] [Updated] (HIVE-8787) UT: update hive-site.xml for spark UTs to add hive_admin_user to admin role

2014-12-16 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8787: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available)

[jira] [Commented] (HIVE-9097) Support runtime skew join for more queries [Spark Branch]

2014-12-16 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249463#comment-14249463 ] Rui Li commented on HIVE-9097: -- Thanks [~xuefuz] for the review. > Support runtime skew join

[jira] [Updated] (HIVE-9140) Add ReduceExpressionRules from Calcite into Hive

2014-12-16 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-9140: --- Attachment: HIVE-9140.patch > Add ReduceExpressionRules from Calcite into Hive > --

[jira] [Updated] (HIVE-9140) Add ReduceExpressionRules from Calcite into Hive

2014-12-16 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-9140: --- Status: Patch Available (was: Open) > Add ReduceExpressionRules from Calcite into Hive > -

[jira] [Created] (HIVE-9140) Add ReduceExpressionRules from Calcite into Hive

2014-12-16 Thread Ashutosh Chauhan (JIRA)
Ashutosh Chauhan created HIVE-9140: -- Summary: Add ReduceExpressionRules from Calcite into Hive Key: HIVE-9140 URL: https://issues.apache.org/jira/browse/HIVE-9140 Project: Hive Issue Type: I

[jira] [Commented] (HIVE-9115) Hive build failure on hadoop-2.7 due to HADOOP-11356

2014-12-16 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249458#comment-14249458 ] Hive QA commented on HIVE-9115: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-4286) When I run `CREATE TABLE new_table LIKE avro_table`, the schema does not get mapped properly from an Avro schema to a Hive schema

2014-12-16 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249447#comment-14249447 ] Prabhu Joseph commented on HIVE-4286: - Hi Uri Laserson, Which hive version this issue r

[jira] [Commented] (HIVE-8843) Release RDD cache when Hive query is done [Spark Branch]

2014-12-16 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249434#comment-14249434 ] Xuefu Zhang commented on HIVE-8843: --- +1 pending on tests. > Release RDD cache when Hive

Re: How to debug hive unit test in eclipse ?

2014-12-16 Thread Jeff Zhang
Thanks Xuefu, very helpful. On Tue, Dec 16, 2014 at 11:24 PM, Xuefu Zhang wrote: > > Besides running the test in eclipse (if possible), the other way to do is > to enable debug for sure-fire and connect it with eclipse using remote > application debugging. > > > http://maven.apache.org/surefire/m

Re: Review Request 29063: HIVE-8843 Release RDD cache when Hive query is done [Spark Branch]

2014-12-16 Thread Jimmy Xiang
> On Dec. 17, 2014, 3:06 a.m., Xuefu Zhang wrote: > > Fixed and attached v3 to the jira. Could not update the diff on this RB because RB has problem to find the file in the repo suddenly. > On Dec. 17, 2014, 3:06 a.m., Xuefu Zhang wrote: > > ql/src/java/org/apache/hadoop/hive/ql/exec/spark/Ma

[jira] [Commented] (HIVE-9127) Improve CombineHiveInputFormat.getSplit performance

2014-12-16 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249427#comment-14249427 ] Xuefu Zhang commented on HIVE-9127: --- Hi [~lirui], I think this JIRA was re-purposed to en

[jira] [Updated] (HIVE-8843) Release RDD cache when Hive query is done [Spark Branch]

2014-12-16 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jimmy Xiang updated HIVE-8843: -- Attachment: HIVE-8843.3-spark.patch > Release RDD cache when Hive query is done [Spark Branch] >

[jira] [Updated] (HIVE-9122) Need to remove additional references to hive-shims-common-secure, hive-shims-0.20

2014-12-16 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-9122: --- Resolution: Fixed Fix Version/s: 0.15.0 Status: Resolved (was: Patch Availabl

Re: Apache Hive 1.0 ?

2014-12-16 Thread Carl Steinbach
Hi Olga, > Switching everybody to HiveServer2 has performance and scale consequences > that might not be acceptable for every use case. > Just wanted to make sure you're aware that it's possible to run HiveServer2 in a thick-client mode where it sits embedded in the client JVM process. This allo

[jira] [Resolved] (HIVE-8406) Research on skewed join [Spark Branch]

2014-12-16 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved HIVE-8406. --- Resolution: Done Skew join is fully supported in Spark. We close this task as "done". Thanks, Rui. >

[jira] [Updated] (HIVE-9097) Support runtime skew join for more queries [Spark Branch]

2014-12-16 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9097: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available)

[jira] [Commented] (HIVE-9097) Support runtime skew join for more queries [Spark Branch]

2014-12-16 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249395#comment-14249395 ] Xuefu Zhang commented on HIVE-9097: --- +1 > Support runtime skew join for more queries [Sp

[jira] [Commented] (HIVE-8988) Support advanced aggregation in Hive to Calcite path

2014-12-16 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249396#comment-14249396 ] Hive QA commented on HIVE-8988: --- {color:red}Overall{color}: -1 no tests executed Here are

[jira] [Commented] (HIVE-9122) Need to remove additional references to hive-shims-common-secure, hive-shims-0.20

2014-12-16 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249392#comment-14249392 ] Hive QA commented on HIVE-9122: --- {color:red}Overall{color}: -1 at least one tests failed H

Re: Review Request 29063: HIVE-8843 Release RDD cache when Hive query is done [Spark Branch]

2014-12-16 Thread Xuefu Zhang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29063/#review65280 --- ql/src/java/org/apache/hadoop/hive/ql/exec/spark/MapInput.java

[jira] [Updated] (HIVE-9041) Generate better plan for queries containing both union and multi-insert [Spark Branch]

2014-12-16 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9041: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available)

[jira] [Created] (HIVE-9139) Clean up GenSparkProcContext.clonedReduceSinks and related code [Spark Branch]

2014-12-16 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-9139: - Summary: Clean up GenSparkProcContext.clonedReduceSinks and related code [Spark Branch] Key: HIVE-9139 URL: https://issues.apache.org/jira/browse/HIVE-9139 Project: Hive

[jira] [Commented] (HIVE-9041) Generate better plan for queries containing both union and multi-insert [Spark Branch]

2014-12-16 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249352#comment-14249352 ] Xuefu Zhang commented on HIVE-9041: --- +1 > Generate better plan for queries containing bo

[jira] [Updated] (HIVE-9097) Support runtime skew join for more queries [Spark Branch]

2014-12-16 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-9097: - Component/s: Spark > Support runtime skew join for more queries [Spark Branch] > --

[jira] [Updated] (HIVE-9097) Support runtime skew join for more queries [Spark Branch]

2014-12-16 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-9097: - Affects Version/s: spark-branch > Support runtime skew join for more queries [Spark Branch] > -

[jira] [Commented] (HIVE-9041) Generate better plan for queries containing both union and multi-insert [Spark Branch]

2014-12-16 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249340#comment-14249340 ] Hive QA commented on HIVE-9041: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-5744) Implement support for BETWEEN in SELECT list

2014-12-16 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249331#comment-14249331 ] Navis commented on HIVE-5744: - I apparently I've forgot to update result of vector_between_in.

Re: Review Request 29111: HIVE-9041 - Generate better plan for queries containing both union and multi-insert [Spark Branch]

2014-12-16 Thread Xuefu Zhang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29111/#review65275 --- Ship it! Ship It! - Xuefu Zhang On Dec. 17, 2014, 12:32 a.m., Ch

[jira] [Updated] (HIVE-9129) Migrate to newer Calcite snapshot, where ByteString is now in org.apache.calcite.avatica.util

2014-12-16 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated HIVE-9129: Resolution: Fixed Fix Version/s: 0.15.0 Status: Resolved (was: Patch Available) I've committed thi

[jira] [Commented] (HIVE-8131) Support timestamp in Avro

2014-12-16 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249299#comment-14249299 ] Hive QA commented on HIVE-8131: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-9138) Add some explain to PTF operator

2014-12-16 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249296#comment-14249296 ] Navis commented on HIVE-9138: - Now it shows something like this. {noformat} PTF Operator wind

[jira] [Updated] (HIVE-9138) Add some explain to PTF operator

2014-12-16 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated HIVE-9138: Attachment: HIVE-9138.1.patch.txt > Add some explain to PTF operator > > >

[jira] [Updated] (HIVE-9138) Add some explain to PTF operator

2014-12-16 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated HIVE-9138: Status: Patch Available (was: Open) > Add some explain to PTF operator > > >

Review Request 29136: HIVE-7797 upgrade hive schema from 0.9.0 to 0.13.1 failed

2014-12-16 Thread nemon lou
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29136/ --- Review request for hive, Ashutosh Chauhan and Prasad Mujumdar. Repository: hive

[jira] [Created] (HIVE-9138) Add some explain to PTF operator

2014-12-16 Thread Navis (JIRA)
Navis created HIVE-9138: --- Summary: Add some explain to PTF operator Key: HIVE-9138 URL: https://issues.apache.org/jira/browse/HIVE-9138 Project: Hive Issue Type: Improvement Components: Query

[jira] [Commented] (HIVE-9127) Improve CombineHiveInputFormat.getSplit performance

2014-12-16 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249287#comment-14249287 ] Rui Li commented on HIVE-9127: -- Will this cache Map/Reduce works for spark? Seems changes to U

Re: What more Hive can do when compared to PIG

2014-12-16 Thread Lefty Leverenz
Have you done an Internet search for "Pig vs Hive"? Plenty of good answers there. -- Lefty On Tue, Dec 16, 2014 at 10:01 AM, Mohan Krishna wrote: > > *Hello all* > > *Can somebody help me in getting the answer for the below question* > > *Its regarding PIG vs HIVE:* > > We knew that PIG for lar

[jira] [Updated] (HIVE-9137) Turn off Hive's PredicateTransitivePropagate optimizer when cbo is on

2014-12-16 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-9137: --- Status: Patch Available (was: Open) > Turn off Hive's PredicateTransitivePropagate optimizer w

[jira] [Updated] (HIVE-9137) Turn off Hive's PredicateTransitivePropagate optimizer when cbo is on

2014-12-16 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-9137: --- Attachment: HIVE-9137.patch > Turn off Hive's PredicateTransitivePropagate optimizer when cbo i

[jira] [Created] (HIVE-9137) Turn off Hive's PredicateTransitivePropagate optimizer when cbo is on

2014-12-16 Thread Ashutosh Chauhan (JIRA)
Ashutosh Chauhan created HIVE-9137: -- Summary: Turn off Hive's PredicateTransitivePropagate optimizer when cbo is on Key: HIVE-9137 URL: https://issues.apache.org/jira/browse/HIVE-9137 Project: Hive

[jira] [Commented] (HIVE-8843) Release RDD cache when Hive query is done [Spark Branch]

2014-12-16 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249259#comment-14249259 ] Hive QA commented on HIVE-8843: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-7634) Use Configuration.getPassword() if available to eliminate passwords from hive-site.xml

2014-12-16 Thread Lefty Leverenz (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249253#comment-14249253 ] Lefty Leverenz commented on HIVE-7634: -- Doc note: [~jdere] documented this in the wik

[jira] [Created] (HIVE-9136) Profile query compiler [Spark Branch]

2014-12-16 Thread Brock Noland (JIRA)
Brock Noland created HIVE-9136: -- Summary: Profile query compiler [Spark Branch] Key: HIVE-9136 URL: https://issues.apache.org/jira/browse/HIVE-9136 Project: Hive Issue Type: Sub-task C

[jira] [Updated] (HIVE-7634) Use Configuration.getPassword() if available to eliminate passwords from hive-site.xml

2014-12-16 Thread Lefty Leverenz (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lefty Leverenz updated HIVE-7634: - Labels: (was: TODOC14) > Use Configuration.getPassword() if available to eliminate passwords from

[jira] [Commented] (HIVE-9131) MiniTez optimize_nullscan test is unstable

2014-12-16 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249245#comment-14249245 ] Ashutosh Chauhan commented on HIVE-9131: [~vikram.dixit] Seems like HIVE-9055 cause

[jira] [Commented] (HIVE-9055) Tez: union all followed by group by followed by another union all gives error

2014-12-16 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249241#comment-14249241 ] Ashutosh Chauhan commented on HIVE-9055: Has this patch been committed ? Seems like

[jira] [Updated] (HIVE-9041) Generate better plan for queries containing both union and multi-insert [Spark Branch]

2014-12-16 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao updated HIVE-9041: --- Attachment: HIVE-9041.3-spark.patch > Generate better plan for queries containing both union and multi-insert > [Spark

[jira] [Updated] (HIVE-9108) Fix for HIVE-8735 is incorrect (stats with long paths)

2014-12-16 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-9108: --- Resolution: Fixed Status: Resolved (was: Patch Available) > Fix for HIVE-8735 is incor

[jira] [Updated] (HIVE-9041) Generate better plan for queries containing both union and multi-insert [Spark Branch]

2014-12-16 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao updated HIVE-9041: --- Attachment: (was: HIVE-9041.3-spark.patch) > Generate better plan for queries containing both union and multi-inser

[jira] [Updated] (HIVE-9041) Generate better plan for queries containing both union and multi-insert [Spark Branch]

2014-12-16 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao updated HIVE-9041: --- Attachment: HIVE-9041.3-spark.patch > Generate better plan for queries containing both union and multi-insert > [Spark

[jira] [Updated] (HIVE-9041) Generate better plan for queries containing both union and multi-insert [Spark Branch]

2014-12-16 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao updated HIVE-9041: --- Attachment: (was: HIVE-9041.3-spark.patch) > Generate better plan for queries containing both union and multi-inser

[jira] [Updated] (HIVE-9041) Generate better plan for queries containing both union and multi-insert [Spark Branch]

2014-12-16 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao updated HIVE-9041: --- Attachment: HIVE-9041.3-spark.patch Addressing RB comments. > Generate better plan for queries containing both union a

[jira] [Commented] (HIVE-4790) MapredLocalTask task does not make virtual columns

2014-12-16 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249218#comment-14249218 ] Hive QA commented on HIVE-4790: --- {color:red}Overall{color}: -1 at least one tests failed H

Re: Review Request 29111: HIVE-9041 - Generate better plan for queries containing both union and multi-insert [Spark Branch]

2014-12-16 Thread Chao Sun
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29111/ --- (Updated Dec. 17, 2014, 12:32 a.m.) Review request for hive and Xuefu Zhang.

Re: Review Request 29111: HIVE-9041 - Generate better plan for queries containing both union and multi-insert [Spark Branch]

2014-12-16 Thread Chao Sun
> On Dec. 17, 2014, midnight, Xuefu Zhang wrote: > > ql/src/java/org/apache/hadoop/hive/ql/optimizer/spark/SparkReduceSinkMapJoinProc.java, > > line 207 > > > > > > should we remove this variable completely? Yes, I'l

[jira] [Updated] (HIVE-9127) Improve CombineHiveInputFormat.getSplit performance

2014-12-16 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-9127: --- Summary: Improve CombineHiveInputFormat.getSplit performance (was: Improve CombineHiveInputFormat.getS

[jira] [Commented] (HIVE-9128) Evaluate hive.rpc.query.plan performance [Spark Branch]

2014-12-16 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249209#comment-14249209 ] Brock Noland commented on HIVE-9128: Agreed that a second isn't very helpful for our us

[jira] [Created] (HIVE-9135) Cache Map and Reduce works in RSC [Spark Branch]

2014-12-16 Thread Brock Noland (JIRA)
Brock Noland created HIVE-9135: -- Summary: Cache Map and Reduce works in RSC [Spark Branch] Key: HIVE-9135 URL: https://issues.apache.org/jira/browse/HIVE-9135 Project: Hive Issue Type: Sub-task

[jira] [Commented] (HIVE-9121) Enable beeline query progress information for Spark job[Spark Branch]

2014-12-16 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249205#comment-14249205 ] Brock Noland commented on HIVE-9121: BTW this works great! > Enable beeline query prog

[jira] [Commented] (HIVE-9128) Evaluate hive.rpc.query.plan performance [Spark Branch]

2014-12-16 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249201#comment-14249201 ] Jimmy Xiang commented on HIVE-9128: --- Played with this setting on spark. With query 28, th

[jira] [Updated] (HIVE-9110) Performance of SELECT COUNT(*) FROM STORE SALES WHERE ss_item_sk IS NOT NULL [Spark Branch]

2014-12-16 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-9110: --- Summary: Performance of SELECT COUNT(*) FROM STORE SALES WHERE ss_item_sk IS NOT NULL [Spark Branch] (

[jira] [Updated] (HIVE-9124) Performance of query 28 from tpc-ds [Spark Branch]

2014-12-16 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-9124: --- Affects Version/s: spark-branch > Performance of query 28 from tpc-ds [Spark Branch] >

[jira] [Updated] (HIVE-9110) Performance of SELECT COUNT(*) FROM STORE SALES WHERE ss_item_sk IS NOT NULL [Spark Branch]

2014-12-16 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-9110: --- Affects Version/s: spark-branch > Performance of SELECT COUNT(*) FROM STORE SALES WHERE ss_item_sk IS N

  1   2   3   >