Re: Backward incompatible changes

2017-03-03 Thread Prasanth Jayachandran
I am in favor of leaning the codebase and removing some old features which could be breaking compatibility. This would also give us opportunity to remove some age old optimizations, configs, remove things we have already marked deprecated etc. Some of changes that we can potentially do is - Remo

[jira] [Created] (HIVE-16112) Sync TestHiveMetastoreChecker unit tests with the configuration change in HIVE-16014

2017-03-03 Thread Kiran Kumar Kolli (JIRA)
Kiran Kumar Kolli created HIVE-16112: Summary: Sync TestHiveMetastoreChecker unit tests with the configuration change in HIVE-16014 Key: HIVE-16112 URL: https://issues.apache.org/jira/browse/HIVE-16112

Re: Backward incompatible changes

2017-03-03 Thread Thejas Nair
+1 There are some features that are incomplete and what I would not recommend for any real production use.The 'legacy authorization mode' is a great example of that - https://cwiki.apache.org/confluence/display/Hive/Hive+Default+Authorization+-+Legacy+Mode . It is inherently insecure mode that nobo

[jira] [Created] (HIVE-16111) Can't override hadoop configs in webhcat-site.xml

2017-03-03 Thread Subramanyam Pattipaka (JIRA)
Subramanyam Pattipaka created HIVE-16111: Summary: Can't override hadoop configs in webhcat-site.xml Key: HIVE-16111 URL: https://issues.apache.org/jira/browse/HIVE-16111 Project: Hive

Re: Backward incompatible changes

2017-03-03 Thread Edward Capriolo
Im not a fan of this our feature branching was supposed to protect us from broken trumk syndrome. I am a believer in releaseable trunk. Make it work and keep it working. On Friday, March 3, 2017, Sergey Shelukhin wrote: > Can we at least release 2.2 first? There’s massive amount of unreleased >

[jira] [Created] (HIVE-16110) Vectorization: Support CASE WHEN instead of fall back to VectorUDFAdaptor

2017-03-03 Thread Matt McCline (JIRA)
Matt McCline created HIVE-16110: --- Summary: Vectorization: Support CASE WHEN instead of fall back to VectorUDFAdaptor Key: HIVE-16110 URL: https://issues.apache.org/jira/browse/HIVE-16110 Project: Hive

Re: Review Request 56810: Compute table stats when user computes column stats

2017-03-03 Thread pengcheng xiong
> On March 3, 2017, 11:54 p.m., Ashutosh Chauhan wrote: > > ql/src/java/org/apache/hadoop/hive/ql/parse/ProcessAnalyzeTable.java > > Lines 170 (patched) > > > > > > tezWork.getAllWork().get(0).setGatheringStats(true)

Re: Review Request 56810: Compute table stats when user computes column stats

2017-03-03 Thread Ashutosh Chauhan
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/56810/#review167896 --- Can you also add golden file updates in RB, wanna go through those

Re: Backward incompatible changes

2017-03-03 Thread Sergey Shelukhin
Can we at least release 2.2 first? There’s massive amount of unreleased code right now on master. On 17/3/3, 13:50, "Ashutosh Chauhan" wrote: >Hi all, > >Hive project has come a long way. With wide-spread adoption also comes >expectations. Expectation of being backward compatible and not breakin

Re: Pre-commit job failing - No disk space

2017-03-03 Thread Vihang Karajgaonkar
I think the issue is coming from TestDbTxnManager test. This test generates a huge hive.log file (of the order of 25-30 GB). Created HIVE-16109 to fix this. We should cleanup older logs manually to free the disk space meanwhile so that pre-commit job is unblocked again. On Fri, Mar 3, 2017 at 12:2

[jira] [Created] (HIVE-16109) TestDbTxnManager generates a huge hive.log

2017-03-03 Thread Vihang Karajgaonkar (JIRA)
Vihang Karajgaonkar created HIVE-16109: -- Summary: TestDbTxnManager generates a huge hive.log Key: HIVE-16109 URL: https://issues.apache.org/jira/browse/HIVE-16109 Project: Hive Issue Typ

Review Request 57307: Display aggr stats for partitioned table in describe statement.

2017-03-03 Thread Ashutosh Chauhan
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/57307/ --- Review request for hive and Gunther Hagleitner. Bugs: HIVE-16098 https://is

[jira] [Created] (HIVE-16108) LLAP: Instance state change listener is notified twice

2017-03-03 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created HIVE-16108: Summary: LLAP: Instance state change listener is notified twice Key: HIVE-16108 URL: https://issues.apache.org/jira/browse/HIVE-16108 Project: Hive

Backward incompatible changes

2017-03-03 Thread Ashutosh Chauhan
Hi all, Hive project has come a long way. With wide-spread adoption also comes expectations. Expectation of being backward compatible and not breaking things. However that doesn't come free of cost and results in lot of legacy code which can't be refactored without fear of breaking things. As a re

Re: Pre-commit job failing - No disk space

2017-03-03 Thread Sergio Pena
Hey Vihang, Seems there is a UT test causing all this noise. See this: 30G ./PreCommit-HIVE-Build-3902/failed/272_UTBatch_ql_10_tests/logs/hive.log 30G ./PreCommit-HIVE-Build-3900/failed/272_UTBatch_ql_10_tests/logs/hive.log 30G ./PreCommit-HIVE-Build-3899/failed/272_UTBatch_ql_10_tests/logs/hive

[jira] [Created] (HIVE-16107) JDBC: HttpClient should retry one more time on NoHttpResponseException

2017-03-03 Thread Vaibhav Gumashta (JIRA)
Vaibhav Gumashta created HIVE-16107: --- Summary: JDBC: HttpClient should retry one more time on NoHttpResponseException Key: HIVE-16107 URL: https://issues.apache.org/jira/browse/HIVE-16107 Project: H

Re: Pre-commit job failing - No disk space

2017-03-03 Thread Sergio Pena
Hey Vihang, The ptest master shows how the jobs has increased the log size, could you investigate what causes this increase? 44G PreCommit-HIVE-Build-3902 44G PreCommit-HIVE-Build-3900 44G PreCommit-HIVE-Build-3899 44G PreCommit-HIVE-Build-3898 44G PreCommit-HIVE-Build-3897 44

[jira] [Created] (HIVE-16106) Upgrade to Datanucleus 4.1.17

2017-03-03 Thread Vaibhav Gumashta (JIRA)
Vaibhav Gumashta created HIVE-16106: --- Summary: Upgrade to Datanucleus 4.1.17 Key: HIVE-16106 URL: https://issues.apache.org/jira/browse/HIVE-16106 Project: Hive Issue Type: Bug Co

[jira] [Created] (HIVE-16105) LLAP: refactor executor pool to not depend on RejectedExecutionEx for preemption

2017-03-03 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created HIVE-16105: --- Summary: LLAP: refactor executor pool to not depend on RejectedExecutionEx for preemption Key: HIVE-16105 URL: https://issues.apache.org/jira/browse/HIVE-16105

[jira] [Created] (HIVE-16104) LLAP: preemption may be too aggressive if the pre-empted task doesn't die immediately

2017-03-03 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created HIVE-16104: --- Summary: LLAP: preemption may be too aggressive if the pre-empted task doesn't die immediately Key: HIVE-16104 URL: https://issues.apache.org/jira/browse/HIVE-16104

[jira] [Created] (HIVE-16103) LLAP: Scheduler timeout monitor never stops

2017-03-03 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created HIVE-16103: Summary: LLAP: Scheduler timeout monitor never stops Key: HIVE-16103 URL: https://issues.apache.org/jira/browse/HIVE-16103 Project: Hive Issu

Pre-commit job failing - No disk space

2017-03-03 Thread Vihang Karajgaonkar
Hi Sergio, Looks like the pre-commit jobs are failing due to disk space issues. Can you please help or let me know how can I fix it? Thanks, Vihang

Re: [DISCUSS] Spark's fork of hive

2017-03-03 Thread Edward Capriolo
On Thu, Mar 2, 2017 at 2:08 PM, Alan Gates wrote: > I think the issues you point out fall into a couple of different buckets: > > 1) Spark forking Hive code. As you point out, based on the license, > there's nothing wrong with this (see naming concerns below). I agree it's > crappy technical pr

Re: Review Request 56546: Allow user to update AVRO table schema via command even if table has external schema

2017-03-03 Thread Aihua Xu
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/56546/#review167827 --- common/src/java/org/apache/hadoop/hive/conf/HiveConf.java Lines 1

Re: [DISCUSS] Looking to the future hivemall graduation

2017-03-03 Thread Edward Capriolo
On Fri, Mar 3, 2017 at 9:39 AM, Makoto Yui wrote: > Edward, > > Thank you for your suggestion. It's certainly an option for our > project graduation. > I'm discussing about it with other PPMC members of Hivemall. > > My concerns are > 1) Hivemall is not only for Hive but also targets Spark and Pi

Re: [DISCUSS] Looking to the future hivemall graduation

2017-03-03 Thread Makoto Yui
Edward, Thank you for your suggestion. It's certainly an option for our project graduation. I'm discussing about it with other PPMC members of Hivemall. My concerns are 1) Hivemall is not only for Hive but also targets Spark and Pig as the runtime. - It has some Spark Dataframe related featu

Review Request 57274: HIVE-16102

2017-03-03 Thread Jesús Camacho Rodríguez
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/57274/ --- Review request for hive and Ashutosh Chauhan. Bugs: HIVE-16102 https://issu

[jira] [Created] (HIVE-16102) Grouping sets do not conform to SQL standard

2017-03-03 Thread Jesus Camacho Rodriguez (JIRA)
Jesus Camacho Rodriguez created HIVE-16102: -- Summary: Grouping sets do not conform to SQL standard Key: HIVE-16102 URL: https://issues.apache.org/jira/browse/HIVE-16102 Project: Hive

[jira] [Created] (HIVE-16101) QTest failure BeeLine escape_comments after HIVE-16045

2017-03-03 Thread Peter Vary (JIRA)
Peter Vary created HIVE-16101: - Summary: QTest failure BeeLine escape_comments after HIVE-16045 Key: HIVE-16101 URL: https://issues.apache.org/jira/browse/HIVE-16101 Project: Hive Issue Type: Bug

[jira] [Created] (HIVE-16100) Dynamic Sorted Partition optimizer loses sibling operators

2017-03-03 Thread Gopal V (JIRA)
Gopal V created HIVE-16100: -- Summary: Dynamic Sorted Partition optimizer loses sibling operators Key: HIVE-16100 URL: https://issues.apache.org/jira/browse/HIVE-16100 Project: Hive Issue Type: Bug