Re: [DISCUSS] Supporting Hadoop-1 and experimental features

2015-05-15 Thread Xuefu Zhang
Thanks for the explanation, Alan! While I have understood more on the proposal, I actually see more problems than the confusion of two lines of releases. Essentially, this proposal forces a user to make a hard choice between a stabler, legacy-aware release line and an adventurous, pioneering relea

Re: [DISCUSS] Supporting Hadoop-1 and experimental features

2015-05-15 Thread Alan Gates
Xuefu Zhang May 15, 2015 at 17:31 Just make sure that I understand the proposal correctly: we are going to have two main branches, one for hadoop-1 and one for hadoop-2. We shouldn't tie this to hadoop-1 and 2. It's about Hive not Hadoop. It will be some time bef

Re: [DISCUSS] Supporting Hadoop-1 and experimental features

2015-05-15 Thread Xuefu Zhang
Just make sure that I understand the proposal correctly: we are going to have two main branches, one for hadoop-1 and one for hadoop-2. New features are only merged to branch-2. That essentially says we stop development for hadoop-1, right? Are we also making two lines of releases: ene for branch-1

Re: [DISCUSS] Supporting Hadoop-1 and experimental features

2015-05-15 Thread Vaibhav Gumashta
+1 on the new branch. I think it'll help in faster dev time for these important changes. -Vaibhav From: Alan Gates mailto:alanfga...@gmail.com>> Reply-To: "dev@hive.apache.org" mailto:dev@hive.apache.org>> Date: Friday, May 15, 2015 at 4:11 PM To: "dev@hive.apache.or

Re: [DISCUSS] Supporting Hadoop-1 and experimental features

2015-05-15 Thread Alan Gates
Anyone else have feedback on this? If not I'll start a vote next week. Alan. Gopal Vijayaraghavan May 14, 2015 at 10:44 Hi, +1 on the idea. Having a stable release branch with ongoing fixes where we do not drop major features would be good all around. It lets us a

Re: Review Request 34293: HIVE-10721 SparkSessionManagerImpl leaks SparkSessions [Spark Branch]

2015-05-15 Thread Jimmy Xiang
> On May 15, 2015, 10:19 p.m., Xuefu Zhang wrote: > > ql/src/java/org/apache/hadoop/hive/ql/exec/spark/session/SparkSessionManagerImpl.java, > > line 169 > > > > > > Any concurrency issue for this, or it doesn't matte

[jira] [Created] (HIVE-10733) Fill out gaps in HiveServer2 HA

2015-05-15 Thread Vaibhav Gumashta (JIRA)
Vaibhav Gumashta created HIVE-10733: --- Summary: Fill out gaps in HiveServer2 HA Key: HIVE-10733 URL: https://issues.apache.org/jira/browse/HIVE-10733 Project: Hive Issue Type: Improvement

[jira] [Created] (HIVE-10732) Hive JDBC driver does not close operation for metadata queries

2015-05-15 Thread Mala Chikka Kempanna (JIRA)
Mala Chikka Kempanna created HIVE-10732: --- Summary: Hive JDBC driver does not close operation for metadata queries Key: HIVE-10732 URL: https://issues.apache.org/jira/browse/HIVE-10732 Project: H

Re: Review Request 34293: HIVE-10721 SparkSessionManagerImpl leaks SparkSessions [Spark Branch]

2015-05-15 Thread Xuefu Zhang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34293/#review83990 --- ql/src/java/org/apache/hadoop/hive/ql/exec/spark/session/SparkSessi

Re: Review Request 34059: HIVE-10673 Dynamically partitioned hash join for Tez

2015-05-15 Thread Jason Dere
> On May 12, 2015, 6:26 a.m., Alexander Pivovarov wrote: > > ql/src/java/org/apache/hadoop/hive/ql/optimizer/ReduceSinkMapJoinProc.java, > > line 107 > > > > > > ReduceSinkOperator uses Object.hashCode() and equals()

Re: Review Request 34059: HIVE-10673 Dynamically partitioned hash join for Tez

2015-05-15 Thread Jason Dere
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34059/ --- (Updated May 15, 2015, 10:02 p.m.) Review request for hive, Matt McCline and Vi

[jira] [Created] (HIVE-10730) LLAP: fix guava stopwatch conflict

2015-05-15 Thread Siddharth Seth (JIRA)
Siddharth Seth created HIVE-10730: - Summary: LLAP: fix guava stopwatch conflict Key: HIVE-10730 URL: https://issues.apache.org/jira/browse/HIVE-10730 Project: Hive Issue Type: Sub-task

[jira] [Created] (HIVE-10731) NullPointerException in HiveParser.g

2015-05-15 Thread Xiu (JIRA)
Xiu created HIVE-10731: -- Summary: NullPointerException in HiveParser.g Key: HIVE-10731 URL: https://issues.apache.org/jira/browse/HIVE-10731 Project: Hive Issue Type: Bug Components: Query Pla

Review Request 34293: HIVE-10721 SparkSessionManagerImpl leaks SparkSessions [Spark Branch]

2015-05-15 Thread Jimmy Xiang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34293/ --- Review request for hive and Xuefu Zhang. Bugs: HIVE-10721 https://issues.ap

Re: [VOTE] Apache Hive 1.2.0 release candidate 5

2015-05-15 Thread Sushanth Sowmyan
Hi All, The vote for releasing Apache Hive 1.2.0-RC5 passes with: 3 +1 votes: * Vikram Dixit (PMC) * Gunther Hagleitner (PMC) * Thejas Nair (PMC) Thanks everybody to have contributed to this release in any way. I'll promote the artifacts and send the announce once the release has been synced t

[jira] [Created] (HIVE-10729) Query failed when join on an element in complex type (tez map join only)

2015-05-15 Thread Selina Zhang (JIRA)
Selina Zhang created HIVE-10729: --- Summary: Query failed when join on an element in complex type (tez map join only) Key: HIVE-10729 URL: https://issues.apache.org/jira/browse/HIVE-10729 Project: Hive

[jira] [Created] (HIVE-10728) deprecate unix_timestamp(void) and make it deterministic

2015-05-15 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created HIVE-10728: --- Summary: deprecate unix_timestamp(void) and make it deterministic Key: HIVE-10728 URL: https://issues.apache.org/jira/browse/HIVE-10728 Project: Hive I

[jira] [Created] (HIVE-10727) Import throws error message "org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset!"

2015-05-15 Thread Balu Vellanki (JIRA)
Balu Vellanki created HIVE-10727: Summary: Import throws error message "org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset!" Key: HIVE-10727 URL: https://issues.apache.org/jira/br

Re: Request for feedback on work intent for non-equijoin support

2015-05-15 Thread Andres.Quiroz
Ok, that would be great! Except for Monday and Friday, I could meet any day next week in the afternoon (Pacific time), since it is the end of the day for me. Thanks a lot, Andrés On 5/15/15, 4:13 PM, "Thejas Nair" wrote: >Hi Andres, >Glad to hear about the progress! > >Vikram is a hive join i

[jira] [Created] (HIVE-10726) Hive JDBC setQueryTimeout should not throw exception to make it work with JMeter

2015-05-15 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created HIVE-10726: Summary: Hive JDBC setQueryTimeout should not throw exception to make it work with JMeter Key: HIVE-10726 URL: https://issues.apache.org/jira/browse/HIVE-10726

[jira] [Created] (HIVE-10725) Better resource management in HiveServer2

2015-05-15 Thread Vaibhav Gumashta (JIRA)
Vaibhav Gumashta created HIVE-10725: --- Summary: Better resource management in HiveServer2 Key: HIVE-10725 URL: https://issues.apache.org/jira/browse/HIVE-10725 Project: Hive Issue Type: Bug

Re: Request for feedback on work intent for non-equijoin support

2015-05-15 Thread Thejas Nair
Hi Andres, Glad to hear about the progress! Vikram is a hive join implementation expert. He can guide you through this. We can setup a webex or google hangout and discuss this. Does sometime next week work for you ? (Please let us know some hours that work for you, in Pacific time zone). Anybody

Re: Request for feedback on work intent for non-equijoin support

2015-05-15 Thread Andres.Quiroz
Hello, At this point, I have implemented a standalone version of the 1-bucket-theta join algorithm described in the northeastern paper on Hadoop MR, and would like to start porting it to Hive. I have been looking at the code and believe that the main goal would be to implement a new JoinOperator.

Review Request 34287: HIVE-10704 Errors in Tez HashTableLoader when estimated table size is 0

2015-05-15 Thread Jason Dere
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34287/ --- Review request for hive. Repository: hive-git Description --- - fix bigg

[jira] [Created] (HIVE-10724) WebHCat e2e test TestStreaming_5 fails on Windows

2015-05-15 Thread Deepesh Khandelwal (JIRA)
Deepesh Khandelwal created HIVE-10724: - Summary: WebHCat e2e test TestStreaming_5 fails on Windows Key: HIVE-10724 URL: https://issues.apache.org/jira/browse/HIVE-10724 Project: Hive Issu

[jira] [Created] (HIVE-10723) better logging/etc. for stuck metastore

2015-05-15 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created HIVE-10723: --- Summary: better logging/etc. for stuck metastore Key: HIVE-10723 URL: https://issues.apache.org/jira/browse/HIVE-10723 Project: Hive Issue Type: Bug

[jira] [Created] (HIVE-10722) external table creation in Hive can create unusable partition

2015-05-15 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created HIVE-10722: --- Summary: external table creation in Hive can create unusable partition Key: HIVE-10722 URL: https://issues.apache.org/jira/browse/HIVE-10722 Project: Hive

Re: FAILED: IndexOutOfBoundsException Index: 3, Size: 3

2015-05-15 Thread Thejas Nair
what version of hive is this ? On Thu, May 14, 2015 at 8:09 PM, lushuai2...@139.com wrote: > Hello, >Man! > > When I execute the hql ,for example: > > FROM INPUT > INSERT OVERWRITE TABLE temp2 partition(dt='2015-05-15',type='type1') > SELECT key,ip, > count(distinct(value)) as

Re: [VOTE] Apache Hive 1.2.0 release candidate 5

2015-05-15 Thread Thejas Nair
+1 Checked the changes since rc4 in git. verified signature, checksums. build against hadoop2, ran simple queries. On Thu, May 14, 2015 at 8:11 PM, Gunther Hagleitner wrote: > One more time, with feeling :-) > > +1, same verification as last time. > > Fr

[jira] [Created] (HIVE-10721) SparkSessionManagerImpl leaks SparkSessions [Spark Branch]

2015-05-15 Thread Jimmy Xiang (JIRA)
Jimmy Xiang created HIVE-10721: -- Summary: SparkSessionManagerImpl leaks SparkSessions [Spark Branch] Key: HIVE-10721 URL: https://issues.apache.org/jira/browse/HIVE-10721 Project: Hive Issue Typ

[jira] [Created] (HIVE-10720) Pig using HCatLoader to access RCFile and perform join but get incorrect result.

2015-05-15 Thread Aihua Xu (JIRA)
Aihua Xu created HIVE-10720: --- Summary: Pig using HCatLoader to access RCFile and perform join but get incorrect result. Key: HIVE-10720 URL: https://issues.apache.org/jira/browse/HIVE-10720 Project: Hive