[jira] [Created] (HIVE-11756) Avoid redundant key serialization in RS for distinct query

2015-09-08 Thread Navis (JIRA)
Navis created HIVE-11756: Summary: Avoid redundant key serialization in RS for distinct query Key: HIVE-11756 URL: https://issues.apache.org/jira/browse/HIVE-11756 Project: Hive Issue Type: Improveme

[jira] [Created] (HIVE-11757) I want to get the value of HiveKey in my custom partitioner

2015-09-08 Thread apachehadoop (JIRA)
apachehadoop created HIVE-11757: --- Summary: I want to get the value of HiveKey in my custom partitioner Key: HIVE-11757 URL: https://issues.apache.org/jira/browse/HIVE-11757 Project: Hive Issue

[jira] [Created] (HIVE-11758) Querying nested parquet columns is case sensitive

2015-09-08 Thread Jakub Kukul (JIRA)
Jakub Kukul created HIVE-11758: -- Summary: Querying nested parquet columns is case sensitive Key: HIVE-11758 URL: https://issues.apache.org/jira/browse/HIVE-11758 Project: Hive Issue Type: Bug

Re: hiveserver2 hangs

2015-09-08 Thread kulkarni.swar...@gmail.com
How much memory have you currently provided to HS2? Have you tried bumping that up? On Mon, Sep 7, 2015 at 1:09 AM, Sanjeev Verma wrote: > *I am getting the following exception when the HS2 is crashing, any idea > why it has happening* > > "pool-1-thread-121" prio=4 tid=19283 RUNNABLE > at java.

[jira] [Created] (HIVE-11759) Extend new cost model to correctly reflect limit cost

2015-09-08 Thread Jesus Camacho Rodriguez (JIRA)
Jesus Camacho Rodriguez created HIVE-11759: -- Summary: Extend new cost model to correctly reflect limit cost Key: HIVE-11759 URL: https://issues.apache.org/jira/browse/HIVE-11759 Project: Hive

[jira] [Created] (HIVE-11760) Make fs.azure.account.key style of credential compatible with StorageBasedAuthorizationProvider

2015-09-08 Thread Wouter De Borger (JIRA)
Wouter De Borger created HIVE-11760: --- Summary: Make fs.azure.account.key style of credential compatible with StorageBasedAuthorizationProvider Key: HIVE-11760 URL: https://issues.apache.org/jira/browse/HIVE-1176

Re: hiveserver2 hangs

2015-09-08 Thread Sanjeev Verma
We have 8GB HS2 java heap, we have not tried any bumping. On Tue, Sep 8, 2015 at 8:14 PM, kulkarni.swar...@gmail.com < kulkarni.swar...@gmail.com> wrote: > How much memory have you currently provided to HS2? Have you tried bumping > that up? > > On Mon, Sep 7, 2015 at 1:09 AM, Sanjeev Verma > wr

Re: hiveserver2 hangs

2015-09-08 Thread Sanjeev Verma
What this exception implies here? how to identify the problem here. Thanks On Tue, Sep 8, 2015 at 10:44 PM, Sanjeev Verma wrote: > We have 8GB HS2 java heap, we have not tried any bumping. > > On Tue, Sep 8, 2015 at 8:14 PM, kulkarni.swar...@gmail.com < > kulkarni.swar...@gmail.com> wrote: > >>

Re: Review Request 38009: HIVE-11696 Exception when table-level serde is Parquet while partition-level serde is JSON

2015-09-08 Thread Chao Sun
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/38009/#review98028 --- Ship it! Ship It! - Chao Sun On Sept. 4, 2015, 1:51 p.m., Aihua

[jira] [Created] (HIVE-11761) DoubleWritable hash code for GroupBy is not properly generated

2015-09-08 Thread Aihua Xu (JIRA)
Aihua Xu created HIVE-11761: --- Summary: DoubleWritable hash code for GroupBy is not properly generated Key: HIVE-11761 URL: https://issues.apache.org/jira/browse/HIVE-11761 Project: Hive Issue Type

[jira] [Created] (HIVE-11762) TestHCatLoaderEncryption failures when using Hadoop 2.7

2015-09-08 Thread Jason Dere (JIRA)
Jason Dere created HIVE-11762: - Summary: TestHCatLoaderEncryption failures when using Hadoop 2.7 Key: HIVE-11762 URL: https://issues.apache.org/jira/browse/HIVE-11762 Project: Hive Issue Type: Bu

[jira] [Created] (HIVE-11763) Use * instead of sum(hash(*)) on Parquet predicate (PPD) integration tests

2015-09-08 Thread JIRA
Sergio Peña created HIVE-11763: -- Summary: Use * instead of sum(hash(*)) on Parquet predicate (PPD) integration tests Key: HIVE-11763 URL: https://issues.apache.org/jira/browse/HIVE-11763 Project: Hive

Re: Review Request 38136: CBO: Calcite Operator To Hive Operator (Calcite Return Path): ctas after order by has problem

2015-09-08 Thread pengcheng xiong
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/38136/ --- (Updated Sept. 8, 2015, 8:42 p.m.) Review request for hive and John Pullokkaran

Re: [ANNOUNCE] New Hive Committer - Lars Francke

2015-09-08 Thread Lars Francke
Thank you so much everyone! Looking forward to continue working with all of you. On Tue, Sep 8, 2015 at 3:26 AM, kulkarni.swar...@gmail.com < kulkarni.swar...@gmail.com> wrote: > Congrats! > > On Mon, Sep 7, 2015 at 3:54 AM, Carl Steinbach wrote: > >> The Apache Hive PMC has voted to make Lars

Re: [ANNOUNCE] New Hive Committer - Lars Francke

2015-09-08 Thread Sergey Shelukhin
Congrats! From: Daniel Lopes mailto:dan...@bankfacil.com.br>> Reply-To: "u...@hive.apache.org" mailto:u...@hive.apache.org>> Date: Tuesday, September 8, 2015 at 15:02 To: "u...@hive.apache.org" mailto:u...@hive.apache.org>> Cc: "kulkarni.

Re: Review Request 37985: HIVE-11705 refactor SARG stripe filtering for ORC into a method

2015-09-08 Thread Sergey Shelukhin
> On Sept. 2, 2015, 2:35 a.m., Swarnim Kulkarni wrote: > > ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcInputFormat.java, line 1460 > > > > > > Nit: Could use parameter substitution instead of concatenating it >

[DISCUSS] github integration

2015-09-08 Thread Owen O'Malley
All, I think we should use the github integrations that Apache infra has introduced. You can read about it here: https://blogs.apache.org/infra/entry/improved_integration_between_apache_and The big win from my point of view is that you can use github pull requests for doing reviews. All of the

Re: Review Request 37985: HIVE-11705 refactor SARG stripe filtering for ORC into a method

2015-09-08 Thread Sergey Shelukhin
> On Sept. 5, 2015, 1:59 a.m., Prasanth_J wrote: > > ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcInputFormat.java, line 272 > > > > > > Who calls this method? If this is required later can you put this in > > th

[jira] [Created] (HIVE-11764) Verify the correctness of groupby_cube1.q with MR, Tez and Spark Mode with HIVE-1110

2015-09-08 Thread Hari Sankar Sivarama Subramaniyan (JIRA)
Hari Sankar Sivarama Subramaniyan created HIVE-11764: Summary: Verify the correctness of groupby_cube1.q with MR, Tez and Spark Mode with HIVE-1110 Key: HIVE-11764 URL: https://issues.apache.or

[jira] [Created] (HIVE-11765) SMB Join fails in Hive 1.2

2015-09-08 Thread Na Yang (JIRA)
Na Yang created HIVE-11765: -- Summary: SMB Join fails in Hive 1.2 Key: HIVE-11765 URL: https://issues.apache.org/jira/browse/HIVE-11765 Project: Hive Issue Type: Bug Components: Hive Af

Re: Review Request 37985: HIVE-11705 refactor SARG stripe filtering for ORC into a method

2015-09-08 Thread Sergey Shelukhin
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/37985/ --- (Updated Sept. 8, 2015, 11:09 p.m.) Review request for hive and Prasanth_J. R

[jira] [Created] (HIVE-11766) LLAP: Remove MiniLlapCluster from shim layer after hadoop-1 removal

2015-09-08 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created HIVE-11766: Summary: LLAP: Remove MiniLlapCluster from shim layer after hadoop-1 removal Key: HIVE-11766 URL: https://issues.apache.org/jira/browse/HIVE-11766 Pro

[jira] [Created] (HIVE-11767) LLAP: merge master into branch

2015-09-08 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created HIVE-11767: --- Summary: LLAP: merge master into branch Key: HIVE-11767 URL: https://issues.apache.org/jira/browse/HIVE-11767 Project: Hive Issue Type: Sub-task

Review Request 38199: HIVE-4577: hive CLI can't handle hadoop dfs command with space and quotes.

2015-09-08 Thread Bing Li
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/38199/ --- Review request for hive, EdwardWJ EdwardWJ and Thejas Nair. Bugs: HIVE-4577

Re: [DISCUSS] github integration

2015-09-08 Thread kulkarni.swar...@gmail.com
I personally am a big fan of pull requests which is primarily the reason for a similar proposal that I made almost a year and half ago[1] :). I think the consensus we reached at the time was that to move the primary source code from svn to git(which we did) but still use patches submitted to JIRAs

Re: hiveserver2 hangs

2015-09-08 Thread kulkarni.swar...@gmail.com
Sanjeev, I am going off this exception in the stacktrace that you posted. "at java.lang.OutOfMemoryError.(OutOfMemoryError.java:48)" which def. indicates that it's not very happy memory wise. I would def. recommend to bump up the memory and see if it helps. If not, we can debug further from ther

Review Request 34877: HIVE-11201: HCatalog is ignoring user specified avro schema in the table definition

2015-09-08 Thread Bing Li
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34877/ --- Review request for hive. Summary (updated) - HIVE-11201: HCata

Lowercase conversion at many places.

2015-09-08 Thread Chetna C
Hi All, I was going through hive codebase and noticed that, there are many classes in which we are converting strings specially table and column aliases or expressions in lowercase. Any particular reason behind this. Have raised a bug HIVE-11735 due to these conversions.I agree in hive

[jira] [Created] (HIVE-11768) java.io.DeleteOnExitHook leaks memory on long running Hive Server2 Instances

2015-09-08 Thread Nemon Lou (JIRA)
Nemon Lou created HIVE-11768: Summary: java.io.DeleteOnExitHook leaks memory on long running Hive Server2 Instances Key: HIVE-11768 URL: https://issues.apache.org/jira/browse/HIVE-11768 Project: Hive

Review Request 38203: HIVE-10708 Add avro schema compatibility check

2015-09-08 Thread Swarnim Kulkarni
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/38203/ --- Review request for hive. Repository: hive-git Description --- HIVE-10708

Review Request 38204: HIVE-11590 Making avro deserializer less chatty

2015-09-08 Thread Swarnim Kulkarni
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/38204/ --- Review request for hive. Repository: hive-git Description --- HIVE-11590

Re: [DISCUSS] github integration

2015-09-08 Thread Owen O'Malley
Thanks for the link to the previous discussion. Much of the previous discussion was about the discussion about git versus subversion. Obviously, we decided to go forward with that. We already have pull requests on github. See the list at https://github.com/apache/hive/pulls Without the Apache inte

Review Request 38206: HIVE-11662 Dynamic partitioning cannot be applied to external table which contains part-spec like directory name

2015-09-08 Thread Navis Ryu
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/38206/ --- Review request for hive. Bugs: HIVE-11662 https://issues.apache.org/jira/br