[jira] [Created] (HIVE-10477) Provide option to disable Spark tests in Windows OS

2015-04-23 Thread Hari Sankar Sivarama Subramaniyan (JIRA)
Hari Sankar Sivarama Subramaniyan created HIVE-10477: Summary: Provide option to disable Spark tests in Windows OS Key: HIVE-10477 URL: https://issues.apache.org/jira/browse/HIVE-10477

Re: PreCommit-HIVE-TRUNK-Build still on svn repo

2015-04-23 Thread Thejas Nair
Sergio, Szehon, thanks for updating the repo being checkout from svn to git. I see jobs getting submitted in precommit, and git checkout being used, but it still fails with an NPE - 2015-04-23 22:32:34,618 ERROR TestExecutor.run:138 Error executing PreCommit-HIVE-TRUNK-Build-3565 java.lang.NullPoi

Re: Review Request 33251: HIVE-10302 Cache small tables in memory [Spark Branch]

2015-04-23 Thread Xuefu Zhang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/33251/#review81444 --- Ship it! Ship It! - Xuefu Zhang On April 23, 2015, 11:22 p.m., J

[jira] [Created] (HIVE-10476) Hive query should fail when it fails to initialize a session in SetSparkReducerParallelism [Spark Branch]

2015-04-23 Thread Chao Sun (JIRA)
Chao Sun created HIVE-10476: --- Summary: Hive query should fail when it fails to initialize a session in SetSparkReducerParallelism [Spark Branch] Key: HIVE-10476 URL: https://issues.apache.org/jira/browse/HIVE-10476

[jira] [Created] (HIVE-10475) LLAP: Minor fixes after tez api enhancements for dag completion

2015-04-23 Thread Siddharth Seth (JIRA)
Siddharth Seth created HIVE-10475: - Summary: LLAP: Minor fixes after tez api enhancements for dag completion Key: HIVE-10475 URL: https://issues.apache.org/jira/browse/HIVE-10475 Project: Hive

jsonpath UDF HIVE-9864

2015-04-23 Thread Alexander Pivovarov
Hi Everyone I implemented jsonpath UDF because existing get_json_object supports only limited json path syntax. Quite often people store json in string column in hive table. e.g. Mongo migration Oracle GoldenGate data Rest API responses from devices application logs in json etc. I think jsonpath

Re: Review Request 33251: HIVE-10302 Cache small tables in memory [Spark Branch]

2015-04-23 Thread Jimmy Xiang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/33251/ --- (Updated April 23, 2015, 11:22 p.m.) Review request for hive, Chao Sun, Szehon

[jira] [Created] (HIVE-10474) LLAP: investigate why TPCH Q1 1k is slow

2015-04-23 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created HIVE-10474: --- Summary: LLAP: investigate why TPCH Q1 1k is slow Key: HIVE-10474 URL: https://issues.apache.org/jira/browse/HIVE-10474 Project: Hive Issue Type: Sub-t

Re: [DISCUSS] Deprecating Hive CLI

2015-04-23 Thread Xuefu Zhang
Hi Alan, Here is my understanding to the questions you asked: Re 1): There used to be many gaps, but majority if not all of them are filled. One of the action item out of this discussion is to identity and remaining gaps. Re 2): if you run "beeline -u jdbc:hive2://", there will be a HS2 embedded

Re: [DISCUSS] Deprecating Hive CLI

2015-04-23 Thread Lars Francke
I've been at about 20 different customers in the years since Beeline has been added. I can only think of a single one that has used beeline. The instinct is to use "hive", partially because it is easy to remember and intuitive and because it is easier to use. I end up googling the stupid JDBC synta

Re: [DISCUSS] Deprecating Hive CLI

2015-04-23 Thread Alexander Pivovarov
Hive CLI should be part of Hive project Beeline is a jdbc client. It should be separated from Hive (as any other jdbc clients). I'm not sure I understand business value of beeline. Power users (which has ssh access to cluster) can use Hive CLI. - more reliable approach because it does not need H

[jira] [Created] (HIVE-10472) Jenkins HMS upgrade test is not publishing results due to GIT change

2015-04-23 Thread JIRA
Sergio Peña created HIVE-10472: -- Summary: Jenkins HMS upgrade test is not publishing results due to GIT change Key: HIVE-10472 URL: https://issues.apache.org/jira/browse/HIVE-10472 Project: Hive

[jira] [Created] (HIVE-10473) Spark client is recreated even spark configuration is not changed

2015-04-23 Thread Jimmy Xiang (JIRA)
Jimmy Xiang created HIVE-10473: -- Summary: Spark client is recreated even spark configuration is not changed Key: HIVE-10473 URL: https://issues.apache.org/jira/browse/HIVE-10473 Project: Hive I

Re: [DISCUSS] Deprecating Hive CLI

2015-04-23 Thread Alan Gates
Xuefu, thanks for getting this discussion started. Limiting our code paths is definitely a plus. My inclination would be to go towards option 2. A few questions: 1) Is there any functionality in CLI that's not in beeline? 2) If I understand correctly option 2 would have an implicit HS2 in p

[jira] [Created] (HIVE-10471) Derive column definitions from a raw Parquet data file

2015-04-23 Thread Mariano Dominguez (JIRA)
Mariano Dominguez created HIVE-10471: Summary: Derive column definitions from a raw Parquet data file Key: HIVE-10471 URL: https://issues.apache.org/jira/browse/HIVE-10471 Project: Hive I

Re: Please cancel Mail forward

2015-04-23 Thread Thejas Nair
To unsubscribe from an email to X@*.apache.org mailing list, send an email to X-unsubscribe@*.apache.org For example to unsubscribe to dev@hive.apache.org, send email to dev-unsubscr...@hive.apache.org On Thu, Apr 23, 2015 at 11:21 AM, Ahmed Mosaad wrote: > > Dear All > > Kindly be informed that

[jira] [Created] (HIVE-10470) LLAP: NPE in IO when returning 0 rows with no projection

2015-04-23 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created HIVE-10470: --- Summary: LLAP: NPE in IO when returning 0 rows with no projection Key: HIVE-10470 URL: https://issues.apache.org/jira/browse/HIVE-10470 Project: Hive I

[DISCUSS] Deprecating Hive CLI

2015-04-23 Thread Xuefu Zhang
Hi all, I'd like to revive the discussion about the fate of Hive CLI, as this topic has haunted us several times including [1][2]. It looks to me that there is a consensus that it's not wise for Hive community to keep both Hive CLI as it is as well as Beeline + HS2. However, I don't believe that n

[jira] [Created] (HIVE-10469) Create table Like in HcatClient does not create partitions

2015-04-23 Thread Antoni Ivanov (JIRA)
Antoni Ivanov created HIVE-10469: Summary: Create table Like in HcatClient does not create partitions Key: HIVE-10469 URL: https://issues.apache.org/jira/browse/HIVE-10469 Project: Hive Issue

[jira] [Created] (HIVE-10468) Create scripts to do metastore upgrade tests on jenkins for Oracle DB.

2015-04-23 Thread Naveen Gangam (JIRA)
Naveen Gangam created HIVE-10468: Summary: Create scripts to do metastore upgrade tests on jenkins for Oracle DB. Key: HIVE-10468 URL: https://issues.apache.org/jira/browse/HIVE-10468 Project: Hive

[jira] [Created] (HIVE-10467) Switch to GIT repository on Jenkins precommit tests

2015-04-23 Thread JIRA
Sergio Peña created HIVE-10467: -- Summary: Switch to GIT repository on Jenkins precommit tests Key: HIVE-10467 URL: https://issues.apache.org/jira/browse/HIVE-10467 Project: Hive Issue Type: Imp

[jira] [Created] (HIVE-10466) LLAP: fix container sizing configuration for memory

2015-04-23 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created HIVE-10466: --- Summary: LLAP: fix container sizing configuration for memory Key: HIVE-10466 URL: https://issues.apache.org/jira/browse/HIVE-10466 Project: Hive Issue

[jira] [Created] (HIVE-10465) whitelist restrictions don't get initialized in initial part of session

2015-04-23 Thread Thejas M Nair (JIRA)
Thejas M Nair created HIVE-10465: Summary: whitelist restrictions don't get initialized in initial part of session Key: HIVE-10465 URL: https://issues.apache.org/jira/browse/HIVE-10465 Project: Hive

Re: PreCommit-HIVE-TRUNK-Build still on svn repo

2015-04-23 Thread Szehon Ho
Yea it is probably specified in the source code or the properties file, the option is not exposed as parameter via jenkins job currently (wasn't expected it would switch). We will have to look at it. On Thu, Apr 23, 2015 at 10:12 AM, Ashutosh Chauhan wrote: > Hi all, > > Seems like Hive QA is s

Re: PreCommit-HIVE-TRUNK-Build still on svn repo

2015-04-23 Thread Sergio Pena
I'm going to investigate that. I think there is some work that is needed to do in the dev-support/ scripts in order to switch to git. On Thu, Apr 23, 2015 at 12:12 PM, Ashutosh Chauhan wrote: > Hi all, > > Seems like Hive QA is still doing checkouts from locked down svn repo for > running tests.

Re: Review Request 33422: HIVE-10434 - Cancel connection when remote Spark driver process has failed [Spark Branch]

2015-04-23 Thread Marcelo Vanzin
> On April 23, 2015, 6:22 p.m., Xuefu Zhang wrote: > > spark-client/src/main/java/org/apache/hive/spark/client/rpc/RpcServer.java, > > line 176 > > > > > > I'm wondering if cinfo can be null here. After the contains()

Re: Review Request 33422: HIVE-10434 - Cancel connection when remote Spark driver process has failed [Spark Branch]

2015-04-23 Thread Chao Sun
> On April 23, 2015, 6:22 p.m., Xuefu Zhang wrote: > > spark-client/src/main/java/org/apache/hive/spark/client/rpc/RpcServer.java, > > line 176 > > > > > > I'm wondering if cinfo can be null here. After the contains()

Re: Review Request 33422: HIVE-10434 - Cancel connection when remote Spark driver process has failed [Spark Branch]

2015-04-23 Thread Chao Sun
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/33422/ --- (Updated April 23, 2015, 6:54 p.m.) Review request for hive and Marcelo Vanzin.

Please cancel Mail forward

2015-04-23 Thread Ahmed Mosaad
Dear All Kindly be informed that there is mail forwarding done from those accounts which I'm sending " TO "to be received on " amos...@eg.ibm.com ", which was related to an old employee " Anas Mosaad " who is no longer owns this mail ID. please cancel this forward from your side as I've been rece

Re: Review Request 33422: HIVE-10434 - Cancel connection when remote Spark driver process has failed [Spark Branch]

2015-04-23 Thread Xuefu Zhang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/33422/#review81361 --- spark-client/src/main/java/org/apache/hive/spark/client/rpc/RpcServ

Re: Review Request 33422: HIVE-10434 - Cancel connection when remote Spark driver process has failed [Spark Branch]

2015-04-23 Thread Chao Sun
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/33422/ --- (Updated April 23, 2015, 6:11 p.m.) Review request for hive and Marcelo Vanzin.

Re: Review Request 33422: HIVE-10434 - Cancel connection when remote Spark driver process has failed [Spark Branch]

2015-04-23 Thread Chao Sun
> On April 23, 2015, 4:55 p.m., Marcelo Vanzin wrote: > > spark-client/src/main/java/org/apache/hive/spark/client/rpc/RpcServer.java, > > line 172 > > > > > > To avoid races, I'd do: > > > > final ClientI

Re: Review Request 33251: HIVE-10302 Cache small tables in memory [Spark Branch]

2015-04-23 Thread Jimmy Xiang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/33251/ --- (Updated April 23, 2015, 5:48 p.m.) Review request for hive, Chao Sun, Szehon H

[jira] [Created] (HIVE-10464) How i find the kryo version

2015-04-23 Thread ankush (JIRA)
ankush created HIVE-10464: - Summary: How i find the kryo version Key: HIVE-10464 URL: https://issues.apache.org/jira/browse/HIVE-10464 Project: Hive Issue Type: Improvement Reporter: ank

PreCommit-HIVE-TRUNK-Build still on svn repo

2015-04-23 Thread Ashutosh Chauhan
Hi all, Seems like Hive QA is still doing checkouts from locked down svn repo for running tests. When I went to configure page of jenkins job, it doesn't list git as an option in Source code management section. Does anyone know if git repo is supported there? And if so, how to enable it? Thanks,

Re: Review Request 33422: HIVE-10434 - Cancel connection when remote Spark driver process has failed [Spark Branch]

2015-04-23 Thread Marcelo Vanzin
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/33422/#review81328 --- Ship it! Just a minor thing left to fix. spark-client/src/main/ja

[jira] [Created] (HIVE-10463) CBO (Calcite Return Path): Insert overwrite... select * from... queries failing for bucketed tables

2015-04-23 Thread Jesus Camacho Rodriguez (JIRA)
Jesus Camacho Rodriguez created HIVE-10463: -- Summary: CBO (Calcite Return Path): Insert overwrite... select * from... queries failing for bucketed tables Key: HIVE-10463 URL: https://issues.apache.org/jir

[jira] [Created] (HIVE-10462) CBO (Calcite Return Path): Exception thrown in conversion to MapJoin

2015-04-23 Thread Jesus Camacho Rodriguez (JIRA)
Jesus Camacho Rodriguez created HIVE-10462: -- Summary: CBO (Calcite Return Path): Exception thrown in conversion to MapJoin Key: HIVE-10462 URL: https://issues.apache.org/jira/browse/HIVE-10462

[jira] [Created] (HIVE-10461) Implement Record Updater and Raw Merger for Parquet as well

2015-04-23 Thread Ferdinand Xu (JIRA)
Ferdinand Xu created HIVE-10461: --- Summary: Implement Record Updater and Raw Merger for Parquet as well Key: HIVE-10461 URL: https://issues.apache.org/jira/browse/HIVE-10461 Project: Hive Issue

[jira] [Created] (HIVE-10460) change the key of Parquet Record to Nullwritable instead of void

2015-04-23 Thread Ferdinand Xu (JIRA)
Ferdinand Xu created HIVE-10460: --- Summary: change the key of Parquet Record to Nullwritable instead of void Key: HIVE-10460 URL: https://issues.apache.org/jira/browse/HIVE-10460 Project: Hive