Predicates for 'like' and 'between' operators to custom storage handler.

2016-05-05 Thread Amey Barve
Hi All, I have implemented custom storage-handler and able to get predicates from hive for '=', '!=', '<', '<=', '>' and '>=' operators. But I cannot get predicates from hive for 'like', 'between' operators. Here's my code: *final String expression = conf.get(TableScanDesc.FILTER_EXPR_CONF_STR);

Re: Predicates for 'like' and 'between' operators to custom storage handler.

2016-05-05 Thread Amey Barve
Thanks Mich, It does work, but with operators other than '=', '!=', '<', '<=', '>' and '>=' , my code with custom storage handler gets null expression. *final String expression = conf.get(TableScanDesc.FILTER_EXPR_CONF_STR); // expression is null for hive query that has like operator* Why does a

Re: Predicates for 'like' and 'between' operators to custom storage handler.

2016-05-05 Thread Amey Barve
Hi, Do you have the equivalent of that operation in pure SQL. ---> This is my hive query: *select count(*) from u_data where unixtime like '%888904884%'* Query evaluates and results are correct. But point is that hive does not give like operator during predicate push down to custom storage handle

Re: HiveQA jenkins picking up old tickets

2016-05-05 Thread Sergio Pena
Maybe the issue is on the PreCommit-Admin job that is on builds.apache.org Jenkins server. This is the one that walks through all JIRAs in searching of patches to be tested. The old Jenkins server used to have its own PreCommit-Admin, but we lost it and we starting using the one from ASF. I'm not

[jira] [Created] (HIVE-13693) Multi-insert query drops Filter before file output when there is a.val <> b.val

2016-05-05 Thread Jesus Camacho Rodriguez (JIRA)
Jesus Camacho Rodriguez created HIVE-13693: -- Summary: Multi-insert query drops Filter before file output when there is a.val <> b.val Key: HIVE-13693 URL: https://issues.apache.org/jira/browse/HIVE-13693

Re: Review Request 46871: TPCH q16 return wrong result when CBO is on

2016-05-05 Thread pengcheng xiong
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/46871/ --- (Updated May 5, 2016, 5:43 p.m.) Review request for hive and Ashutosh Chauhan.

[jira] [Created] (HIVE-13694) Prevent ACID table being unusable due to DDL changes

2016-05-05 Thread Wei Zheng (JIRA)
Wei Zheng created HIVE-13694: Summary: Prevent ACID table being unusable due to DDL changes Key: HIVE-13694 URL: https://issues.apache.org/jira/browse/HIVE-13694 Project: Hive Issue Type: Bug

[jira] [Created] (HIVE-13695) LlapOutputFormatService port should be able to be set via conf

2016-05-05 Thread Jason Dere (JIRA)
Jason Dere created HIVE-13695: - Summary: LlapOutputFormatService port should be able to be set via conf Key: HIVE-13695 URL: https://issues.apache.org/jira/browse/HIVE-13695 Project: Hive Issue

[jira] [Created] (HIVE-13696) Validate jobs submitted to fair-scheduler

2016-05-05 Thread Reuben Kuhnert (JIRA)
Reuben Kuhnert created HIVE-13696: - Summary: Validate jobs submitted to fair-scheduler Key: HIVE-13696 URL: https://issues.apache.org/jira/browse/HIVE-13696 Project: Hive Issue Type: Improvem

Fwd: Beeline - Hive With LDAP

2016-05-05 Thread praveen_spkr kumar
I am trying to connect to hive with LDAP through beeline. But I am getting the following error: Beeline> !connect jdbc:hive2://hostname:1/default;user=hive;password= Error: Failed to open new session: java.lang.RuntimeException: java.lang.RuntimeException: org.apache.hadoop.ipc.RemoteEx

Re: Predicates for 'like' and 'between' operators to custom storage handler.

2016-05-05 Thread Mich Talebzadeh
Right. What is the underlying Hive table format? Is that Parquet, Avro, ORC ..? Also do you store your time as raw time in Hive table? For example this is the way I store timestamp it in an ORC table TO_DATE(FROM_UNIXTIME(UNIX_TIMESTAMP(TransactionDate,'dd/MM/'),'-MM-dd')) AS Transaction

Re: Predicates for 'like' and 'between' operators to custom storage handler.

2016-05-05 Thread Mich Talebzadeh
On a normal query using sql in* Hive 2* LIKE predicate works fine. Case in point in a 1 billion rows table with the column random_string of varchar(50) I have one row that satisfies the followinh@ +---+--+--+---+--

Re: Predicates for 'like' and 'between' operators to custom storage handler.

2016-05-05 Thread Mich Talebzadeh
Hi, Do you have the equivalent of that operation in pure SQL. Also have you tried Spark query tool with Hive table. I gather you are doing this through Java? Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw

Review Request 47037: HIVE-13693

2016-05-05 Thread Jesús Camacho Rodríguez
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/47037/ --- Review request for hive and Ashutosh Chauhan. Bugs: HIVE-13693 https://issu

Review Request 47040: Validate jobs submitted to fair-scheduler

2016-05-05 Thread Reuben Kuhnert
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/47040/ --- Review request for hive, Lenni Kuff, Mohit Sabharwal, and Sergio Pena. Bugs: HI

[jira] [Created] (HIVE-13697) ListBucketing feature does not support uppercase string.

2016-05-05 Thread Hao Zhu (JIRA)
Hao Zhu created HIVE-13697: -- Summary: ListBucketing feature does not support uppercase string. Key: HIVE-13697 URL: https://issues.apache.org/jira/browse/HIVE-13697 Project: Hive Issue Type: Bug

ListBucketing feature does not support uppercase string.

2016-05-05 Thread Jim Green
Hi Team, I found when there is uppercase string as the skew value, ListBucketing is not working. https://issues.apache.org/jira/browse/HIVE-13697 is filed: For example: 1. This is good: CREATE TABLE testskew (id INT, a STRING) SKEWED BY (a) ON ('abc', 'xyz') STORED AS DIRECTORIES; set hive.mapre

[jira] [Created] (HIVE-13698) refactor TezSession-s to support shared state

2016-05-05 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created HIVE-13698: --- Summary: refactor TezSession-s to support shared state Key: HIVE-13698 URL: https://issues.apache.org/jira/browse/HIVE-13698 Project: Hive Issue Type:

Re: Review Request 46579: HIVE-13449 LLAP: HS2 should get the token directly, rather than from LLAP

2016-05-05 Thread Sergey Shelukhin
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/46579/ --- (Updated May 5, 2016, 9:55 p.m.) Review request for hive, Gunther Hagleitner, S

[jira] [Created] (HIVE-13699) Make JavaDataModel#get thread safe for parallel compilation

2016-05-05 Thread Peter Slawski (JIRA)
Peter Slawski created HIVE-13699: Summary: Make JavaDataModel#get thread safe for parallel compilation Key: HIVE-13699 URL: https://issues.apache.org/jira/browse/HIVE-13699 Project: Hive Iss

[jira] [Created] (HIVE-13700) TestHiveOperationType is failing on master

2016-05-05 Thread Ashutosh Chauhan (JIRA)
Ashutosh Chauhan created HIVE-13700: --- Summary: TestHiveOperationType is failing on master Key: HIVE-13700 URL: https://issues.apache.org/jira/browse/HIVE-13700 Project: Hive Issue Type: Bug

[GitHub] hive pull request: Correcting typo in a Hive configuration

2016-05-05 Thread dharmeshkakadia
GitHub user dharmeshkakadia opened a pull request: https://github.com/apache/hive/pull/75 Correcting typo in a Hive configuration You can merge this pull request into a Git repository by running: $ git pull https://github.com/dharmeshkakadia/hive patch-1 Alternatively you can

Re: Review Request 46579: HIVE-13449 LLAP: HS2 should get the token directly, rather than from LLAP

2016-05-05 Thread Lefty Leverenz
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/46579/#review131971 --- common/src/java/org/apache/hadoop/hive/conf/HiveConf.java (lines

Re: Running unit tests?

2016-05-05 Thread Thejas Nair
Does this work from base hive directory ? (runs a specific test ) mvn clean install -DskipTests && cd itests/ && mvn test -Dtest=TestCliDriver '-Dqfile=index_compact_2.q' On Wed, May 4, 2016 at 10:54 AM, Ravi Prakash wrote: > Hi! > > Could someone please tell me how to run the clientpositive/

[jira] [Created] (HIVE-13701) LLAP: Use different prefix for llap task scheduler metrics

2016-05-05 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created HIVE-13701: Summary: LLAP: Use different prefix for llap task scheduler metrics Key: HIVE-13701 URL: https://issues.apache.org/jira/browse/HIVE-13701 Project: Hive

[jira] [Created] (HIVE-13702) TestHiveSessionImpl fails on master

2016-05-05 Thread Ashutosh Chauhan (JIRA)
Ashutosh Chauhan created HIVE-13702: --- Summary: TestHiveSessionImpl fails on master Key: HIVE-13702 URL: https://issues.apache.org/jira/browse/HIVE-13702 Project: Hive Issue Type: Bug

Review Request 47051: Trailing spaces in partition column will be treated differently

2016-05-05 Thread pengcheng xiong
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/47051/ --- Review request for hive and Ashutosh Chauhan. Repository: hive-git Descriptio

Re: Review Request 47051: Trailing spaces in partition column will be treated differently

2016-05-05 Thread Ashutosh Chauhan
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/47051/#review131980 --- metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.j

Re: [VOTE] Apache Hive 2.0.1 Release Candidate 1

2016-05-05 Thread Prasanth J
+1 - Verified signature and md5 on binary and src - Ran some tpcds scale 1 tests on tez with binary - Compiled source and ran some unit tests - Verified for SNAPSHOT jars - Ran Rat checks on some of the modules Thanks Prasanth > On May 3, 2016, at 11:25 PM, Sergey Shelukhin wrote: > > Apache H