Re: [ANNOUNCE] Apache Hive 1.0.0 Released

2015-02-05 Thread Devopam Mittra
+1 Updated https://en.wikipedia.org/wiki/Apache_Hive with the latest version info regards Devopam On Thu, Feb 5, 2015 at 11:46 PM, Thejas Nair wrote: > Congrats to all the users and contributors in the Apache Hive community! > It is great that we finally move away from the 0.x versioning schem

Re: Re: How to query data by page in Hive?

2015-02-05 Thread Alexander Pivovarov
ROW_NUMBER doc http://docs.oracle.com/cd/B28359_01/server.111/b28286/functions144.htm#SQLRF06100 On Thu, Feb 5, 2015 at 4:48 PM, r7raul1...@163.com wrote: > *Table structure :* > CREATE TABLE `u_data`( > `userid` int, > `movieid` int, > `rating` int, > `unixtime` string) > ROW FORMAT DELIMITED

Re: Re: How to query data by page in Hive?

2015-02-05 Thread r7raul1...@163.com
Table structure : CREATE TABLE `u_data`( `userid` int, `movieid` int, `rating` int, `unixtime` string) ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t' STORED AS INPUTFORMAT 'org.apache.hadoop.mapred.TextInputFormat' OUTPUTFORMAT 'org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat'

Re: Predicate push-down on nested types ?

2015-02-05 Thread The Watcher
Thanks for the quick reply. I suppose you are referring to https://issues.apache.org/jira/browse/HIVE-7214 ? Does Parquet really already support this ? That ticket says it does but I'd like confirmation Thanks 2015-02-05 19:47 GMT+01:00 Prasanth Jayachandran < pjayachand...@hortonworks.com>: >

Re: Predicate push-down on nested types ?

2015-02-05 Thread Prasanth Jayachandran
ORC does not support at this point. There are plans to do so. > On Feb 5, 2015, at 10:29 AM, The Watcher wrote: > > I'm wondering if predicates are pushed down when they apply to elements of a > nested struct. More specifically, imagine a table such as > > CREATE TABLE t ( > c1 int, > c2 STRUC

Predicate push-down on nested types ?

2015-02-05 Thread The Watcher
I'm wondering if predicates are pushed down when they apply to elements of a nested struct. More specifically, imagine a table such as CREATE TABLE t ( c1 int, c2 STRUCT ) STORED as XXX; Will "SELECT * from t where c2.b=3 " be pushed down to ORC ? Would it be pushed down to Parquet ? Thanks

hive-testbench install fails

2015-02-05 Thread max scalf
hello all, i am trying to install the hive testbench( https://github.com/hortonworks/hive-testbench) on my cluster but it seems to fail with some maven error…below is the output for installing that tool…any help is appreciated… http://pastebin.com/MJecpGxh Funny thing is, i was able to install t

Re: [ANNOUNCE] Apache Hive 1.0.0 Released

2015-02-05 Thread Thejas Nair
Congrats to all the users and contributors in the Apache Hive community! It is great that we finally move away from the 0.x versioning scheme to the 1.x versioning scheme for new releases. This is a great way of honoring the work from hive community that has made hive the defacto standard for SQL o

Re: [ANNOUNCE] Apache Hive 1.0.0 Released

2015-02-05 Thread DU DU
I know. But comparing to 0.14.0 and 0.13.0, version 1.0.0 is expected to have much, is it? On Thu, Feb 5, 2015 at 9:44 AM, grimaldi.vince...@gmail.com < grimaldi.vince...@gmail.com> wrote: > Please note that the Tez support is for version 0.5.2 now. > > > 2015-02-05 14:33 GMT+00:00 DU DU : > >> I

Re: [ANNOUNCE] Apache Hive 1.0.0 Released

2015-02-05 Thread grimaldi.vince...@gmail.com
Please note that the Tez support is for version 0.5.2 now. 2015-02-05 14:33 GMT+00:00 DU DU : > It is mainly a collection of bug fix on 0.14.0, is it? > Thanks, > Will > > On Thu, Feb 5, 2015 at 8:38 AM, Clark Yang (杨卓荦) > wrote: > >> Congrats! Great job! >> >> Thanks, >> Zhuoluo (Clark) Yang >

Re: [ANNOUNCE] Apache Hive 1.0.0 Released

2015-02-05 Thread DU DU
It is mainly a collection of bug fix on 0.14.0, is it? Thanks, Will On Thu, Feb 5, 2015 at 8:38 AM, Clark Yang (杨卓荦) wrote: > Congrats! Great job! > > Thanks, > Zhuoluo (Clark) Yang > > 2015-02-05 6:07 GMT+08:00 Vikram Dixit K : > >> The Apache Hive team is proud to announce the the release of A

Re: [ANNOUNCE] Apache Hive 1.0.0 Released

2015-02-05 Thread 杨卓荦
Congrats! Great job! Thanks, Zhuoluo (Clark) Yang 2015-02-05 6:07 GMT+08:00 Vikram Dixit K : > The Apache Hive team is proud to announce the the release of Apache > Hive version 1.0.0. > > The Apache Hive (TM) data warehouse software facilitates querying and > managing large datasets residing in

Re: Re: How to query data by page in Hive?

2015-02-05 Thread Devopam Mittra
Please provide a valid table structure and the columns you wish to pick and I shall email you the query directly regards Devopam On Thu, Feb 5, 2015 at 3:20 PM, r7raul1...@163.com wrote: > Thank you Devopam! Could you show me a example? > > -- > r7raul1...@163.com

Re: Re: How to query data by page in Hive?

2015-02-05 Thread r7raul1...@163.com
Thank you Devopam! Could you show me a example? r7raul1...@163.com From: Devopam Mittra Date: 2015-02-05 18:05 To: user@hive.apache.org Subject: Re: How to query data by page in Hive? You may want to use a ROW_NUMBER OR RANK / DENSE RANK in the inner query and then select only a subset of i

Re: How to query data by page in Hive?

2015-02-05 Thread Devopam Mittra
You may want to use a ROW_NUMBER OR RANK / DENSE RANK in the inner query and then select only a subset of it in the outer query to control pagination. Based on your need, you may want to order the records as well .. Alternatively you may want to use CTE( https://cwiki.apache.org/confluence/display

How to query data by page in Hive?

2015-02-05 Thread r7raul1...@163.com
Hello, How to query data by page in Hive? hive> select * from u_data a limit 1,2; FAILED: ParseException line 1:31 missing EOF at ',' near '1' r7raul1...@163.com