Re: ORDER BY clause in Hive

2015-03-30 Thread Lefty Leverenz
I've opened HIVE-10160 : Give a warning when grouping or ordering by a constant column. Thanks Gopal. -- Lefty On Tue, Mar 31, 2015 at 2:14 AM, Lefty Leverenz wrote: > -- Forwarded message -- > From: Lefty Leverenz > Date: Tue

Fwd: ORDER BY clause in Hive

2015-03-30 Thread Lefty Leverenz
-- Forwarded message -- From: Lefty Leverenz Date: Tue, Mar 31, 2015 at 1:47 AM Subject: Re: ORDER BY clause in Hive To: Mich Talebzadeh Hive as I see it does not support ORDER BY *Column position*. It only > supports ORDER BY *Column name*. > That's just in Hive release 0.10.0

Fwd: ORDER BY clause in Hive

2015-03-30 Thread Lefty Leverenz
Oops, failed to send this to user@hive. -- Lefty -- Forwarded message -- From: Lefty Leverenz Date: Mon, Mar 30, 2015 at 12:42 AM Subject: Re: ORDER BY clause in Hive To: Gopal Vijayaraghavan Oho! Good point, Gopal. hive.groupby.orderby.position.alias isn't in the wiki yet, b

Re: Predicate pushdown on HBase snapshots

2015-03-30 Thread Gopal Vijayaraghavan
>Looking at the current implementation on trunk, hive's hbase integration >doesn't currently seem to support predicate pushdown for queries over >HBase snapshots. Does this seem like a reasonable feature to add? >It would be nice to have relative feature parity between queries running >over snapsh

Predicate pushdown on HBase snapshots

2015-03-30 Thread Andrew Mains
Hi all, Looking at the current implementation on trunk, hive's hbase integration doesn't currently seem to support predicate pushdown for queries over HBase snapshots. Does this seem like a reasonable feature to add? It would be nice to have relative feature parity between queries running over

Standard deviation (STDDEV) function calculation in Hive

2015-03-30 Thread Mich Talebzadeh
Hi, Basically, the standard deviation (STDDEV) is a measure that is used to quantify the amount of variation or dispersion of a set of data values. It is widely used in trading systems such as FX. STDEDV in Hive is explained here

Re: Interpretation of transactional table base file format

2015-03-30 Thread Elliot West
Ok, so both the source and Javadoc for org.apache.hadoop.hive.ql.io.orc.OrcInputFormat answer most of these questions. Apologies for the spam. Thanks - Elliot. On 30 March 2015 at 11:52, Elliot West wrote: > I've been looking at the structure of the ORCFiles that back transaction > tables in H

Interpretation of transactional table base file format

2015-03-30 Thread Elliot West
I've been looking at the structure of the ORCFiles that back transaction tables in Hive. After a compaction I was surprised to find that the base file structure is identical to the delta structure: struct< operation:int, originalTransaction:bigint, bucket:int, rowId:bigint, c

RE: ORDER BY clause in Hive

2015-03-30 Thread Mich Talebzadeh
Gents, Hive as I see it does not support ORDER BY Column position. It only supports ORDER BY Column name. Thanks Mich Talebzadeh http://talebzadehmich.wordpress.com Publications due shortly: Creating in-memory Data Grid for Trading Systems with Oracle TimesTen and Coherence