Hallo,
It always depends on your use case and you always should do performance tests
to verify it fits your use cases. Hence, I doubt that you find a generic
statement on the Hive site. Although most of the times the internal index of
orc will have more advantages, such as less space usage.
Fu
fxtrade.com
>
> - Original Message -
> From: "Ranjith Raghunath"
> To: "user@hive.apache.org"
> Cc: "terry.zhao...@huawei.com"
> Sent: Wednesday, May 16, 2012 9:46:23 PM
> Subject: Re: Indexing in hive
>
> Thanks Mark, Carl, and Ransom
--
From: "Ranjith Raghunath"
To: "user@hive.apache.org"
Cc: "terry.zhao...@huawei.com"
Sent: Wednesday, May 16, 2012 9:46:23 PM
Subject: Re: Indexing in hive
Thanks Mark, Carl, and Ransom. I really appreciate the answers here. I am using
Hive 0.7.1 and currently trying to cre
: Zhaojun (Terry)
Subject: Re: Indexing in hive
Ransom,
From this JIRA (https://issues.apache.org/jira/browse/HIVE-1644), it looks like
automatic use of indexes using hive.optimize.index.filter was introduced in
Hive 0.8. However, Ranjith seems to be using Hive 0.7.1 which doesn't support
che.org
Cc: "Zhaojun (Terry)"
Sent: Wednesday, May 16, 2012 8:32:55 PM
Subject: RE: Indexing in hive
“ hive.optimize.index.filter ” is the conf automatically use indexes
If u set hive.optimize.index.groupby = true.
It will set hive.optimize.index.filter =false.
See your configurat
Hi Ranjith,
Hive 0.7 supports the ability to build indexes, but the query compiler in
0.7 doesn't know how to optimize queries with these indexes. Hive 0.8 was
the first release to include some support for optimizing query plans with
indexes, and that only applies to GROUP BY and WHERE clauses und
“hive.optimize.index.filter” is the conf automatically use indexes
If u set hive.optimize.index.groupby = true.
It will set hive.optimize.index.filter=false.
See your configurations.
And you need to build index after create index.
Best regards
Ransom.
Hi Avrilia,
These are (some of) the patches you are looking for:
HIVE-1644
HIVE-2128
HIVE-2138
I'm not sure what went into 0.7.1 but they will all be in the upcoming 0.8
release.
JIRA is your friend:
https://issues.apache.org/jira/secure/IssueNavigator.jspa?reset=true&jqlQuery=project+%3D+HIV
on a side note, i'm looking at adding indexes to our hive tables as well, is
there a performance/space trade off comparison or metrics?
thx!
On Wed, Aug 3, 2011 at 10:52 AM, Siddharth Ramanan <
siddharth.rama...@gmail.com> wrote:
> Hi all,
> I have used compact index for my table and th
Thanks! Can Hive index LZO compressed files then? LZO compression isn't
part of Cloudera's release, right?
On 03/08/2011 19:38, yongqiang he wrote:
unfortunately it does not, because can not split .gz file.
2011/8/3 Martin Konicek:
Hi,
can indexes work on gzipped files?
The index gets build
unfortunately it does not, because can not split .gz file.
2011/8/3 Martin Konicek :
> Hi,
>
> can indexes work on gzipped files?
>
> The index gets build without errors using
> ALTER INDEX syslog_index ON syslog PARTITION(dt='2011-08-03') REBUILD;
>
> but when querying, no results are returned (a
The reduce percentage keeps fluctuating when, the alter index command is
being keyed. The logs just give " out of memory error " after tweaking some
properties, the earlier exceptions doesn't appear now. Can anyone guide me
here? I have increased the heap space upto 4gb.. still, getting the same
ex
Hi,
I am adding the log information for a reduce task. I am running hadoop
in standalone mode.
2011-07-28 19:16:42,621 ERROR
org.apache.hadoop.hive.ql.stats.jdbc.JDBCStatsPublisher: Error during JDBC
connection to jdbc:derby:;databaseName=TempStatsStore;create=true.
java.lang.ClassNotFoundExc
13 matches
Mail list logo
