Thank you, I will do that.
B
Subject: Re: Hive indexing optimization
From: jpullokka...@hortonworks.com
To: user@hive.apache.org
Date: Tue, 30 Jun 2015 18:46:50 +
Index doesn’t seems to be kicking in this case.
Please file a bug for this.
Thanks
John
From: Bennie Leo
Reply-To
PM
To: "user@hive.apache.org<mailto:user@hive.apache.org>"
mailto:user@hive.apache.org>>
Subject: RE: Hive indexing optimization
I've attached the output. Thanks.
B
____
Subject: Re: Hive indexing optimization
From: jpullokka...@horton
I've attached the output. Thanks.
B
Subject: Re: Hive indexing optimization
From: jpullokka...@hortonworks.com
To: user@hive.apache.org
Date: Mon, 29 Jun 2015 19:17:44 +
Could you post explain extended output?
From: Bennie Leo
Reply-To:
:user@hive.apache.org>"
mailto:user@hive.apache.org>>
Subject: RE: Hive indexing optimization
Here is the explain output:
STAGE PLANS:
Stage: Stage-1
Tez
Edges:
Reducer 2 <- Map 1 (SIMPLE_EDGE), Map 3 (SIMPLE_EDGE)
Vertices:
Map 1
putFormat
output format:
org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
serde:
org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
Stage: Stage-0
Fetch Operator
limit: -1
Thank you,
B
> Subject: Re: Hive indexing optimiz
"SELECT StartIp, EndIp, Country FROM ipv4geotable” should have been
rewritten as a scan against index table.
BitMap Indexes seems to support inequalities (<=, <, >=).
Post the explain plan.
On 6/26/15, 8:56 PM, "Gopal Vijayaraghavan" wrote:
>Hi,
>
>Hive indexes won¹t really help you speed up t
Hi,
Hive indexes won¹t really help you speed up that query right now, because
of the plan it generates due to the <= clauses.
> CREATETABLE ipv4table
> AS
> SELECT logon.IP, ipv4.Country
> FROM
> (SELECT * FROM logontable WHERE isIpv4(IP)) logon
> LEFT OUTER JOIN
> (SELECT StartIp, EndIp, Country
veCompactIndexInputFormat;"
?
I don't know how I could include this within my current query.
Cheers,
B
Subject: Re: Hive indexing optimization
From: jpullokka...@hortonworks.com
To: user@hive.apache.org
Date: Fri, 26 Jun 2015 01:27:21 +
Set hive.optimize.index.filter=tru
e.org<mailto:user@hive.apache.org>"
mailto:user@hive.apache.org>>
Subject: Hive indexing optimization
Hi,
I am attempting to optimize a query using indexing. My current query converts
an ipv4 address to a country using a geolocation table. However, the
geolocation table is fairly large and
Hi,
I am attempting to optimize a query using indexing. My current query converts
an ipv4 address to a country using a geolocation table. However, the
geolocation table is fairly large and the query takes an impractical amount of
time. I have created indexes and set the binary search param
10 matches
Mail list logo
