[
https://issues.apache.org/jira/browse/HIVE-2036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Melick reassigned HIVE-2036:
Assignee: Syed S. Albiz (was: Jeffrey Lym)
> Update bitmap indexes for automatic us
[
https://issues.apache.org/jira/browse/HIVE-2036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13036685#comment-13036685
]
Russell Melick commented on HIVE-2036:
--
To expand a bit on Marquis' comm
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/558/
---
(Updated 2011-05-01 19:20:02.130293)
Review request for hive.
Summary
---
[
https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Melick updated HIVE-1644:
-
Attachment: HIVE-1644.19.patch
Patch 19 ready for review.
https://reviews.apache.org/r/558
[
https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Melick updated HIVE-1644:
-
Status: Patch Available (was: Open)
> use filter pushdown for automatically accessing inde
[
https://issues.apache.org/jira/browse/HIVE-2138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Melick updated HIVE-2138:
-
Attachment: index_auto_test_if_used.q
Attached test file (index_auto_test_if_used) that should
: 0.8.0
Reporter: Russell Melick
Running a query that uses indexing but doesn't return any results give an
exception.
{code} java.lang.IllegalArgumentException: Can not create a Path from an empty
string
at org.apache.hadoop.fs.Path.checkPathArg(Path.java:8
[
https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13027294#comment-13027294
]
Russell Melick commented on HIVE-1644:
--
Unfortunately, having an empty array g
[
https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13027283#comment-13027283
]
Russell Melick commented on HIVE-1644:
--
I can send it back out of the index han
[
https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Melick updated HIVE-1644:
-
Attachment: hive.log
I've attached the hive.log I get from running
{{{
ant test -Dtes
[
https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Melick updated HIVE-1644:
-
Attachment: HIVE-1644.18.patch
patch 18
I moved that logic into a helper method, but I'
[
https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Melick updated HIVE-1644:
-
Attachment: HIVE-1644.17.patch
patch 17
Updated to include HIVE-1803. Still cannot figure out
r.java
<https://reviews.apache.org/r/558/#comment1254>
At this point, the inputFormat for this work is actually null. I do not
know which work I need to change the inputFormat for, and I can't think of an
easy way to get to other work.
- Russell
On 2011-04-29 00:01:06, Rus
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/558/
---
(Updated 2011-04-29 00:01:06.921150)
Review request for hive.
Changes
---
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/558/
---
(Updated 2011-04-23 06:41:49.007802)
Review request for hive.
Changes
---
didn't change
anything.
ql/src/test/results/clientpositive/index_auto_test_if_used.q.out
<https://reviews.apache.org/r/558/#comment1109>
We shouldn't be seeing this output. We're still generating the right plan,
but something is wrong when we run it.
- Russell
On 2
[
https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Melick updated HIVE-1644:
-
Attachment: HIVE-1644.16.patch
Patch 16
One last problem. It doesn't appear the ind
: Indexing
Affects Versions: 0.8.0
Reporter: Russell Melick
After processing a predicate, there are potentially multiple index rewrites
possible. Currently, we just choose the first one. However, there are
probably heuristics for choosing certain rewrites over others, based on
Components: Indexing
Affects Versions: 0.8.0
Reporter: Russell Melick
Show the indexInputFormat and indexIntermediateFile in the plan, to indicate
that the table scan's input is being filtered by the intermediate file. But,
we only want to do this when these values are non-null (
: 0.8.0
Reporter: Russell Melick
Make automatic indexing work with jobs which access multiple tables. We'll
probably need to modify the way that the index input format works in order to
associate index formats/files with specific tables.
--
This message is automatically generat
[
https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Melick updated HIVE-1644:
-
Attachment: HIVE-1644.15.patch
HIVE-1644.15.patch
Few remaining comments on reviewboard.
>
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/558/
---
(Updated 2011-04-22 03:50:54.602032)
Review request for hive.
Changes
---
>
See above comment about MapredWork
- Russell
On 2011-04-22 03:50:54, Russell Melick wrote:
>
> ---
> This is an automatically generated e-mail. To reply,
d.q
<https://reviews.apache.org/r/558/#comment996>
How do unbuilt partitions work? I didn't see any way to delay the
building, so I don't know how to have an index with unbuilt partitions.
- Russell
On 2011-04-16 06:04:26, Russell Melick wrote:
>
> -
[
https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Melick updated HIVE-1644:
-
Attachment: HIVE-1644.14.patch
Include new unit tests. Also asked a few more questions on the
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/558/
---
(Updated 2011-04-16 06:04:26.681814)
Review request for hive.
Changes
---
: Indexing
Affects Versions: 0.8.0
Reporter: Russell Melick
During automatic use of indexes, we analyze the query predicate to pull out
what we can use the index on. Not all of the predicate can necessarily be
processed with a single index. Currently, we return the residual
l a single task.
Or, should it relabel all tasks in the whole plan? We only have easy access to
the context.currentTask when we iterate through in IndexWhereProcessor (line
153)
- Russell
On 2011-04-15 08:08:14, Russell Melick wrote:
>
>
[
https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Melick updated HIVE-1644:
-
Attachment: HIVE-1644.13.patch
I have several questions on the review board. I also fixed the
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/558/
---
(Updated 2011-04-15 08:08:14.640798)
Review request for hive.
Changes
---
[
https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Melick updated HIVE-1644:
-
Affects Version/s: (was: 0.7.0)
0.8.0
Release Note: Enables
[
https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Melick updated HIVE-1644:
-
Attachment: HIVE-1644.12.patch
Includes check to make sure that all partitions in the query exist
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/558/
---
Review request for hive.
Summary
---
Review request for HIVE-1644.12.patch
[
https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13014394#comment-13014394
]
Russell Melick commented on HIVE-1644:
--
I'm having trouble getting the p
[
https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Melick updated HIVE-1644:
-
Attachment: HIVE-1644.11.patch
* I don't think that my method of relabeling the tasks
: Indexing
Affects Versions: 0.8.0
Reporter: Russell Melick
We want to make sure that automatically using indexes doesn't make the query
worse. For example, after scanning the index table, it might still need to
scan the whole base table. In this case, we would much rather
[
https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Melick updated HIVE-1644:
-
Attachment: HIVE-1644.10.patch
Yongqiang, I think I fixed the double processing by using a
[
https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Melick updated HIVE-1644:
-
Attachment: HIVE-1644.9.patch
HIVE-1644.9.patch
Added task relabeling to the addDependentTask
[
https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Melick updated HIVE-1644:
-
Attachment: HIVE-1644.8.patch
HIVE-1644.8.patch
Fixed unit tests per John and Yonqiang. Cleaned
Versions: 0.8.0
Reporter: Russell Melick
Assignee: Jeffrey Lym
HIVE-1644 will provide automatic usage of indexes, and HIVE-1803 adds bitmap
index support. The bitmap code will need to be extended after it is committed
to enable automatic use of indexing. Most work will be
[
https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Melick updated HIVE-1644:
-
Attachment: HIVE-1644.7.patch
HIVE-1744.7.patch:
@Yongqiang, I fixed the problems in
[
https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Melick updated HIVE-1644:
-
Attachment: HIVE-1644.6.patch
New patch fixes the NPE by linking the SemanticAnalyzer into the
[
https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Melick updated HIVE-1644:
-
Attachment: HIVE-1644.5.patch
HIVE-1644.5.path
I have moved the processing into the
[
https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Melick updated HIVE-1644:
-
Attachment: HIVE-1644.3.patch
Much cleaner patch, which includes moving the re-entrant QL
[
https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12999206#comment-12999206
]
Russell Melick commented on HIVE-1644:
--
Make sure we update the admin configura
[
https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12998155#comment-12998155
]
Russell Melick commented on HIVE-1644:
--
We also spoke about changing the re-ent
[
https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12998148#comment-12998148
]
Russell Melick commented on HIVE-1644:
--
Like we said, writing the index query to
[
https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Melick updated HIVE-1644:
-
Attachment: HIVE-1644.2.patch
Includes modification of MapReduce tasks to use index input format
[
https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Melick updated HIVE-1644:
-
Attachment: HIVE-1644.1.patch
I'm having trouble joining the operator trees together. W
[
https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on HIVE-1644 started by Russell Melick.
> use filter pushdown for automatically accessing inde
See if this can help you-
> http://indoos.wordpress.com/2010/06/24/hive-remote-debugging/
>
>
> You would have to tweak the old scripts however for your Hadoop and Hive
> versions
>
> Regards,
> Sanjay Sharma
>
>
> -Original Message-
> From:
as to
why connecting remotely with jdb is not working. Any help is
appreciated. I've detailed my process below.
Thanks,
Russell Melick
First, I check out a fresh copy of trunk:
> svn checkout http://svn.apache.org/repos/asf/hive/trunk hive
Then, I compile it for debugging, a
[
https://issues.apache.org/jira/browse/HIVE-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Melick updated HIVE-1497:
-
Status: Patch Available (was: Open)
> support COMMENT clause on CREATE INDEX, and add
[
https://issues.apache.org/jira/browse/HIVE-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Melick updated HIVE-1497:
-
Attachment: HIVE-1497.8.patch
fixed problem with only showing first column/key name
> supp
[
https://issues.apache.org/jira/browse/HIVE-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Melick updated HIVE-1497:
-
Attachment: HIVE-1497.7.patch
Pluralized col_names in the FORMATTED column header
> supp
[
https://issues.apache.org/jira/browse/HIVE-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Melick updated HIVE-1497:
-
Status: Patch Available (was: Open)
> support COMMENT clause on CREATE INDEX, and add
[
https://issues.apache.org/jira/browse/HIVE-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Melick updated HIVE-1497:
-
Attachment: HIVE-1497.6.patch
* Removed commented out code
* Added a test case with index
[
https://issues.apache.org/jira/browse/HIVE-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12928140#action_12928140
]
Russell Melick commented on HIVE-1497:
--
Should also update the Index wiki:
[
https://issues.apache.org/jira/browse/HIVE-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Melick updated HIVE-1497:
-
Status: Patch Available (was: Open)
> support COMMENT clause on CREATE INDEX, and add
[
https://issues.apache.org/jira/browse/HIVE-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Melick updated HIVE-1497:
-
Attachment: HIVE-1497.5.patch
Modify SHOW INDEX grammer to use ON keyword instead of FROM/IN to
[
https://issues.apache.org/jira/browse/HIVE-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Melick updated HIVE-1497:
-
Attachment: HIVE-1497.4.patch
> support COMMENT clause on CREATE INDEX, and add new commands
Reporter: Russell Melick
Assignee: Jeffrey Lym
Fix For: 0.7.0
Followup for HIVE-1497
* Work out the syntax for DESCRIBE, taking partitioning into account.
* Allow regular expressions for selecting tables (like SHOW TABLES )
* Enable showing indexes which are only on
[
https://issues.apache.org/jira/browse/HIVE-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Melick updated HIVE-1497:
-
Attachment: hive-1497.p3.patch
Coding complete, but unit tests not added yet. Does not deal with
63 matches
Mail list logo
