[jira] [Updated] (HIVE-1644) use filter pushdown for automatically accessing indexes

2011-03-22 Thread Russell Melick (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Melick updated HIVE-1644: - Attachment: HIVE-1644.10.patch Yongqiang, I think I fixed the double processing by using a differe

[jira] [Commented] (HIVE-2031) Correct the exception message for the better traceability for the scenario load into the partitioned table having 2 partitions by specifying only one partition in the l

2011-03-22 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13010011#comment-13010011 ] Amareshwari Sriramadasu commented on HIVE-2031: --- Committed. Thanks Chinna. >

[jira] [Commented] (HIVE-1434) Cassandra Storage Handler

2011-03-22 Thread Amr Awadallah (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13010010#comment-13010010 ] Amr Awadallah commented on HIVE-1434: - I am out of office on a business trip this week

[jira] [Commented] (HIVE-1434) Cassandra Storage Handler

2011-03-22 Thread John Sichi (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13010009#comment-13010009 ] John Sichi commented on HIVE-1434: -- Hey Ed, I'm out on vacation so just saw this). A coup

Build failed in Jenkins: Hive-trunk-h0.20 #634

2011-03-22 Thread Apache Hudson Server
See Changes: [namit] HIVE-2003 LOAD compilation does not set the outputs during semantic analysis resulting in no authorization checks being done for it (Krishna Kumar via namit) --

[jira] [Commented] (HIVE-2050) batch processing partition pruning process

2011-03-22 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13010001#comment-13010001 ] Ning Zhang commented on HIVE-2050: -- Note that this patch implements a simple API that pass

Re: skew join optimization

2011-03-22 Thread Ted Yu
Can someone re-attach the missing figures for that wiki ? Thanks On Sun, Mar 20, 2011 at 7:15 AM, bharath vissapragada < bharathvissapragada1...@gmail.com> wrote: > Hi Igor, > > See http://wiki.apache.org/hadoop/Hive/JoinOptimization and see the > jira 1642 which automatically converts a normal

Re: skew join optimization

2011-03-22 Thread Ted Yu
How about link to http://imageshack.us/ or TinyPic ? Thanks On Sun, Mar 20, 2011 at 7:56 AM, Edward Capriolo wrote: > On Sun, Mar 20, 2011 at 10:30 AM, Ted Yu wrote: > > Can someone re-attach the missing figures for that wiki ? > > > > Thanks > > > > On Sun, Mar 20, 2011 at 7:15 AM, bharath vis

Review Request: Patch for HIVE-2003: Load analysis should add table/partition to the outputs

2011-03-22 Thread Krishna
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/518/ --- Review request for hive. Summary --- Patch for HIVE-2003: Load analysis shou

Re: Review Request: HIVE-2054: fix for IOException on the jdbc driver on windows.

2011-03-22 Thread Bennie Schut
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/513/ --- (Updated 2011-03-21 12:50:40.422997) Review request for hive. Changes ---

Re: Review Request: HIVE-1803: Implement bitmap indexing in Hive (new review starting from patch 6)

2011-03-22 Thread Marquis Wang
> On None, John Sichi wrote: > > ql/src/java/org/apache/hadoop/hive/ql/index/compact/HiveCompactIndexInputFormat.java, > > line 45 > > > > > > I'm confused about how the backwards compatibility works for the index > > fil

[jira] [Created] (HIVE-2071) enforcereadonlytables hook should not check a configuration variable

2011-03-22 Thread Namit Jain (JIRA)
enforcereadonlytables hook should not check a configuration variable Key: HIVE-2071 URL: https://issues.apache.org/jira/browse/HIVE-2071 Project: Hive Issue Type: Bug

Review Request: HIVE-2069: NullPointerException on getSchemas

2011-03-22 Thread Bennie Schut
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/521/ --- Review request for hive. Summary --- HIVE-2069: NullPointerException on getS

Bug in using columns with leading underscores in subqueries

2011-03-22 Thread Marquis Wang
Hi, I believe I've found a bug in the semantic analyzer (or maybe something else?). It occurs when using a column with a leading underscore in a subquery. > create table temp (`_col` int, key int); > select key from temp; > select `_col` from temp; > select key from (select key from temp) t; Th

Re: Work around for using OR in Joins

2011-03-22 Thread Ning Zhang
Joins with OR conditions are not supported by Hive currently. I think even though you rewrite the condition to use NOT and AND only, the results may be wrong. It is quite hard to implement joins of any tables with OR conditions in a MapReduce framework. it is straightforward to implement it i

[jira] [Commented] (HIVE-2050) batch processing partition pruning process

2011-03-22 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13009993#comment-13009993 ] Ning Zhang commented on HIVE-2050: -- passed all unit tests. > batch processing partition p

[jira] [Commented] (HIVE-2065) RCFile issues

2011-03-22 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13009982#comment-13009982 ] He Yongqiang commented on HIVE-2065: if being compatible with sequencefile does not bre

[jira] [Commented] (HIVE-2065) RCFile issues

2011-03-22 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13009981#comment-13009981 ] Krishna Kumar commented on HIVE-2065: - Hmm. #3 is taking me a bit too far than I origin

Re: Meanings of privileges

2011-03-22 Thread yongqiang he
>>INDEX - my best guess is that this allows me to create/drop indexes on a table? Yes. It is there for this purpose. >> Is it the case that if I have select access on a table, I can use any index that exists on a table? No. index is also a table now, so you need to have access to both of them. >>

Meanings of privileges

2011-03-22 Thread Jonathan Natkins
Hi all, I'm trying to understand the meaning of some of the privileges in the system, and I'm a bit stumped on what some of them actually do. Privileges that confuse me: INDEX - my best guess is that this allows me to create/drop indexes on a table? Is it the case that if I have select access on

[jira] [Updated] (HIVE-2050) batch processing partition pruning process

2011-03-22 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-2050: - Attachment: HIVE-2050.patch Uploading a new patch for review. Still running tests. The review board reque

[jira] [Updated] (HIVE-2050) batch processing partition pruning process

2011-03-22 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-2050: - Status: Patch Available (was: Open) > batch processing partition pruning process > --

Review Request: HIVE-2050. batch processing partition pruning process

2011-03-22 Thread Ning Zhang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/522/ --- Review request for hive. Summary --- Introducing a new metastore API to retr

[jira] [Updated] (HIVE-2003) LOAD compilation does not set the outputs during semantic analysis resulting in no authorization checks being done for it.

2011-03-22 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2003: - Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) Commit

Build failed in Jenkins: Hive-trunk-h0.20 #633

2011-03-22 Thread Apache Hudson Server
See Changes: [namit] HIVE-1983 Bundle Log4j configuration files in Hive JARs (Carl Steinbach via namit) [namit] HIVE-2049 Push down partition pruning to JDO filtering for a subset of partition predicates (Ning Zhang vi

[jira] [Created] (HIVE-2070) SHOW GRANT grantTime field should be a human-readable timestamp

2011-03-22 Thread Jonathan Natkins (JIRA)
SHOW GRANT grantTime field should be a human-readable timestamp --- Key: HIVE-2070 URL: https://issues.apache.org/jira/browse/HIVE-2070 Project: Hive Issue Type: Improvement

[jira] [Commented] (HIVE-2069) NullPointerException on getSchemas

2011-03-22 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13009841#comment-13009841 ] Ning Zhang commented on HIVE-2069: -- +1. will commit if tests pass. > NullPointerExceptio

[jira] [Updated] (HIVE-2069) NullPointerException on getSchemas

2011-03-22 Thread Bennie Schut (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bennie Schut updated HIVE-2069: --- Release Note: Fix for NullPointerException on the jdbc driver on getSchemas Status: Patch Ava

[jira] [Updated] (HIVE-2069) NullPointerException on getSchemas

2011-03-22 Thread Bennie Schut (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bennie Schut updated HIVE-2069: --- Attachment: HIVE-2069.1.patch.txt This patch includes a fix and a test which can be used to reproduce

[jira] [Commented] (HIVE-2069) NullPointerException on getSchemas

2011-03-22 Thread Bennie Schut (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13009825#comment-13009825 ] Bennie Schut commented on HIVE-2069: java.lang.NullPointerException at java.util.ArrayL

[jira] [Created] (HIVE-2069) NullPointerException on getSchemas

2011-03-22 Thread Bennie Schut (JIRA)
NullPointerException on getSchemas -- Key: HIVE-2069 URL: https://issues.apache.org/jira/browse/HIVE-2069 Project: Hive Issue Type: Bug Components: JDBC Affects Versions: 0.8.0 Report

Build failed in Jenkins: Hive-trunk-h0.20 #632

2011-03-22 Thread Apache Hudson Server
See -- [...truncated 28061 lines...] [junit] POSTHOOK: query: load data local inpath ' into table testhivedr

Build failed in Jenkins: Hive-0.7.0-h0.20 #50

2011-03-22 Thread Apache Hudson Server
See -- [...truncated 27029 lines...] [junit] POSTHOOK: Output: default@srcbucket2 [junit] OK [junit] Copying file:

[jira] [Commented] (HIVE-2003) LOAD compilation does not set the outputs during semantic analysis resulting in no authorization checks being done for it.

2011-03-22 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13009772#comment-13009772 ] Namit Jain commented on HIVE-2003: -- Instead of adding a new configuration parameter whi

[jira] [Commented] (HIVE-2003) LOAD compilation does not set the outputs during semantic analysis resulting in no authorization checks being done for it.

2011-03-22 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13009739#comment-13009739 ] Namit Jain commented on HIVE-2003: -- I will take a look right away > LOAD compilation does

[jira] [Updated] (HIVE-2003) LOAD compilation does not set the outputs during semantic analysis resulting in no authorization checks being done for it.

2011-03-22 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2003: Status: Patch Available (was: Open) Please review asap as there are lots of changes to q.out files

[jira] [Updated] (HIVE-1983) Bundle Log4j configuration files in Hive JARs

2011-03-22 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-1983: - Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) Commit

[jira] [Assigned] (HIVE-2050) batch processing partition pruning process

2011-03-22 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang reassigned HIVE-2050: Assignee: Ning Zhang > batch processing partition pruning process >

[jira] [Updated] (HIVE-2049) Push down partition pruning to JDO filtering for a subset of partition predicates

2011-03-22 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2049: - Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) Commit

[jira] [Commented] (HIVE-2031) Correct the exception message for the better traceability for the scenario load into the partitioned table having 2 partitions by specifying only one partition in the l

2011-03-22 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13009643#comment-13009643 ] Amareshwari Sriramadasu commented on HIVE-2031: --- +1. Will commit if tests pas

[jira] [Updated] (HIVE-1538) FilterOperator is applied twice with ppd on.

2011-03-22 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated HIVE-1538: -- Attachment: patch-1538-2.txt Added configuration hive.ppd.remove.duplicatefilter

[jira] [Commented] (HIVE-2063) jdbc return only 1 collumn

2011-03-22 Thread Alexey Diomin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13009623#comment-13009623 ] Alexey Diomin commented on HIVE-2063: - wait bug very interesting reproducing on hadoop

[jira] [Updated] (HIVE-2042) In error scenario some opened streams may not closed in ExplainTask.java and Throttle.java

2011-03-22 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated HIVE-2042: -- Resolution: Fixed Fix Version/s: 0.8.0 Status: Resolved (was:

[jira] [Updated] (HIVE-2042) In error scenario some opened streams may not closed

2011-03-22 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated HIVE-2042: -- Summary: In error scenario some opened streams may not closed (was: In error sc

[jira] [Commented] (HIVE-2031) Correct the exception message for the better traceability for the scenario load into the partitioned table having 2 partitions by specifying only one partition in the l

2011-03-22 Thread Chinna Rao Lalam (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13009586#comment-13009586 ] Chinna Rao Lalam commented on HIVE-2031: Updated the patch with test cases. > Corr

Re: Work around for using OR in Joins

2011-03-22 Thread MIS
Found it at *org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.java* line no. 1122 There is some concern mentioned that supporting OR would lead to data explosion. Is it discussed/documneted in a little more detail somewhere ? If so, some pointers towards the same will be helpful. Thanks, MIS. On

Work around for using OR in Joins

2011-03-22 Thread MIS
I want to use OR in the join expression, but it seems only AND is supported as of now. I have a work around though to use DeMorgan's law {C1 OR C2 = !(!C1 AND !C2))} , but it would be nice if somebody can point me to the location in code base that would need modification to support the OR in the jo