Re: (HIVE-1642) Convert join queries to map-join based on size of table/row

Hi, How large is t1 and t2 ? if both of t1 and t2 is larger than 25M (a default threshold), the query processor will do the common join. Thanks Liyin On 23 December 2010 18:50, wrote: > Hi, > > I set hive.auto.convert.join=true and run the following query: > > select t1.foo, count(t2.bar) from

[jira] Updated: (HIVE-1858) Implement DROP {PARTITION, INDEX, TEMPORARY FUNCTION} IF EXISTS

[ https://issues.apache.org/jira/browse/HIVE-1858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcel Kornacker updated HIVE-1858: --- Attachment: hive-1858.1.patch > Implement DROP {PARTITION, INDEX, TEMPORARY FUNCTION} IF EXIST

[jira] Updated: (HIVE-1858) Implement DROP {PARTITION, INDEX, TEMPORARY FUNCTION} IF EXISTS

[ https://issues.apache.org/jira/browse/HIVE-1858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcel Kornacker updated HIVE-1858: --- Status: Patch Available (was: Open) > Implement DROP {PARTITION, INDEX, TEMPORARY FUNCTION} I

[jira] Updated: (HIVE-1858) Implement DROP {PARTITION, INDEX, TEMPORARY FUNCTION} IF EXISTS

[ https://issues.apache.org/jira/browse/HIVE-1858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcel Kornacker updated HIVE-1858: --- Description: Extend HIVE-1856 to support IF EXISTS for {DROP TABLE, VIEW} and ALTER TABLE DRO

(HIVE-1642) Convert join queries to map-join based on size of table/row

Hi, I set hive.auto.convert.join=true and run the following query: select t1.foo, count(t2.bar) from invites t1 join invites t2 on (t1.foo=t2.foo) group by t1.foo; I did not see it ran as map side join. Did I miss something? Is there any precondition for this feature to work? Thanks.

[jira] Commented: (HIVE-1262) Add security/checksum UDFs sha,crc32,md5,aes_encrypt, and aes_decrypt

[ https://issues.apache.org/jira/browse/HIVE-1262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12974795#action_12974795 ] John Sichi commented on HIVE-1262: -- Review comments added in https://reviews.apache.org/r/

[jira] Updated: (HIVE-1262) Add security/checksum UDFs sha,crc32,md5,aes_encrypt, and aes_decrypt

[ https://issues.apache.org/jira/browse/HIVE-1262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Sichi updated HIVE-1262: - Status: Open (was: Patch Available) > Add security/checksum UDFs sha,crc32,md5,aes_encrypt, and aes_decry

Re: Review Request: HIVE-1262

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/192/#review79 --- http://svn.apache.org/repos/asf/hive/trunk/common/src/java/org/apache/ha

Review Request: HIVE-1262

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/192/ --- Review request for hive. Summary --- Review by JVS This addresses bug HIVE

[jira] Updated: (HIVE-1806) The merge criteria on dynamic partitons should be per partiton

[ https://issues.apache.org/jira/browse/HIVE-1806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-1806: - Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) Commit

[jira] Updated: (HIVE-1818) Call frequency and duration metrics for HiveMetaStore via jmx

[ https://issues.apache.org/jira/browse/HIVE-1818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Yang updated HIVE-1818: Status: Open (was: Patch Available) > Call frequency and duration metrics for HiveMetaStore via jmx > -

[jira] Commented: (HIVE-1818) Call frequency and duration metrics for HiveMetaStore via jmx

[ https://issues.apache.org/jira/browse/HIVE-1818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12974786#action_12974786 ] Paul Yang commented on HIVE-1818: - Sushanth, can you regenerate this patch against the curre

[jira] Commented: (HIVE-1866) -101 should not swallow the exception.

[ https://issues.apache.org/jira/browse/HIVE-1866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12974787#action_12974787 ] Ning Zhang commented on HIVE-1866: -- This has been fixed in part of HIVE-1806 (not committed

[jira] Created: (HIVE-1866) -101 should not swallow the exception.

-101 should not swallow the exception. --- Key: HIVE-1866 URL: https://issues.apache.org/jira/browse/HIVE-1866 Project: Hive Issue Type: Improvement Reporter: He Yongqiang The exception stac

[jira] Updated: (HIVE-1611) Add alternative search-provider to Hive site

[ https://issues.apache.org/jira/browse/HIVE-1611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Sichi updated HIVE-1611: - Status: Open (was: Patch Available) > Add alternative search-provider to Hive site >

[jira] Assigned: (HIVE-1818) Call frequency and duration metrics for HiveMetaStore via jmx

[ https://issues.apache.org/jira/browse/HIVE-1818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Yang reassigned HIVE-1818: --- Assignee: Sushanth Sowmyan > Call frequency and duration metrics for HiveMetaStore via jmx > -

[jira] Commented: (HIVE-1818) Call frequency and duration metrics for HiveMetaStore via jmx

[ https://issues.apache.org/jira/browse/HIVE-1818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12974785#action_12974785 ] Paul Yang commented on HIVE-1818: - Taking a look > Call frequency and duration metrics for

[jira] Updated: (HIVE-1456) potentail NullPointerException

[ https://issues.apache.org/jira/browse/HIVE-1456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-1456: - Resolution: Fixed Status: Resolved (was: Patch Available) Committed. Thanks Alexey > potentail N

[jira] Assigned: (HIVE-1456) potentail NullPointerException

[ https://issues.apache.org/jira/browse/HIVE-1456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain reassigned HIVE-1456: Assignee: Alexey Diomin > potentail NullPointerException > -- > >

[jira] Commented: (HIVE-1865) redo zookeeper hive lock manager

[ https://issues.apache.org/jira/browse/HIVE-1865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12974779#action_12974779 ] He Yongqiang commented on HIVE-1865: will take a look, and do some stress test. > redo

[jira] Commented: (HIVE-1456) potentail NullPointerException

[ https://issues.apache.org/jira/browse/HIVE-1456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12974776#action_12974776 ] Namit Jain commented on HIVE-1456: -- +1 > potentail NullPointerException >

[jira] Reopened: (HIVE-1623) Factor out Hadoop version check logic in bin/hive scripts

[ https://issues.apache.org/jira/browse/HIVE-1623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach reopened HIVE-1623: -- @Ed: Please link a ticket to the duplicating ticket before resolving it as a duplicate. > Factor o

[jira] Commented: (HIVE-901) Build Hive ODBC library with Autoconf/Automake

[ https://issues.apache.org/jira/browse/HIVE-901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12974767#action_12974767 ] Carl Steinbach commented on HIVE-901: - @Ed: The FSF makes a specific exception for autoco

[jira] Updated: (HIVE-1456) potentail NullPointerException

[ https://issues.apache.org/jira/browse/HIVE-1456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Capriolo updated HIVE-1456: -- Status: Patch Available (was: Open) > potentail NullPointerException >

[jira] Resolved: (HIVE-1623) Factor out Hadoop version check logic in bin/hive scripts

[ https://issues.apache.org/jira/browse/HIVE-1623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Capriolo resolved HIVE-1623. --- Resolution: Duplicate I have an jira open to remove all pre-20 tweaks. This will be handled in

[jira] Commented: (HIVE-901) Build Hive ODBC library with Autoconf/Automake

[ https://issues.apache.org/jira/browse/HIVE-901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12974757#action_12974757 ] Ning Zhang commented on HIVE-901: - @edward, I guess this JIRA is about making libhiveclient.s

[jira] Resolved: (HIVE-1597) Hive CLI returns MasterNotRunningException with HBase 0.89.x

[ https://issues.apache.org/jira/browse/HIVE-1597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Capriolo resolved HIVE-1597. --- Resolution: Won't Fix This looks to be a classpath/external problem. Reopen if we missed somet

[jira] Resolved: (HIVE-1604) Patch to allow variables in Hive

[ https://issues.apache.org/jira/browse/HIVE-1604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Capriolo resolved HIVE-1604. --- Resolution: Duplicate Release Note: Duplicate of HIVE-1096 1096 has been committed. We

[jira] Commented: (HIVE-901) Build Hive ODBC library with Autoconf/Automake

[ https://issues.apache.org/jira/browse/HIVE-901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12974751#action_12974751 ] Edward Capriolo commented on HIVE-901: -- Is there any licensing issues with bringing GPL

[jira] Commented: (HIVE-1806) The merge criteria on dynamic partitons should be per partiton

[ https://issues.apache.org/jira/browse/HIVE-1806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12974752#action_12974752 ] Namit Jain commented on HIVE-1806: -- Thats fine +1 > The merge criteria on dynamic partito

[jira] Commented: (HIVE-1806) The merge criteria on dynamic partitons should be per partiton

[ https://issues.apache.org/jira/browse/HIVE-1806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12974749#action_12974749 ] Ning Zhang commented on HIVE-1806: -- That's expected behavior. The merge job will check if t

[jira] Resolved: (HIVE-822) HWI: propagate error messages all the way up to user interface

[ https://issues.apache.org/jira/browse/HIVE-822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Capriolo resolved HIVE-822. -- Resolution: Duplicate Release Note: Duplication of HIVE-821 > HWI: propagate error messages

[jira] Commented: (HIVE-837) virtual column support (filename) in hive

[ https://issues.apache.org/jira/browse/HIVE-837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12974739#action_12974739 ] Amr Awadallah commented on HIVE-837: I am out of office on vacation and will be slower th

[jira] Resolved: (HIVE-837) virtual column support (filename) in hive

[ https://issues.apache.org/jira/browse/HIVE-837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Capriolo resolved HIVE-837. -- Resolution: Duplicate Duplicate of HIVE-417. We are working on adding another virtual column (l

[jira] Commented: (HIVE-1861) Hive's float datatype is not supported by the Hive JDBC driver

[ https://issues.apache.org/jira/browse/HIVE-1861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12974731#action_12974731 ] Steven Wong commented on HIVE-1861: --- This should have been fixed by HIVE-1378 in trunk (0.

[jira] Commented: (HIVE-1859) Hive's tinyint datatype is not supported by the Hive JDBC driver

[ https://issues.apache.org/jira/browse/HIVE-1859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12974733#action_12974733 ] Steven Wong commented on HIVE-1859: --- This should have been fixed by HIVE-1378 in trunk (0.

[jira] Commented: (HIVE-1860) Hive's smallint datatype is not supported by the Hive JDBC driver

[ https://issues.apache.org/jira/browse/HIVE-1860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12974732#action_12974732 ] Steven Wong commented on HIVE-1860: --- This should have been fixed by HIVE-1378 in trunk (0.

[jira] Commented: (HIVE-1863) Boolean columns in Hive tables containing NULL are treated as FALSE by the Hive JDBC driver.

[ https://issues.apache.org/jira/browse/HIVE-1863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12974728#action_12974728 ] Steven Wong commented on HIVE-1863: --- This may have been fixed by HIVE-1378 in trunk (0.7).

[jira] Commented: (HIVE-1806) The merge criteria on dynamic partitons should be per partiton

[ https://issues.apache.org/jira/browse/HIVE-1806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12974713#action_12974713 ] Namit Jain commented on HIVE-1806: -- Mostly looks good - a minor comment. In the new test

[jira] Commented: (HIVE-1863) Boolean columns in Hive tables containing NULL are treated as FALSE by the Hive JDBC driver.

[ https://issues.apache.org/jira/browse/HIVE-1863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12974701#action_12974701 ] Edward Capriolo commented on HIVE-1863: --- Right. Something gets "lost in translation" h

Build failed in Hudson: Hive-trunk-h0.20 #451

See Changes: [jssarma] HIVE-1852 Reduce unnecessary DFSClient.rename() calls (Ning Zhang via jssarma) -- [...truncated 14785 lines...] [junit] POSTHOOK: Output: defa...@srcbucket2

Re: Issue with map join

Can you send the exact query along with the schema of the tables ? On 12/23/10 1:48 AM, "jaydeep vishwakarma" wrote: >Hi, > >I am trying to running some MAPJOIN queries. When I am placing single >table in MAP JOIN it works fine,But when I run same query with two >tables on MAPJOIN it gives erro

[jira] Resolved: (HIVE-1847) option of continue on error

[ https://issues.apache.org/jira/browse/HIVE-1847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain resolved HIVE-1847. -- Resolution: Not A Problem Thanks Thiruvel > option of continue on error > --- >

[jira] Assigned: (HIVE-1863) Boolean columns in Hive tables containing NULL are treated as FALSE by the Hive JDBC driver.

[ https://issues.apache.org/jira/browse/HIVE-1863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Capriolo reassigned HIVE-1863: - Assignee: Edward Capriolo > Boolean columns in Hive tables containing NULL are treated as

[jira] Commented: (HIVE-1847) option of continue on error

[ https://issues.apache.org/jira/browse/HIVE-1847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12974603#action_12974603 ] Thiruvel Thirumoolan commented on HIVE-1847: @Namit, i wasn't clear. The param

Issue with map join

Hi, I am trying to running some MAPJOIN queries. When I am placing single table in MAP JOIN it works fine,But when I run same query with two tables on MAPJOIN it gives error. Can any tell me what could be the problem? Here is the error log which I am getting from job tracker. java.lang.RuntimeE