RE: Debugging Hive

2010-11-16 Thread Sanjay Sharma
Russell, See if this can help you- http://indoos.wordpress.com/2010/06/24/hive-remote-debugging/ You would have to tweak the old scripts however for your Hadoop and Hive versions Regards, Sanjay Sharma -Original Message- From: Russell Melick [mailto:rmel...@hmc.edu] Sent: Wednesday,

Debugging Hive

2010-11-16 Thread Russell Melick
Hi all, Apologies for the long email. I'm attempting to connect to the hive code with a debugger to understand the optimizer. In this example, I would like to pause at the beginning of the createIndex function in DDLTask. After following the directions on the wiki, I'm stumped as to why connect

[jira] Commented: (HIVE-1642) Convert join queries to map-join based on size of table/row

2010-11-16 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12932843#action_12932843 ] Namit Jain commented on HIVE-1642: -- +1 running tests > Convert join queries to map-join ba

[jira] Commented: (HIVE-1795) outputs not correctly populated for alter table

2010-11-16 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12932835#action_12932835 ] He Yongqiang commented on HIVE-1795: +1 running tests. > outputs not correctly populate

[jira] Updated: (HIVE-1746) Support for using ALTER to set IDXPROPERTIES

2010-11-16 Thread Marquis Wang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marquis Wang updated HIVE-1746: --- Status: Patch Available (was: Open) > Support for using ALTER to set IDXPROPERTIES >

[jira] Updated: (HIVE-1746) Support for using ALTER to set IDXPROPERTIES

2010-11-16 Thread Marquis Wang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marquis Wang updated HIVE-1746: --- Attachment: HIVE-1746.4.patch Oops, you're right, that makes sense. New patch that includes those chan

[jira] Updated: (HIVE-1795) outputs not correctly populated for alter table

2010-11-16 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-1795: - Status: Patch Available (was: Open) > outputs not correctly populated for alter table > -

[jira] Updated: (HIVE-1795) outputs not correctly populated for alter table

2010-11-16 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-1795: - Attachment: hive.1795.1.patch > outputs not correctly populated for alter table >

[jira] Updated: (HIVE-1642) Convert join queries to map-join based on size of table/row

2010-11-16 Thread Liyin Tang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liyin Tang updated HIVE-1642: - Attachment: hive-1642_11.patch When the local task runs out of memory, do NOT print any thing out and jus

[jira] Updated: (HIVE-1642) Convert join queries to map-join based on size of table/row

2010-11-16 Thread Liyin Tang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liyin Tang updated HIVE-1642: - Attachment: hive-1642_10.patch After discussing, we think the function: replaceWithConditionalTask is not

[jira] Updated: (HIVE-1642) Convert join queries to map-join based on size of table/row

2010-11-16 Thread Liyin Tang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liyin Tang updated HIVE-1642: - Attachment: hive-1642_9.patch some minor changes in ConditionalResolverCommonJoin.java > Convert join qu

[jira] Updated: (HIVE-1642) Convert join queries to map-join based on size of table/row

2010-11-16 Thread Liyin Tang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liyin Tang updated HIVE-1642: - Attachment: hive-1642_7.patch In Task.java public void replaceWithConditionalTask(ConditionalTask cndTsk,

[jira] Commented: (HIVE-1642) Convert join queries to map-join based on size of table/row

2010-11-16 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12932744#action_12932744 ] Namit Jain commented on HIVE-1642: -- ConditionalResolverCommonJoin // Iterate the sor

[jira] Commented: (HIVE-1642) Convert join queries to map-join based on size of table/row

2010-11-16 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12932741#action_12932741 ] Namit Jain commented on HIVE-1642: -- ConditionalResolverCommonJoin // generate file siz

[jira] Created: (HIVE-1796) dumps time at which lock was taken along with the queryid in show locks extended

2010-11-16 Thread Namit Jain (JIRA)
dumps time at which lock was taken along with the queryid in show locks extended Key: HIVE-1796 URL: https://issues.apache.org/jira/browse/HIVE-1796 Project: Hive

[jira] Updated: (HIVE-1642) Convert join queries to map-join based on size of table/row

2010-11-16 Thread Liyin Tang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liyin Tang updated HIVE-1642: - Attachment: hive-1642_6.patch Remove the getBackupTask interface from all the Conditional Resolver > Con

[jira] Created: (HIVE-1795) outputs not correctly populated for alter table

2010-11-16 Thread Namit Jain (JIRA)
outputs not correctly populated for alter table --- Key: HIVE-1795 URL: https://issues.apache.org/jira/browse/HIVE-1795 Project: Hive Issue Type: Bug Components: Query Processor

[jira] Updated: (HIVE-1642) Convert join queries to map-join based on size of table/row

2010-11-16 Thread Liyin Tang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liyin Tang updated HIVE-1642: - Attachment: (was: hive-1642_5.patch) > Convert join queries to map-join based on size of table/row > -

[jira] Updated: (HIVE-1642) Convert join queries to map-join based on size of table/row

2010-11-16 Thread Liyin Tang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liyin Tang updated HIVE-1642: - Attachment: hive-1642_5.patch Add more detailed description on configuration xml file Revert the DriverCon

[jira] Updated: (HIVE-1642) Convert join queries to map-join based on size of table/row

2010-11-16 Thread Liyin Tang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liyin Tang updated HIVE-1642: - Attachment: hive-1642_5.patch Add more descriptions to the configuration files. Revert the DriverContext.

[jira] Commented: (HIVE-1746) Support for using ALTER to set IDXPROPERTIES

2010-11-16 Thread John Sichi (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12932680#action_12932680 ] John Sichi commented on HIVE-1746: -- My suggestion is to push the user-get completely inside

[jira] Commented: (HIVE-1746) Support for using ALTER to set IDXPROPERTIES

2010-11-16 Thread Marquis Wang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12932671#action_12932671 ] Marquis Wang commented on HIVE-1746: Are you sure it makes sense to share the code for g

[jira] Updated: (HIVE-1794) GenericUDFOr and GenericUDFAnd cannot receive boolean typed object

2010-11-16 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-1794: - Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) Commit

[jira] Commented: (HIVE-1642) Convert join queries to map-join based on size of table/row

2010-11-16 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12932666#action_12932666 ] Namit Jain commented on HIVE-1642: -- hive-default.xml 477 478 hive.mapjoin.hashtable

[jira] Commented: (HIVE-1785) change Pre/Post Query Hooks to take in 1 parameter: HookContext

2010-11-16 Thread Liyin Tang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12932623#action_12932623 ] Liyin Tang commented on HIVE-1785: -- I generate the diff based on the Hive-1642. Please igno

[jira] Updated: (HIVE-1785) change Pre/Post Query Hooks to take in 1 parameter: HookContext

2010-11-16 Thread Liyin Tang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liyin Tang updated HIVE-1785: - Attachment: hive_1785_2.patch Thanks for John's comments. Now in the Driver.java: for (PostExecute peh :

[jira] Commented: (HIVE-78) Authorization infrastructure for Hive

2010-11-16 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-78?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12932587#action_12932587 ] Namit Jain commented on HIVE-78: In case of dynamic partitions, you can also have DummyPartiti

[jira] Updated: (HIVE-1642) Convert join queries to map-join based on size of table/row

2010-11-16 Thread Liyin Tang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liyin Tang updated HIVE-1642: - Attachment: hive_1642_4.patch This patch formats the output of local task. > Convert join queries to map-

[jira] Commented: (HIVE-1783) CommonJoinOperator optimize the case of 1:1 join

2010-11-16 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12932570#action_12932570 ] Namit Jain commented on HIVE-1783: -- Let us get it after HIVE-1642 > CommonJoinOperator opt

[jira] Commented: (HIVE-1794) GenericUDFOr and GenericUDFAnd cannot receive boolean typed object

2010-11-16 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12932540#action_12932540 ] Namit Jain commented on HIVE-1794: -- +1 running tests > GenericUDFOr and GenericUDFAnd c

[jira] Updated: (HIVE-1642) Convert join queries to map-join based on size of table/row

2010-11-16 Thread Liyin Tang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liyin Tang updated HIVE-1642: - Attachment: hive_1642_2.patch Thanks for the comments. I have updated the patch according to the review c