Anyway in hive to measure query performance.

2010-11-01 Thread Prafulla Tekawade
Hi, I was wondering if there is anyway in hive that can be used to measure the performance of variour components/operations of a single query run. Eg. Typecally query involvs various operations like tablescan, joins, aggregation, orderby etc. Can I get how much time was required for each of this?

[jira] Commented: (HIVE-1750) Remove Partition Filtering Conditions when Possible

2010-11-01 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12927312#action_12927312 ] Namit Jain commented on HIVE-1750: -- OpProcFactory: for (Partition p: prunedPartList.

[jira] Created: (HIVE-1762) Multi-character delimiter strings do not work correctly

2010-11-01 Thread Todd Lipcon (JIRA)
Multi-character delimiter strings do not work correctly --- Key: HIVE-1762 URL: https://issues.apache.org/jira/browse/HIVE-1762 Project: Hive Issue Type: Bug Components: Serialize

[jira] Updated: (HIVE-1750) Remove Partition Filtering Conditions when Possible

2010-11-01 Thread Siying Dong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siying Dong updated HIVE-1750: -- Attachment: HIVE-1750.2.patch Remove #PartitionConditionRemover.java# and some files that were not serio

[jira] Commented: (HIVE-1750) Remove Partition Filtering Conditions when Possible

2010-11-01 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12927285#action_12927285 ] Ted Yu commented on HIVE-1750: -- Should #PartitionConditionRemover.java# be removed from the pat

[jira] Updated: (HIVE-1754) Remove JDBM component from Map Join

2010-11-01 Thread Liyin Tang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liyin Tang updated HIVE-1754: - Attachment: Hive-1754.patch > Remove JDBM component from Map Join > --- >

[jira] Updated: (HIVE-1754) Remove JDBM component from Map Join

2010-11-01 Thread Liyin Tang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liyin Tang updated HIVE-1754: - Status: Patch Available (was: Open) This patch modifies the following things 1) Remove the JDBM from Hive

[jira] Resolved: (HIVE-1702) optimize JDBM to make mapjoin faster

2010-11-01 Thread Liyin Tang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liyin Tang resolved HIVE-1702. -- Resolution: Won't Fix Release Note: JDBM will be removed from Hive > optimize JDBM to make mapjoin

[jira] Resolved: (HIVE-1733) Make the bucket size of JDBM configurable

2010-11-01 Thread Liyin Tang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liyin Tang resolved HIVE-1733. -- Resolution: Not A Problem Release Note: The JDBM will be removed from Hive > Make the bucket size

[jira] Commented: (HIVE-1761) Support show locks for a particular table

2010-11-01 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12927247#action_12927247 ] He Yongqiang commented on HIVE-1761: +1 > Support show locks for a particular table > -

[jira] Updated: (HIVE-1761) Support show locks for a particular table

2010-11-01 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-1761: - Status: Patch Available (was: Open) > Support show locks for a particular table > ---

[jira] Updated: (HIVE-1761) Support show locks for a particular table

2010-11-01 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-1761: - Attachment: hive.1761.1.patch > Support show locks for a particular table > --

[jira] Commented: (HIVE-1332) Archiving partitions

2010-11-01 Thread Paul Yang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12927231#action_12927231 ] Paul Yang commented on HIVE-1332: - No, not yet. I'll update once it is posted. > Archiving

[jira] Commented: (HIVE-1332) Archiving partitions

2010-11-01 Thread John Sichi (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12927228#action_12927228 ] John Sichi commented on HIVE-1332: -- Paul, is there wiki documentation available for this fe

[jira] Updated: (HIVE-1750) Remove Partition Filtering Conditions when Possible

2010-11-01 Thread Siying Dong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siying Dong updated HIVE-1750: -- Status: Patch Available (was: Open) > Remove Partition Filtering Conditions when Possible > ---

[jira] Updated: (HIVE-1750) Remove Partition Filtering Conditions when Possible

2010-11-01 Thread Siying Dong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siying Dong updated HIVE-1750: -- Attachment: HIVE-1750.1.patch After generating partition predicates, we add another step to prune partit

[jira] Created: (HIVE-1761) Support show locks for a particular table

2010-11-01 Thread Namit Jain (JIRA)
Support show locks for a particular table - Key: HIVE-1761 URL: https://issues.apache.org/jira/browse/HIVE-1761 Project: Hive Issue Type: Improvement Components: Query Processor R

[jira] Assigned: (HIVE-1694) Accelerate query execution using indexes

2010-11-01 Thread John Sichi (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Sichi reassigned HIVE-1694: Assignee: Nikhil Deshpande > Accelerate query execution using indexes >

[jira] Updated: (HIVE-1501) when generating reentrant INSERT for index rebuild, quote identifiers using backticks

2010-11-01 Thread John Sichi (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Sichi updated HIVE-1501: - Status: Open (was: Patch Available) Can you update the testcase to use an index on a compound key so that

[jira] Commented: (HIVE-1497) support COMMENT clause on CREATE INDEX, and add new commands for SHOW/DESCRIBE indexes

2010-11-01 Thread John Sichi (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12927086#action_12927086 ] John Sichi commented on HIVE-1497: -- As discussed in last week's conf call, we'll need a fol

[jira] Commented: (HIVE-1526) Hive should depend on a release version of Thrift

2010-11-01 Thread Carl Steinbach (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12927081#action_12927081 ] Carl Steinbach commented on HIVE-1526: -- Need to update this page once this change is co

[jira] Commented: (HIVE-1746) Support for using ALTER to set IDXPROPERTIES

2010-11-01 Thread John Sichi (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12927079#action_12927079 ] John Sichi commented on HIVE-1746: -- Yes, you do need to extend the metastore thrift API for

[jira] Issue Comment Edited: (HIVE-1694) Accelerate query execution using indexes

2010-11-01 Thread John Sichi (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12927077#action_12927077 ] John Sichi edited comment on HIVE-1694 at 11/1/10 2:30 PM: --- +1 to

[jira] Commented: (HIVE-1694) Accelerate query execution using indexes

2010-11-01 Thread John Sichi (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12927077#action_12927077 ] John Sichi commented on HIVE-1694: -- +1 to what Namit said. Doing the rewrites at the relat

[jira] Commented: (HIVE-1694) Accelerate query execution using indexes

2010-11-01 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12927073#action_12927073 ] Namit Jain commented on HIVE-1694: -- Had an offline discussion with John just now - I think

[jira] Commented: (HIVE-1694) Accelerate query execution using indexes

2010-11-01 Thread John Sichi (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12927070#action_12927070 ] John Sichi commented on HIVE-1694: -- Hey guys, I haven't gone through all the code yet, but