[jira] [Commented] (HIVE-3403) user should not specify mapjoin to perform sort-merge bucketed join

[ https://issues.apache.org/jira/browse/HIVE-3403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13567412#comment-13567412 ] Namit Jain commented on HIVE-3403: -- To help in review, the class hierarchy is: AbstractBu

[jira] [Updated] (HIVE-3403) user should not specify mapjoin to perform sort-merge bucketed join

[ https://issues.apache.org/jira/browse/HIVE-3403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-3403: - Attachment: hive.3403.22.patch > user should not specify mapjoin to perform sort-merge bucketed join >

[jira] [Updated] (HIVE-3917) Support noscan operation for analyze command

[ https://issues.apache.org/jira/browse/HIVE-3917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gang Tim Liu updated HIVE-3917: --- Attachment: HIVE-3917.patch.3 > Support noscan operation for analyze command > ---

Re: reduced unit test timings

I run tests on a parallel cluster (8 machines). For that, the test time has gone down from 2:15hours to approx. 1:15 On 1/31/13 11:55 AM, "Ashutosh Chauhan" wrote: >I am not sure about half, but >https://issues.apache.org/jira/browse/HIVE-3947 has certainly helped. Both >MiniMRCliDriver and Neg

Re: reduced unit test timings

I am not sure about half, but https://issues.apache.org/jira/browse/HIVE-3947 has certainly helped. Both MiniMRCliDriver and NegativeMiniMRCliDriver used to remain in hung state for ~10 minutes after all tests have run and minicluster is tearing down. That patch has saved atleast ~15 mins for test

[jira] [Updated] (HIVE-3403) user should not specify mapjoin to perform sort-merge bucketed join

[ https://issues.apache.org/jira/browse/HIVE-3403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-3403: - Attachment: hive.3403.21.patch > user should not specify mapjoin to perform sort-merge bucketed join >

[jira] [Updated] (HIVE-3778) Add MapJoinDesc.isBucketMapJoin() as part of explain plan

[ https://issues.apache.org/jira/browse/HIVE-3778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gang Tim Liu updated HIVE-3778: --- Status: Patch Available (was: Open) patch is available. > Add MapJoinDesc.isBucketMa

[jira] [Updated] (HIVE-3778) Add MapJoinDesc.isBucketMapJoin() as part of explain plan

[ https://issues.apache.org/jira/browse/HIVE-3778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gang Tim Liu updated HIVE-3778: --- Attachment: HIVE-3778.patch.10 > Add MapJoinDesc.isBucketMapJoin() as part of explain plan > -

[jira] [Updated] (HIVE-3778) Add MapJoinDesc.isBucketMapJoin() as part of explain plan

[ https://issues.apache.org/jira/browse/HIVE-3778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gang Tim Liu updated HIVE-3778: --- Attachment: HIVE-3778.patch.10 > Add MapJoinDesc.isBucketMapJoin() as part of explain plan > -

[jira] [Updated] (HIVE-3778) Add MapJoinDesc.isBucketMapJoin() as part of explain plan

[ https://issues.apache.org/jira/browse/HIVE-3778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-3778: - Status: Open (was: Patch Available) comments > Add MapJoinDesc.isBucketMapJoin() as part

[jira] [Updated] (HIVE-3778) Add MapJoinDesc.isBucketMapJoin() as part of explain plan

[ https://issues.apache.org/jira/browse/HIVE-3778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gang Tim Liu updated HIVE-3778: --- Attachment: HIVE-3778.patch.9 > Add MapJoinDesc.isBucketMapJoin() as part of explain plan > --

[jira] [Updated] (HIVE-3850) hour() function returns 12 hour clock value when using timestamp datatype

[ https://issues.apache.org/jira/browse/HIVE-3850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Grover updated HIVE-3850: -- Affects Version/s: 0.10.0 Fix Version/s: 0.11.0 > hour() function returns 12 hour clock valu

[jira] [Reopened] (HIVE-3850) hour() function returns 12 hour clock value when using timestamp datatype

[ https://issues.apache.org/jira/browse/HIVE-3850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Grover reopened HIVE-3850: --- The change wasn't committed, re-opening the JIRA. > hour() function returns 12 hour clock

[jira] [Commented] (HIVE-3850) hour() function returns 12 hour clock value when using timestamp datatype

[ https://issues.apache.org/jira/browse/HIVE-3850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13567356#comment-13567356 ] Mark Grover commented on HIVE-3850: --- Patch looks good to me. Usually, I would ask for un

[jira] [Commented] (HIVE-3850) hour() function returns 12 hour clock value when using timestamp datatype

[ https://issues.apache.org/jira/browse/HIVE-3850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13567355#comment-13567355 ] Mark Grover commented on HIVE-3850: --- For completeness, review is at: https://reviews.apac

Review Request: Request to review the change.

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/9171/ --- Review request for hive. Description --- Patch for issue https://issues.apa

[jira] [Commented] (HIVE-3778) Add MapJoinDesc.isBucketMapJoin() as part of explain plan

[ https://issues.apache.org/jira/browse/HIVE-3778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13567345#comment-13567345 ] Namit Jain commented on HIVE-3778: -- +1 Running tests > Add MapJoinDesc.i

reduced unit test timings

I have noticed that the time taken to run the unit tests has reduced considerably (it has become nearly half) from the last week or so. Just wondering, if anyone else has noticed this too. If yes, does anyone know the root cause of this speedup ? Thanks, -namit

[jira] [Commented] (HIVE-3953) Reading of partitioned Avro data fails because of missing properties

[ https://issues.apache.org/jira/browse/HIVE-3953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13567337#comment-13567337 ] Namit Jain commented on HIVE-3953: -- Copying from HIVE-3833. Can you provide me a complete

[jira] [Commented] (HIVE-3833) object inspectors should be initialized based on partition metadata

[ https://issues.apache.org/jira/browse/HIVE-3833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13567336#comment-13567336 ] Namit Jain commented on HIVE-3833: -- [~jakobhoman], this was definitely not intentional. Un

[jira] [Created] (HIVE-3965) Reduce output of explain plan by printing boolean value only if it is true

Gang Tim Liu created HIVE-3965: -- Summary: Reduce output of explain plan by printing boolean value only if it is true Key: HIVE-3965 URL: https://issues.apache.org/jira/browse/HIVE-3965 Project: Hive

[jira] [Commented] (HIVE-3778) Add MapJoinDesc.isBucketMapJoin() as part of explain plan

[ https://issues.apache.org/jira/browse/HIVE-3778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13567331#comment-13567331 ] Gang Tim Liu commented on HIVE-3778: [~ashutoshc]glad you like it. yes, here is the fol

[jira] [Commented] (HIVE-3778) Add MapJoinDesc.isBucketMapJoin() as part of explain plan

[ https://issues.apache.org/jira/browse/HIVE-3778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13567318#comment-13567318 ] Ashutosh Chauhan commented on HIVE-3778: Gang cool idea to address the concern. I t

[jira] [Updated] (HIVE-3958) support partial scan for analyze command

[ https://issues.apache.org/jira/browse/HIVE-3958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhuoluo (Clark) Yang updated HIVE-3958: --- Description: analyze commands allows us to collect statistics on existing tables/parti

[jira] [Commented] (HIVE-896) Add LEAD/LAG/FIRST/LAST analytical windowing functions to Hive.

[ https://issues.apache.org/jira/browse/HIVE-896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13567271#comment-13567271 ] Harish Butani commented on HIVE-896: Yes, exactly. Will start to introduce the new Spec

[jira] [Created] (HIVE-3964) Add upgrade script for Oracle backend to metastore.

Mithun Radhakrishnan created HIVE-3964: -- Summary: Add upgrade script for Oracle backend to metastore. Key: HIVE-3964 URL: https://issues.apache.org/jira/browse/HIVE-3964 Project: Hive Is

[jira] [Commented] (HIVE-3940) Track columns accessed in each table in a query

[ https://issues.apache.org/jira/browse/HIVE-3940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13567149#comment-13567149 ] Hudson commented on HIVE-3940: -- Integrated in hive-trunk-hadoop1 #60 (See [https://builds.apa

Jenkins build is back to normal : Hive-0.9.1-SNAPSHOT-h0.21 #277

See

[jira] [Commented] (HIVE-3917) Support noscan operation for analyze command

[ https://issues.apache.org/jira/browse/HIVE-3917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13567024#comment-13567024 ] Gang Tim Liu commented on HIVE-3917: patch is in both https://reviews.facebook.net/D823

[jira] [Commented] (HIVE-3778) Add MapJoinDesc.isBucketMapJoin() as part of explain plan

[ https://issues.apache.org/jira/browse/HIVE-3778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13567023#comment-13567023 ] Gang Tim Liu commented on HIVE-3778: patch is attached to the jira also.

[jira] [Updated] (HIVE-3778) Add MapJoinDesc.isBucketMapJoin() as part of explain plan

[ https://issues.apache.org/jira/browse/HIVE-3778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gang Tim Liu updated HIVE-3778: --- Status: Patch Available (was: In Progress) patch is available https://reviews.facebook.net/D8259

[jira] [Work started] (HIVE-3778) Add MapJoinDesc.isBucketMapJoin() as part of explain plan

[ https://issues.apache.org/jira/browse/HIVE-3778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-3778 started by Gang Tim Liu. > Add MapJoinDesc.isBucketMapJoin() as part of explain plan > - > >

[jira] [Updated] (HIVE-3778) Add MapJoinDesc.isBucketMapJoin() as part of explain plan

[ https://issues.apache.org/jira/browse/HIVE-3778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gang Tim Liu updated HIVE-3778: --- Attachment: HIVE-3778.patch.8 > Add MapJoinDesc.isBucketMapJoin() as part of explain plan > --

[jira] [Updated] (HIVE-3963) Allow Hive to connect to RDBMS

[ https://issues.apache.org/jira/browse/HIVE-3963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxime LANCIAUX updated HIVE-3963: -- Component/s: StorageHandler SQL JDBC

[jira] [Updated] (HIVE-3917) Support noscan operation for analyze command

[ https://issues.apache.org/jira/browse/HIVE-3917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gang Tim Liu updated HIVE-3917: --- Attachment: HIVE-3917.patch.2 > Support noscan operation for analyze command > ---

[jira] [Updated] (HIVE-3917) Support noscan operation for analyze command

[ https://issues.apache.org/jira/browse/HIVE-3917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gang Tim Liu updated HIVE-3917: --- Attachment: (was: HIVE-3917.patch.2) > Support noscan operation for analyze command >

[jira] [Created] (HIVE-3963) Allow Hive to get connect to RDBMS

Maxime LANCIAUX created HIVE-3963: - Summary: Allow Hive to get connect to RDBMS Key: HIVE-3963 URL: https://issues.apache.org/jira/browse/HIVE-3963 Project: Hive Issue Type: New Feature

[jira] [Commented] (HIVE-896) Add LEAD/LAG/FIRST/LAST analytical windowing functions to Hive.

[ https://issues.apache.org/jira/browse/HIVE-896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566952#comment-13566952 ] Ashutosh Chauhan commented on HIVE-896: --- Also need to make sure that ASTNode and other

[jira] [Commented] (HIVE-896) Add LEAD/LAG/FIRST/LAST analytical windowing functions to Hive.

[ https://issues.apache.org/jira/browse/HIVE-896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566946#comment-13566946 ] Ashutosh Chauhan commented on HIVE-896: --- PTFDesc only contains a serialized string for

[jira] [Updated] (HIVE-3940) Track columns accessed in each table in a query

[ https://issues.apache.org/jira/browse/HIVE-3940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Wilfong updated HIVE-3940: Resolution: Fixed Fix Version/s: 0.11.0 Status: Resolved (was: Patch Available) C

Jenkins build is back to normal : Hive-0.10.0-SNAPSHOT-h0.20.1 #50

See

[jira] [Commented] (HIVE-3833) object inspectors should be initialized based on partition metadata

[ https://issues.apache.org/jira/browse/HIVE-3833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566913#comment-13566913 ] Jakob Homan commented on HIVE-3833: --- This patch has broken Avro (and probably HBase and C

[jira] [Updated] (HIVE-3917) Support noscan operation for analyze command

[ https://issues.apache.org/jira/browse/HIVE-3917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gang Tim Liu updated HIVE-3917: --- Status: Patch Available (was: In Progress) patch is available. > Support noscan oper

[jira] [Work started] (HIVE-3917) Support noscan operation for analyze command

[ https://issues.apache.org/jira/browse/HIVE-3917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-3917 started by Gang Tim Liu. > Support noscan operation for analyze command > > > Key: HIVE-3917

[jira] [Updated] (HIVE-3917) Support noscan operation for analyze command

[ https://issues.apache.org/jira/browse/HIVE-3917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gang Tim Liu updated HIVE-3917: --- Attachment: HIVE-3917.patch.2 > Support noscan operation for analyze command > ---

[jira] [Commented] (HIVE-2340) optimize orderby followed by a groupby

[ https://issues.apache.org/jira/browse/HIVE-2340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566902#comment-13566902 ] Gunther Hagleitner commented on HIVE-2340: -- Partial review on phabricator. Biggest

[jira] [Commented] (HIVE-2340) optimize orderby followed by a groupby

[ https://issues.apache.org/jira/browse/HIVE-2340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566898#comment-13566898 ] Phabricator commented on HIVE-2340: --- hagleitn has commented on the revision "HIVE-2340 [j

[jira] [Updated] (HIVE-2340) optimize orderby followed by a groupby

[ https://issues.apache.org/jira/browse/HIVE-2340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gunther Hagleitner updated HIVE-2340: - Attachment: testclidriver.txt just the diff of the latest unit test run.

[jira] [Commented] (HIVE-2340) optimize orderby followed by a groupby

[ https://issues.apache.org/jira/browse/HIVE-2340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566810#comment-13566810 ] Gunther Hagleitner commented on HIVE-2340: -- FYI: Ran all unit tests on patch .9. F

[jira] [Updated] (HIVE-3940) Track columns accessed in each table in a query

[ https://issues.apache.org/jira/browse/HIVE-3940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Samuel Yuan updated HIVE-3940: -- Attachment: HIVE-3940.3.patch.txt Updated. > Track columns accessed in each table in a

[jira] [Commented] (HIVE-3874) Create a new Optimized Row Columnar file format for Hive

[ https://issues.apache.org/jira/browse/HIVE-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566727#comment-13566727 ] Namit Jain commented on HIVE-3874: -- I took a stab at it. I am attaching it just in case -

[jira] [Updated] (HIVE-3874) Create a new Optimized Row Columnar file format for Hive

[ https://issues.apache.org/jira/browse/HIVE-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-3874: - Attachment: hive.3874.2.patch > Create a new Optimized Row Columnar file format for Hive > ---

Hive-trunk-h0.21 - Build # 1947 - Fixed

Changes for Build #1944 [namit] HIVE-3873 lot of tests failing for hadoop 23 (Gang Tim Liu via namit) Changes for Build #1945 [hashutosh] Missed deleting empty file GenMRRedSink4.java while commiting 3784 [hashutosh] HIVE-de-emphasize mapjoin hint (Namit Jain via Ashutosh Chauhan) Changes for

[jira] [Commented] (HIVE-933) Infer bucketing/sorting properties

[ https://issues.apache.org/jira/browse/HIVE-933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566726#comment-13566726 ] Hudson commented on HIVE-933: - Integrated in Hive-trunk-h0.21 #1947 (See [https://builds.apache

[jira] [Commented] (HIVE-3874) Create a new Optimized Row Columnar file format for Hive

[ https://issues.apache.org/jira/browse/HIVE-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566707#comment-13566707 ] Owen O'Malley commented on HIVE-3874: - [~namit], I've got one more feature that I'm wor

[jira] [Resolved] (HIVE-3850) hour() function returns 12 hour clock value when using timestamp datatype

[ https://issues.apache.org/jira/browse/HIVE-3850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pieterjan Vriends resolved HIVE-3850. - Resolution: Fixed > hour() function returns 12 hour clock value when using timestamp d

Hive-trunk-h0.21 - Build # 1946 - Failure

Changes for Build #1944 [namit] HIVE-3873 lot of tests failing for hadoop 23 (Gang Tim Liu via namit) Changes for Build #1945 [hashutosh] Missed deleting empty file GenMRRedSink4.java while commiting 3784 [hashutosh] HIVE-de-emphasize mapjoin hint (Namit Jain via Ashutosh Chauhan) Changes for

[jira] [Commented] (HIVE-3950) Remove code for merging files via MR job

[ https://issues.apache.org/jira/browse/HIVE-3950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566422#comment-13566422 ] Hudson commented on HIVE-3950: -- Integrated in Hive-trunk-h0.21 #1946 (See [https://builds.apa

[jira] [Updated] (HIVE-3403) user should not specify mapjoin to perform sort-merge bucketed join

[ https://issues.apache.org/jira/browse/HIVE-3403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-3403: - Attachment: hive.3403.19.patch > user should not specify mapjoin to perform sort-merge bucketed join >

[jira] [Commented] (HIVE-3950) Remove code for merging files via MR job

[ https://issues.apache.org/jira/browse/HIVE-3950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566401#comment-13566401 ] Hudson commented on HIVE-3950: -- Integrated in Hive-trunk-hadoop2 #97 (See [https://builds.apa

[jira] [Commented] (HIVE-933) Infer bucketing/sorting properties

[ https://issues.apache.org/jira/browse/HIVE-933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566402#comment-13566402 ] Hudson commented on HIVE-933: - Integrated in Hive-trunk-hadoop2 #97 (See [https://builds.apache

[jira] [Commented] (HIVE-3785) Core hive changes for HiveServer2 implementation

[ https://issues.apache.org/jira/browse/HIVE-3785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566400#comment-13566400 ] Namit Jain commented on HIVE-3785: -- cc [~mgrover], [~prasadm] > Core hive

[jira] [Commented] (HIVE-3785) Core hive changes for HiveServer2 implementation

[ https://issues.apache.org/jira/browse/HIVE-3785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566399#comment-13566399 ] Namit Jain commented on HIVE-3785: -- I am sorry for the delay on my part. Can you refresh ?

[jira] [Updated] (HIVE-3962) Number of distinct values are wrong in column statistics

[ https://issues.apache.org/jira/browse/HIVE-3962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated HIVE-3962: -- Summary: Number of distinct values are wrong in column statistics (was: number

[jira] [Created] (HIVE-3962) number of distinct values are in column statistics

Amareshwari Sriramadasu created HIVE-3962: - Summary: number of distinct values are in column statistics Key: HIVE-3962 URL: https://issues.apache.org/jira/browse/HIVE-3962 Project: Hive

[jira] [Commented] (HIVE-633) ADD FILE command does not accept quoted filenames

[ https://issues.apache.org/jira/browse/HIVE-633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566331#comment-13566331 ] kiran sreekumar commented on HIVE-633: -- is this issue still relevant, as i would like t