[ https://issues.apache.org/jira/browse/HIVE-5029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13755431#comment-13755431 ]
Hudson commented on HIVE-5029: ------------------------------ FAILURE: Integrated in Hive-trunk-h0.21 #2299 (See [https://builds.apache.org/job/Hive-trunk-h0.21/2299/]) HIVE-5029 : direct SQL perf optimization cannot be tested well (Sergey Shelukhin via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1518953) * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/RetryingRawStore.java * /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/VerifyingObjectStore.java * /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/QTestUtil.java > direct SQL perf optimization cannot be tested well > -------------------------------------------------- > > Key: HIVE-5029 > URL: https://issues.apache.org/jira/browse/HIVE-5029 > Project: Hive > Issue Type: Test > Reporter: Sergey Shelukhin > Assignee: Sergey Shelukhin > Priority: Critical > Fix For: 0.12.0 > > Attachments: HIVE-5029.D12483.1.patch, HIVE-5029.D12483.2.patch, > HIVE-5029.patch, HIVE-5029.patch > > > HIVE-4051 introduced perf optimization that involves getting partitions > directly via SQL in metastore. Given that SQL queries might not work on all > datastores (and will not work on non-SQL ones), JDO fallback is in place. > Given that perf improvement is very large for short queries, it's on by > default. > However, there's a problem with tests with regard to that. If SQL code is > broken, tests may fall back to JDO and pass. If JDO code is broken, SQL might > allow tests to pass. > We are going to disable SQL by default before the testing problem is resolved. > There are several possible solultions: > 1) Separate build for this setting. Seems like an overkill... > 2) Enable by default; disable by default in tests, create a clone of > TestCliDriver with a subset of queries that will exercise the SQL path. > 3) Have some sort of test hook inside metastore that will run both ORM and > SQL and compare. > 3') Or make a subclass of ObjectStore that will do that. ObjectStore is > already pluggable. > 4) Write unit tests for one of the modes (JDO, as non-default?) and declare > that they are sufficient; disable fallback in tests. > 3' seems like the easiest. For now we will disable SQL by default. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira