[ https://issues.apache.org/jira/browse/HIVE-2686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Phabricator updated HIVE-2686: ------------------------------ Attachment: HIVE-2686.D1215.3.patch navis updated the revision "HIVE-2686 [jira] Test ppr_pushdown.q is failing on trunk". Reviewers: JIRA Changing topOps to LinkedHashMap made predictable execution plans, but MapRed task executed with multiple map still induces non-predictable result, which cannot be corrected. I think I'm done. For ppr_pushdown, I prefer using explode instead of union, which is more faster. But it's not an important issue. Included a fix for trivial-but-critical bug, which registers task with parent to root task. Also made best effort to find common union operator which could reduce map task in CombinHiveInputFormat. REVISION DETAIL https://reviews.facebook.net/D1215 AFFECTED FILES hbase-handler/src/test/results/hbase_queries.q.out ql/src/java/org/apache/hadoop/hive/ql/io/HiveFileFormatUtils.java ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMRTableScan1.java ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMRUnion1.java ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMapRedUtils.java ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java ql/src/test/queries/clientpositive/ppr_pushdown.q ql/src/test/queries/clientpositive/union_order.q ql/src/test/results/clientpositive/auto_join27.q.out ql/src/test/results/clientpositive/auto_join30.q.out ql/src/test/results/clientpositive/auto_join31.q.out ql/src/test/results/clientpositive/join19.q.out ql/src/test/results/clientpositive/join28.q.out ql/src/test/results/clientpositive/lineage1.q.out ql/src/test/results/clientpositive/load_dyn_part14.q.out ql/src/test/results/clientpositive/ppd_repeated_alias.q.out ql/src/test/results/clientpositive/ppd_union_view.q.out ql/src/test/results/clientpositive/ppr_pushdown.q.out ql/src/test/results/clientpositive/ql_rewrite_gbtoidx.q.out ql/src/test/results/clientpositive/union20.q.out ql/src/test/results/clientpositive/union22.q.out ql/src/test/results/clientpositive/union24.q.out ql/src/test/results/clientpositive/union25.q.out ql/src/test/results/clientpositive/union26.q.out ql/src/test/results/clientpositive/union3.q.out ql/src/test/results/clientpositive/union_order.q.out ql/src/test/results/compiler/plan/join4.q.xml ql/src/test/results/compiler/plan/join5.q.xml ql/src/test/results/compiler/plan/join6.q.xml ql/src/test/results/compiler/plan/join7.q.xml ql/src/test/results/compiler/plan/join8.q.xml > Test ppr_pushdown.q is failing on trunk > --------------------------------------- > > Key: HIVE-2686 > URL: https://issues.apache.org/jira/browse/HIVE-2686 > Project: Hive > Issue Type: Test > Components: Testing Infrastructure > Affects Versions: 0.9.0 > Reporter: Ashutosh Chauhan > Assignee: Navis > Priority: Minor > Fix For: 0.9.0 > > Attachments: HIVE-2686.D1215.1.patch, HIVE-2686.D1215.2.patch, > HIVE-2686.D1215.3.patch > > > {noformat} > $ ant test -Dtestcase=TestCliDriver -Dqfile=ppr_pushdown.q > [junit] See build/ql/tmp/hive.log, or try "ant test ... > -Dtest.silent=false" to get more logs. > [junit] at junit.framework.Assert.fail(Assert.java:50) > [junit] at > org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_ppr_pushdown(TestCliDriver.java:129) > [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > [junit] at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > [junit] at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > [junit] at java.lang.reflect.Method.invoke(Method.java:597) > [junit] at junit.framework.TestCase.runTest(TestCase.java:168) > [junit] at junit.framework.TestCase.runBare(TestCase.java:134) > [junit] at junit.framework.TestResult$1.protect(TestResult.java:110) > [junit] at junit.framework.TestResult.runProtected(TestResult.java:128) > [junit] at junit.framework.TestResult.run(TestResult.java:113) > [junit] at junit.framework.TestCase.run(TestCase.java:124) > [junit] at junit.framework.TestSuite.runTest(TestSuite.java:243) > [junit] at junit.framework.TestSuite.run(TestSuite.java:238) > [junit] at > org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:518) > [junit] at > org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1052) > [junit] at > org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:906) > [junit] 178d177 > [junit] < 1234 1234 > [junit] 179a179 > [junit] > 1234 1234 > [junit] 196d195 > [junit] < 1224 1224 > [junit] 197a197 > [junit] > 1224 1224 > [junit] 214d213 > [junit] Exception: Client execution results failed with error code = 1 > [junit] See build/ql/tmp/hive.log, or try "ant test ... > -Dtest.silent=false" to get more logs. > [junit] < 1214 1214 > [junit] 215a215 > [junit] > 1214 1214 > [junit] 232d231 > [junit] < 12.4 12.4 > [junit] 233a233 > [junit] > 12.4 12.4 > [junit] 250d249 > [junit] < 12+4 12+4 > [junit] 251a251 > [junit] > 12+4 12+4 > [junit] 268d267 > [junit] < 12:4 12:4 > [junit] 269a269 > [junit] > 12:4 12:4 > [junit] 286d285 > [junit] < 12%4 12%4 > [junit] 287a287 > [junit] > 12%4 12%4 > [junit] 304d303 > [junit] < 12*4 12*4 > [junit] 305a305 > [junit] > 12*4 12*4 > [junit] Cleaning up TestCliDriver > [junit] Tests run: 2, Failures: 1, Errors: 0, Time elapsed: 137.556 sec > [junit] Test org.apache.hadoop.hive.cli.TestCliDriver FAILED > {noformat} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira