[ https://issues.apache.org/jira/browse/HIVE-7955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14202917#comment-14202917 ]
Thomas Friedrich commented on HIVE-7955: ---------------------------------------- The test udf_context_aware fails with a NPE here: Thread [main] (Suspended (exception NullPointerException)) DummyContextUDF.evaluate(GenericUDF$DeferredObject[]) line: 42 ExprNodeGenericFuncEvaluator._evaluate(Object, int) line: 169 ExprNodeGenericFuncEvaluator(ExprNodeEvaluator<T>).evaluate(Object, int) line: 77 ExprNodeGenericFuncEvaluator(ExprNodeEvaluator<T>).evaluate(Object) line: 65 SelectOperator.processOp(Object, int) line: 77 TableScanOperator(Operator<T>).forward(Object, ObjectInspector) line: 815 TableScanOperator.processOp(Object, int) line: 95 FetchOperator.pushRow(InspectableObject) line: 577 FetchOperator.pushRow() line: 569 FetchTask.fetch(List) line: 138 Driver.getResults(List) line: 1661 CliDriver.processLocalCmd(String, CommandProcessor, CliSessionState) line: 267 CliDriver.processCmd(String) line: 199 CliDriver.processLine(String, boolean) line: 410 CliDriver.processLine(String) line: 345 QTestUtil.executeClient(String) line: 832 TestSparkCliDriver.runTest(String, String, String) line: 136 TestSparkCliDriver.testCliDriver_udf_context_aware() line: 120 NativeMethodAccessorImpl.invoke0(Method, Object, Object[]) line: not available [native method] NativeMethodAccessorImpl.invoke(Object, Object[]) line: 57 DelegatingMethodAccessorImpl.invoke(Object, Object[]) line: 43 Method.invoke(Object, Object...) line: 606 TestSparkCliDriver(TestCase).runTest() line: 176 TestSparkCliDriver(TestCase).runBare() line: 141 TestResult$1.protect() line: 122 TestResult.runProtected(Test, Protectable) line: 142 TestResult.run(TestCase) line: 125 TestSparkCliDriver(TestCase).run(TestResult) line: 129 TestSuite.runTest(Test, TestResult) line: 255 TestSuite.run(TestResult) line: 250 SuiteMethod(JUnit38ClassRunner).run(RunNotifier) line: 84 JUnit4Provider.execute(Class<?>, RunNotifier, String[]) line: 264 JUnit4Provider.executeTestSet(Class<?>, RunListener, RunNotifier) line: 153 JUnit4Provider.invoke(Object) line: 124 ForkedBooter.invokeProviderInSameClassLoader(Object, Object, ProviderConfiguration, boolean, StartupConfiguration, boolean) line: 200 ForkedBooter.runSuitesInProcess(Object, StartupConfiguration, ProviderConfiguration, PrintStream) line: 153 ForkedBooter.main(String[]) line: 103 The reason is the MapredContext object is null: Reporter reporter = context.getReporter(); Created JIRA HIVE-8789 to track failure. > Investigate query failures (4) > ------------------------------ > > Key: HIVE-7955 > URL: https://issues.apache.org/jira/browse/HIVE-7955 > Project: Hive > Issue Type: Sub-task > Components: Spark > Reporter: Brock Noland > Assignee: Thomas Friedrich > > I ran all q-file tests and the following failed with an exception: > http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-SPARK-ALL-TESTS-Build/lastCompletedBuild/testReport/ > we don't necessary want to run all these tests as part of the spark tests, > but we should understand why they failed with an exception. This JIRA is to > look into these failures and document them with one of: > * New JIRA > * Covered under existing JIRA > * More investigation required > Tests: > {noformat} > > org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_dynpart_sort_optimization > 12 sec 2 > org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_schemeAuthority2 > 0.23 sec 2 > org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_load_dyn_part8 > 10 sec 2 > > org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_auto_sortmerge_join_4 > 11 sec 2 > org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_orc_analyze > 8 sec 2 > org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_tez_join_hash > 0.98 sec 2 > org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_hook_context_cs > 2.1 sec 2 > > org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_insert_overwrite_local_directory_1 > 3.7 sec 2 > > org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_archive_excludeHadoop20 > 27 sec 2 > > org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_auto_sortmerge_join_9 > 8.2 sec 2 > > org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_limit_partition_metadataonly > 0.77 sec 2 > > org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_bucket_num_reducers2 > 7 sec 2 > org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_groupby_bigdata > 0.6 sec 2 > > org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_bucketsortoptimize_insert_6 > 6.6 sec 2 > org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_smb_mapjoin_25 > 2.6 sec 2 > org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_dbtxnmgr_query3 > 0.48 sec 2 > > org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_auto_sortmerge_join_16 > 8.5 sec 2 > > org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_empty_dir_in_table > 2.6 sec 2 > org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_input33 1.3 sec > 2 > > org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_authorization_admin_almighty1 > 2.8 sec 2 > > org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_udf_context_aware > 0.23 sec 2 > > org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_authorization_view_sqlstd > 4.1 sec 2 > org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_smb_mapjoin_12 > {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)