Pale Rider 9/18 13:53:54 I'm getting an error in the Linkis Hive on Spark mode. Has anyone encountered this before?
Mo Xi Zhi Mo 9/18 14:27:06 How are you submitting the task? Pale Rider 9/18 14:47:50 [image] Pale Rider 9/18 14:52:16 Executing SQL in Linkis Scripts. Pale Rider 9/18 14:52:27 The CDH Hive is configured with Hive on Spark. Mo Xi Zhi Mo 9/18 14:54:42 Can you first try executing it directly on the machine to verify if it works? Pale Rider 9/19 15:12:53 Does anyone know if Hive on Spark is supported by default? Pale Rider 9/19 15:12:53 [image] Pale Rider 9/19 15:13:13 Currently, Hive on MR works for me, but Hive on Spark doesn't. Yuan Zi Dong Li 9/19 15:14:53 The version is insufficient. Pale Rider 9/19 15:15:37 Hive comes with CDH 5.16.1. Pale Rider 9/19 15:15:43 The default Spark version is 1.6. Pale Rider 9/19 15:26:54 2025-09-19 14:24:56.404 ERROR [TaskExecution-Thread-11] org.apache.hadoop.hive.ql.Driver 1110 printError [JobId-223] - FAILED: Execution Error, return code 3 from org.apache.hadoop.hive.ql.exec.spark.SparkTask. Spark job failed during runtime. Please check stacktrace for the root cause. 2025-09-19 14:24:56.411 ERROR [TaskExecution-Thread-11] org.apache.linkis.engineplugin.hive.executor.HiveEngineConnExecutor 277 orga pachelinkisenginepluginhiveexecutorHiveEngineConnExecutor$$executeHQL [JobId-223] - Hive query failed, response code is 3 2025-09-19 14:24:56.478 ERROR [TaskExecution-Thread-11] org.apache.linkis.engineplugin.hive.executor.HiveEngineConnExecutor 282 apply [JobId-223] - execute code failed! org.apache.hadoop.hive.ql.metadata.HiveException: Spark job failed during runtime. Please check stacktrace for the root cause. Caused by: java.lang.NullPointerException Pale Rider 9/19 16:24:31 https://github.com/apache/linkis/issues/4535 Pale Rider 9/19 16:24:43 This issue is similar to mine, but no one has responded to it. Mo Xi Zhi Mo 9/19 16:47:21 >From the error message above, it's clear that the task execution failed. Pale Rider 9/19 16:48:04 Yeah. Mo Xi Zhi Mo 9/19 16:48:27 For Linkis to execute successfully, the client on your machine must also support it first. Log in to your machine and try executing directly with Hive to see if it works. Pale Rider 9/19 16:49:25 It works with MR, but not with Spark. Mo Xi Zhi Mo 9/19 16:51:27 Then this version probably doesn't support it. Mo Xi Zhi Mo 9/19 16:52:35 Check the versions supported by Hive on Spark and see if they are compatible with your current version. Pale Rider 9/19 16:52:36 I'm using Linkis 1.7. Mo Xi Zhi Mo 9/19 16:54:03 Not the Linkis version, but the underlying engine version. Pale Rider 9/19 16:54:53 Does the underlying engine Spark 1.6 not support Linkis 1.7? Mo Xi Zhi Mo 9/19 16:58:07 If you're sure the underlying engine supports it, then check if Linkis supports it. Mo Xi Zhi Mo 9/19 16:58:09 https://linkis.apache.org/zh-CN/download/main Mo Xi Zhi Mo 9/19 16:58:26 Here are the features of each Linkis version.
