[ 
https://issues.apache.org/jira/browse/HIVE-8991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14234082#comment-14234082
 ] 

Rui Li commented on HIVE-8991:
------------------------------

Not sure if it's because how we add hive-exec:
If added dynamically (as application jar), spark loads it with 
{{ExecutorURLClassLoader}} and set it as the thread's ContextClassLoader. Then 
we hit the NoClassDefFoundError.
If added to {{spark.driver.extraClassPath}}, then it's loaded with the system 
class loader and the error is gone.

> Fix custom_input_output_format [Spark Branch]
> ---------------------------------------------
>
>                 Key: HIVE-8991
>                 URL: https://issues.apache.org/jira/browse/HIVE-8991
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Spark
>            Reporter: Rui Li
>            Assignee: Rui Li
>         Attachments: HIVE-8991.1-spark.patch
>
>
> After HIVE-8836, {{custom_input_output_format}} fails because of missing 
> hive-it-util in remote driver's class path.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to