[ 
https://issues.apache.org/jira/browse/HIVE-15815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853390#comment-15853390
 ] 

Xiaobin Zheng commented on HIVE-15815:
--------------------------------------

[~ctang.ma] Is it necessary to have 'hadoop' as part of the prefix? Oozie is 
going to pass 'spark.oozie.xxx' to Spark in case Oozie directly launches Spark 
application. It would be great to be consistent here that Hive passes 
properties with same prefix.

> Allow to pass some Oozie properties to Spark in HoS
> ---------------------------------------------------
>
>                 Key: HIVE-15815
>                 URL: https://issues.apache.org/jira/browse/HIVE-15815
>             Project: Hive
>          Issue Type: Improvement
>          Components: Diagnosability, Spark
>            Reporter: Chaoyu Tang
>            Assignee: Chaoyu Tang
>            Priority: Minor
>         Attachments: HIVE-15815.patch
>
>
> Oozie passes some of its properties (e.g. oozie.job.id) to Beeline/HS2 when 
> it invokes Hive2 action. If we allow these properties to be passed to Spark 
> in HoS, we can easily associate an Ooize workflow ID to an HoS client and 
> Spark job in Spark history. It will be very helpful in diagnosing some issues 
> involving Oozie Hive2/HoS/Spark.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Reply via email to