[ 
https://issues.apache.org/jira/browse/HIVE-9756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15334447#comment-15334447
 ] 

Prasanth Jayachandran commented on HIVE-9756:
---------------------------------------------

The threadpool threads issue is still there. In most cases, we pass a single 
threaded thread pool to tez for task execution. This is not a big problem with 
the current patch as any thread creation will inherit the MDC.. Still it does 
not cover all cases (you can run llap with the latest patch and see some log 
lines without NDC attempt id goes to default file). This happens with NDC as 
well. As long as tez does not spin threads on its own, I think we can fix the 
issue by providing a custom executor service to tez that sets up MDC properly. 
In HIVE-13258 we already pass custom executor service, I will extend that and 
will put up another patch.

> LLAP: use log4j 2 for llap (log to separate files, etc.)
> --------------------------------------------------------
>
>                 Key: HIVE-9756
>                 URL: https://issues.apache.org/jira/browse/HIVE-9756
>             Project: Hive
>          Issue Type: Sub-task
>    Affects Versions: 2.0.0
>            Reporter: Gunther Hagleitner
>            Assignee: Prasanth Jayachandran
>         Attachments: HIVE-9756.1.patch, HIVE-9756.2.patch, HIVE-9756.3.patch, 
> HIVE-9756.4.patch, HIVE-9756.4.patch
>
>
> For the INFO logging, we'll need to use the log4j-jcl 2.x upgrade-path to get 
> throughput friendly logging.
> http://logging.apache.org/log4j/2.0/manual/async.html#Performance



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to