[
https://issues.apache.org/jira/browse/HIVE-13517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15624357#comment-15624357
]
liyunzhang_intel commented on HIVE-13517:
-----------------------------------------
[~szehon]:
currently i view the driver and executor logs by url like
"http://xxx:18080/";(see the attached picture) and click the link to view the
detailed logs. The content of log is like
{noformat}
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/home/hadoop26/nm-local-dir/filecache/11/spark-assembly-1.6.2-SNAPSHOT-hadoop2.6.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/home/hadoop-2.6.0/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
16/10/31 23:16:58 INFO CoarseGrainedExecutorBackend: Registered signal handlers
for [TERM, HUP, INT]
16/10/31 23:16:59 WARN NativeCodeLoader: Unable to load native-hadoop library
for your platform... using builtin-java classes where applicable
16/10/31 23:16:59 INFO SecurityManager: Changing view acls to: root
16/10/31 23:16:59 INFO SecurityManager: Changing modify acls to: root
16/10/31 23:16:59 INFO SecurityManager: SecurityManager: authentication
disabled; ui acls disabled; users with view permissions: Set(root); users with
modify permissions: Set(root)
16/10/31 23:16:59 INFO SecurityManager: Changing view acls to: root
16/10/31 23:16:59 INFO SecurityManager: Changing modify acls to: root
{noformat}
So what you want is 16/10/31 23:16:59 *Thread-Name* INFO SecurityManager:
Changing modify acls to: root? is my understanding right?
> Hive logs in Spark Executor and Driver should show thread-id.
> -------------------------------------------------------------
>
> Key: HIVE-13517
> URL: https://issues.apache.org/jira/browse/HIVE-13517
> Project: Hive
> Issue Type: Bug
> Components: Spark
> Affects Versions: 1.2.1, 2.0.0
> Reporter: Szehon Ho
> Assignee: liyunzhang_intel
>
> In Spark, there might be more than one task running in one executor.
> Similarly, there may be more than one thread running in Driver.
> This makes debugging through the logs a nightmare. It would be great if there
> could be thread-ids in the logs.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
