[
https://issues.apache.org/jira/browse/HIVE-17112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sahil Takiar updated HIVE-17112:
--------------------------------
Description:
HiveSparkClientFactory has the following line that introduces excess logging:
{code}
LOG.info(String.format(
"load spark property from %s (%s -> %s).",
SPARK_DEFAULT_CONF_FILE, propertyName,
LogUtils.maskIfPassword(propertyName,value)));
{code}
It basically dumps the entire configuration object to the logs, we can probably
change this from INFO to DEBUG.
Same thing happens in {{RemoteHiveSparkClient#logConfigurations}}
was:
HiveSparkClientFactory has the following line that introduces excess logging:
{code}
LOG.info(String.format(
"load spark property from %s (%s -> %s).",
SPARK_DEFAULT_CONF_FILE, propertyName,
LogUtils.maskIfPassword(propertyName,value)));
{code}
It basically dumps the entire configuration object to the logs, we can probably
change this from INFO to DEBUG.
> Reduce logging in HiveSparkClientFactory and RemoteHiveSparkClient
> ------------------------------------------------------------------
>
> Key: HIVE-17112
> URL: https://issues.apache.org/jira/browse/HIVE-17112
> Project: Hive
> Issue Type: Bug
> Components: Spark
> Reporter: Sahil Takiar
> Assignee: Sahil Takiar
>
> HiveSparkClientFactory has the following line that introduces excess logging:
> {code}
> LOG.info(String.format(
> "load spark property from %s (%s -> %s).",
> SPARK_DEFAULT_CONF_FILE, propertyName,
> LogUtils.maskIfPassword(propertyName,value)));
> {code}
> It basically dumps the entire configuration object to the logs, we can
> probably change this from INFO to DEBUG.
> Same thing happens in {{RemoteHiveSparkClient#logConfigurations}}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
