[
https://issues.apache.org/jira/browse/HIVE-4513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13650245#comment-13650245
]
Thejas M Nair commented on HIVE-4513:
-------------------------------------
Having this on by default can cause problems if you have same machine and
config being used for large number of queries. For example, while doing some
stress tests on HiveServer2, the mount with /tmp became full because hive
history files (around 20k of them) took 2.5 GB.
> disable hivehistory logs by default
> -----------------------------------
>
> Key: HIVE-4513
> URL: https://issues.apache.org/jira/browse/HIVE-4513
> Project: Hive
> Issue Type: Bug
> Components: Configuration, Logging
> Reporter: Thejas M Nair
> Assignee: Thejas M Nair
>
> HiveHistory log files (hive_job_log_hive_*.txt files) store information about
> hive query such as query string, plan , counters and MR job progress
> information.
> There is no mechanism to delete these files and as a result they get
> accumulated over time, using up lot of disk space.
> I don't think this is used by most people, so I think it would better to turn
> this off by default. Jobtracker logs already capture most of this
> information, though it is not as structured as history logs.
> HIVE-4500 is introducing a new config parameter to turn this off, we should
> use that to turn this off by default.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
