Hi, I am seeing like one million of these files on our hadoop cluster.
1005717 files like /tmp/hdfs/hdfs_2012082902171088341605155583849.pipeout 1005742 files like /tmp/hdfs/hive_job_log_hdfs_201208290217_1000376604.txt My questions are: 1. What is a .pipeout file, and can they be deleted at any time? What might happen if a pipeout file is removed that shouldn't be removed? 2. Is it entirely up the admin to log rotate these? Why aren't they rotated by default when you install the packages? Thanks, Sam