Thanks Martin Can you also mention steps you did to reclaim the hdfs data from temporary data ?
On Fri, Apr 24, 2015 at 12:21 PM, Martin Benson <martin.ben...@jaywing.com> wrote: > Hi All, > > I just wanted to feedback that it does appear to be safe - I emptied the > directory manually, without adverse consequences. > > Thanks, > > Martin. > ------------------------------ > From: Martin Benson <martin.ben...@jaywing.com> > Sent: 20/04/2015 18:06 > To: user@hive.apache.org > Subject: Clear up Hive scratch directory > > Hi, > > One of my users tried to run an HUGE join, which failed due to a lack of > space in HDFS. This has resulted in a large amount of data remaining in the > Hive scratch directory which I need to clear down. I've tried setting > hive.start.cleanup.scratchdir to true and restarting Hive, but it didn't > tidy it up. So, I'm wondering if it is safe to just delete the content of > the directory in HDFS (while Hive is stopped). Could anyone advise please? > > Many thanks, > > Martin. > > > Registered in England and Wales at Players House, 300 Attercliffe > Common, Sheffield, S9 2AG. Company number 05935923. > > This email and its attachments are confidential and are intended solely > for the use of the addressed recipient. > Any views or opinions expressed are those of the author and do not > necessarily represent Jaywing. If you are not > the intended recipient, you must not forward or show this to anyone or > take any action based upon it. > Please contact the sender if you received this in error. > > > Registered in England and Wales at Players House, 300 Attercliffe > Common, Sheffield, S9 2AG. Company number 05935923. > > This email and its attachments are confidential and are intended solely > for the use of the addressed recipient. > Any views or opinions expressed are those of the author and do not > necessarily represent Jaywing. If you are not > the intended recipient, you must not forward or show this to anyone or > take any action based upon it. > Please contact the sender if you received this in error. > -- Nitin Pawar
