RE: Avoid creation of _SUCCESS folder in reducer output folder

2012-10-05 Thread Balaraman, Anand
Sent: 05 October 2012 12:04 To: user@hive.apache.org Cc: hive-u...@hadoop.apache.org; u...@hadoop.apache.org Subject: Re: Avoid creation of _SUCCESS folder in reducer output folder mapreduce.fileoutputcommitter.marksuccessfuljobs=false; MAPREDUCE-947, i guess.. ~Aniket On Thu, Oct 4, 201

Re: Avoid creation of _SUCCESS folder in reducer output folder

2012-10-04 Thread Aniket Mokashi
mapreduce.fileoutputcommitter.marksuccessfuljobs=false; MAPREDUCE-947, i guess.. ~Aniket On Thu, Oct 4, 2012 at 11:06 PM, Balaraman, Anand < anand_balara...@syntelinc.com> wrote: > Hi > > ** ** > > While using Map reduce programs, the output folder where reducer writes > out the result cont

Avoid creation of _SUCCESS folder in reducer output folder

2012-10-04 Thread Balaraman, Anand
Hi While using Map reduce programs, the output folder where reducer writes out the result contains 2 auto-generated folders: _SUCCESS and _logs. To avoid generation of _log folder, I can set the configuration parameter "hadoop.job.history.user.location" with value as "none". But, I don't know