Rdd.coalesce(1) will coalesce RDD and give only one output file. coalesce(2) will give 2 wise versa. On Jan 23, 2015 4:58 AM, "Sean Owen" <[email protected]> wrote:
> One output file is produced per partition. If you want fewer, use > coalesce() before saving the RDD. > > On Thu, Jan 22, 2015 at 10:46 PM, Kane Kim <[email protected]> wrote: > > How I can reduce number of output files? Is there a parameter to > saveAsTextFile? > > > > Thanks. > > > > --------------------------------------------------------------------- > > To unsubscribe, e-mail: [email protected] > > For additional commands, e-mail: [email protected] > > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] > >
