+1 on Option (B) with flag to allow semantics in (A) for back compatibility.
Kexin
On Tue, Jun 3, 2014 at 1:18 PM, Nicholas Chammas wrote:
> On Mon, Jun 2, 2014 at 10:39 PM, Patrick Wendell
> wrote:
>
>> (B) Semantics in Spark 1.0 and earlier:
>
>
> Do you mean 1.0 and later?
>
> Option (B) w
Hi,
Spark 1.0 changes the default behaviour of RDD.saveAsTextFile to
throw org.apache.hadoop.mapred.FileAlreadyExistsException when file already
exists.
Is there a way I can allow Spark to overwrite the existing file?
Cheers,
Kexin
