Hi all: I’ve tried to execute something as below: result.map(transform).saveAsTextFile(hdfsAddress)
Result is a RDD caluculated from mlilib algorithm. I submit this to yarn, and after two attempts , the application failed. But the exception in log is very missleading. It said hdfsAddress already exits. Actually, the first attempt log showed that the exception is from the calculation of result. Though the attempt failed it created the file. And then attempt 2 began with exception ‘file already exists’. Why was RDD calculation before already failed but also the file created? That’s not so good I think.
