Noone has any idea ?It's really troublesome, it seems like i have no way to
catch errors while an action is beeing processed and just ignore it.Here's
a bit more details on what i'm doing:
JavaRDD a = sc.textFile("s3n://"+missingFilenamePattern) JavaRDD b =
sc.textFile("s3n://"+existingFilenamePattern) JavaRDD aPlusB =
a.union(b);aPlusB.reduceByLey(MyReducer); // <-- This throws the error
I'd like to ignore the exception caused by a to process b without
troubles.Thanks
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Ignoring-S3-0-files-exception-tp6101p6163.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
