Hi all
I am trying to read:
sc.textFile(DataFile).mapPartitions(lines => {
val parser = new CSVParser(",")
lines.map(line=>parseLineToTuple(line, parser))
})
Data looks like:
android
phone,0,0,0,,0,0,0,0,0,0,0,5,0,0,0,5,0,0.00000,0.00000,0.00000,0.00000,0.00000,0,0,0,0,0,0,0,0.00000,0,0,0
ios
phone,0,-1,0,,0,0,0,0,0,0,1,0,0,0,0,1,0,0.00000,0.00000,0.00000,0.00000,0.00000,0,0,0,0,0,0,0,0.00000,0,0,0
org.apache.spark.SparkException: Job aborted due to stage failure: Task 1 in
stage 23055.0 failed 4 times, most recent failure: Lost task 1.3 in stage
23055.0 (TID 191607, ):
java.lang.NumberFormatException: For input string: "0.00000"
Has anyone faced such issues. Is there a solution?
Thanks,
Mohamed