Hi,
When I am doing the using theFileUtil.copymerge function
val file = "/tmp/primaryTypes.csv"
FileUtil.fullyDelete(new File(file))
val destinationFile= "/tmp/singlePrimaryTypes.csv"
FileUtil.fullyDelete(new File(destinationFile))
val counts = partitions.
reduceByKey {case (x,y) => x + y}.
sortBy {case (key, value) => -value}.
map { case (key, value) => Array(key, value).mkString(",") }
counts.saveAsTextFile(file)
merge(file, destinationFile)
I am wondering here what does FileUtil.fullyDelete(new
File(destinationFile)) do ?
does it delete the merged file ....If yes,then how will we access
the merged file ..?
Confused here ...
Thanks,
Divya