Hello
I am using spark-2.0.1 and saw that CSV fileformat stores output with
JOBUUID in it.
https://github.com/apache/spark/blob/v2.0.1/sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/CSVRelation.scala#L191
I want to avoid csv writing JOBUUID in it. Is there any property (may be
spark.sql.sources.writeJobUUID) that can skip this JOBUUID in output part
filenames?
Furthermore, I couldn't find how this JOBUUID is used in spark-2.1.0
version. We are planning to upgrade very soon so wanted to know how 2.1.0
version handles it in code.
Any help or pointers is very much appreciated!
Thanks
Swapnil