Does dataframe spark API write/create a single file instead of directory as a result of write operation.

[Kshitij]

Hi,

There is no dataframe spark API which writes/creates a single file instead
of directory as a result of write operation.

Below both options will create directory with a random file name.

df.coalesce(1).write.csv(<path>)



df.write.csv(<path>)


Instead of creating directory with standard files (_SUCCESS , _committed ,
_started). I want a single file with file_name specified.


Thanks