Re: \r\n in csv output

2020-03-23 Thread Steven Parkes
Hrm ... looks like we were setting this in the past although it looks like it was being ignored ... On Mon, Mar 23, 2020 at 12:53 PM Steven Parkes wrote: > SPARK-26108 <https://issues.apache.org/jira/browse/SPARK-26108> / PR#23080 > <https://github.com/apache/spark/pull/23080&g

\r\n in csv output

2020-03-23 Thread Steven Parkes
SPARK-26108 / PR#23080 added a require on CSVOptions#lineSeparator to be a single character. AFAICT, this keeps us from writing CSV files with \r\n line terminators. Wondering if this was intended or