Writing file

2018-07-31 Thread mattbuttow
According to Stack Overflow (https://stackoverflow.com/q/40786093) it should be possible to write file to a local path and the result should be available on the driver node. However when I try this: df.write.parquet("file:///some/path") the data seems to be written on each node, not a drive

Re: Writing file

2018-08-01 Thread mattbuttow
Thank you cloud0fan. That's really helpful. -- Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/ - To unsubscribe e-mail: dev-unsubscr...@spark.apache.org