Hi,I need to write a data set to a single file without setting the parallelism to 1.
How can I achieve this?
Cheers, MihailP.S.: it's for persisting intermediate results in loops and reading those in the next iteration.
Which btw work for higher iteration counts with explicit persistence.