Write each group to its own file

2017-10-11 Thread rlazoti
Hi, Is there a way to write each group to its own file using the Dataset api (Batch)? For example, lets use the following class: case class Product(name: String, category: String) And the following Dataset: val products = env.fromElements(Product("i7", "cpu"), Product("R5", "cpu"), Product("gt

Write each group to its own file

2017-10-11 Thread rlazoti
Hi, Is there a way to write each group to its own file using the Dataset api (Batch)? For example, lets use the following class: And the following Dataset: So in this example my output should be these 3 files: - cpu.csv i7, cpu R5, cpu - gpu.csv gtx1080, gpu vega64, gpu - ssd.csv evo250gb