I'm looking for something like DataStream.split(), but for DataSets. I'd like 
to split my streaming data so messages go to different parts of an execution 
graph, based on arbitrary logic.

DataStream.split() seems to be perfect, except that my source is a CSV file, 
and I have only found built in functions for reading CSV files into a DataSet.

I've evaluated using DataSet.filter(), but as far as I can tell, that only 
allows me to emulate a yes/no split. This is not ideal because it's too coarse, 
and I would prefer a more fine grained split than that.


Do you have any suggestions on how I can achieve my arbitrary splitting logic 
for a) DataSets in general, or b) CSV files?

Reply via email to