Re: Split a dataset

2017-10-17 Thread Magnus Vojbacke
hirdSplit = setToSplit.filter(new SplitCondition3()); > > where SplitCondition1, SplitCondition2, and SplitCondition3 are > FilterFunction that filter out all records that don't belong to the split. > > Best, Fabian > > 2017-10-17 10:42 GMT+02:00 Magnus Vojb

Split a dataset

2017-10-17 Thread Magnus Vojbacke
I'm looking for something like DataStream.split(), but for DataSets. I'd like to split my streaming data so messages go to different parts of an execution graph, based on arbitrary logic. DataStream.split() seems to be perfect, except that my source is a CSV file, and I have only found built in