Re: Datastream splitter - Confusing behaviour

2017-01-03 Thread madhairsilence
Spot on. Thanks for the explanation and pointing out the bug in the code -- View this message in context: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/Datastream-splitter-Confusing-behaviour-tp15138p15145.html Sent from the Apache Flink Mailing List archive. mailing list

Re: Datastream splitter - Confusing behaviour

2017-01-03 Thread Jark Wu
Hi madhairsilence, 1. The default parallelism of a job is set to the number of cpu cores on your machine, generally is 4. That means all operators’ (except source operator) parallelism is 4. That’s why you get always get 4 files, because there are 4 csv sink tasks. You can change the paral

Datastream splitter - Confusing behaviour

2017-01-03 Thread madhairsilence
e the count in "fromElements", I get 4 files. Why does it create 4 files always 2. The code should split the stream in to odd and even and right now am printing only the "Even" stream. So 3 should not be printed I could not make out anything from this. Some help would be nice