Re: Flink programm with for loop yields wrong results when run in parallel

2016-07-04 Thread Flavio Pompermaier
I also have a lot of use case where caching a dataset would be definitely useful...maybe using Auxillio (the new name of Tachyon) and write intermediate results to an in-memory fs could be an better than re-read over and over tge input source for the moment...What do you think? On 4 Jul 2016 12:25

Re: Flink programm with for loop yields wrong results when run in parallel

2016-07-04 Thread Ufuk Celebi
Nested iterations are not supported via a "native iteration" operator. There is no way to avoid the for loop at the moment. I think it's not possible to tell why the results are wrong from the code snippet. How do you propagate the counts back? In general I expect this program to perform very badl