Re: Iterative Stream won't loop

2018-05-11 Thread Rong Rong
Yeah that too. Agree with Paris here. especially you are not only doing a windowed aggregation but a join step. Using graph processing engine [1] might be the best idea here. Another possible way is to create a rich agg function over a combination of the tuple, this way you are complete in contr

Re: Iterative Stream won't loop

2018-05-11 Thread Paris Carbone
Hey! I would recommend against using iterations with windows for that problem at the moment. Alongside loop scoping and backpressure that will be addressed by FLIP-15 [1] I think you also need the notion of stream supersteps, which is experimental work in progress for now, from my side at least

Re: Iterative Stream won't loop

2018-05-11 Thread Henrique Colao Zanuz
Hi, thank you for your reply Actually, I'm doing something very similar to your code. The problem I'm having is that this structure is not generating any loop. For instance, If I print *labelsVerticesGroup*, I only see the initial set of tuples, the one from *updated**LabelsVerticesGroup* (at the

Re: Iterative Stream won't loop

2018-05-10 Thread Rong Rong
Based on the pseudo code. Seems like you are trying to do the loop by yourself and not suing the iterative.map() function[1]. I think you would need to specify the "map" function in order to use the iterative stream. and there should be a clear definition on which data is iterative. In this case y