Re: CoGgroup Operator Data Sink

2015-04-14 Thread Kostas Tzoumas
Each operator has only one output (which can be consumed by multiple downstream operators), so you cannot branch out to two different directions from inside the user code with many collectors. The reasoning is that you can have the same effect with what Robert suggested. But perhaps your use case

Re: CoGgroup Operator Data Sink

2015-04-14 Thread Mustafa Elbehery
Thanks for prompt reply. Maybe the expression "Sink" is not suitable to what I need. What if I want to *Collect* two data sets directly from the coGroup operator. Is there anyway to do so ?!! As I might know, the operator has only Collector Object, but I wonder if there is another feature in Flin

Re: CoGgroup Operator Data Sink

2015-04-14 Thread Robert Metzger
Hi, you can write the output of a coGroup operator to two sinks: --\ />Sink1 \ / (CoGroup) /\ --/ \-->Sink2 You can actually write to as many sinks as you want. Note that the data written to Sink1 and Sink2 will be identica

CoGgroup Operator Data Sink

2015-04-14 Thread Mustafa Elbehery
Hi all, I wonder if the coGroup operator have the ability to sink two output simultaneously. I am trying to mock it by calling a function inside the operator, in which I sink the first output, and get the second output myself. I am not sure if this is the best way, and I would like to hear your s