Re: how is data partitoned and distributed for connected stream

2017-08-22 Thread Till Rohrmann
Hi, if all operators have the same parallelism, then there will be a pointwise connection. This means all elements arriving at s1_x and s2_x will be forwarded to s3_x with _x denoting the parallel subtask. Thus, to answer your second question, the single s1 element will only be present at one subt

how is data partitoned and distributed for connected stream

2017-08-21 Thread xie wei
Hello Flinkļ¼Œ assume there are two finite streams, stream1(s1)has only one event, stream2(s2)have 100 events, the parallelism is 2. Then doing stream1.connect(stream2).map(). How is the data partitioned and distributed to the CoMap instances? Is the event from s1 only available in one of the CoMap