Re: Side Inputs vs. Connected Streams

2016-10-06 Thread Maximilian Michels
> Will the above ensure that dsSide is always available before ds3 elements > arrive on the connected stream. Am I correct in assuming that ds2 changes > will continue to be broadcast to ds3 (with no ordering guarantees between ds3 > and dsSide, ofcourse). Broadcasting is just a partition strat

Re: Side Inputs vs. Connected Streams

2016-10-04 Thread Till Rohrmann
Hi Sameer, the semantics of side inputs are not fully fledged out yet, as far as I know. The design doc says that one first waits for some data on the side input before starting processing the main input. Therefore, I would assume that you have some temporal ordering of the side input and main in

Side Inputs vs. Connected Streams

2016-10-03 Thread Sameer W
Hi, I read the Side Inputs design document. How does it compare to using ConnectedStreams with respect to handling the ordering of streams transparently? One of the challenges I have with ConnectedStreams is I