Re: connect data stream with parameter stream

2017-07-08 Thread Lei Chen
ame input and therefore have the same > state) you would only checkpoint the state of parallel operator instance 0. > When restoring, this would be distributed to all operators and they > therefore all have the same state again. > > Does that help? > > Best, > Aljoscha > >

connect data stream with parameter stream

2017-06-30 Thread Lei Chen
Hi, In my scenario I have 2 streams. DS1 is main data stream reading logs from kafka, and DS2 is a parameter stream which is used to maintain a state about all processing parameters (including filters) need to be applied at runtime by DS1. The processing parameters can be changed anytime during th