Re: connect data stream with parameter stream

2017-07-08 Thread Lei Chen
Hi Aljoscha, Thanks a lot for your help! Yes solution 2 did point me the right direction. Ended up connect them before window function so I can filter out uninterested element earlier. thanks, Lei On Tue, Jul 4, 2017 at 9:33 AM, Aljoscha Krettek wrote: > Hi Lei, > > I’m afraid there is current

Re: connect data stream with parameter stream

2017-07-04 Thread Aljoscha Krettek
Hi Lei, I’m afraid there is currently no API for doing this in one operation. I see two options right now: 1. Built a custom operator that implements windowing and also has a second input for the parameter stream. This would be a subclass of TwoInputStreamOperator. As an example, you can look

connect data stream with parameter stream

2017-06-30 Thread Lei Chen
Hi, In my scenario I have 2 streams. DS1 is main data stream reading logs from kafka, and DS2 is a parameter stream which is used to maintain a state about all processing parameters (including filters) need to be applied at runtime by DS1. The processing parameters can be changed anytime during th