Re: Elegantly sharing state in a streaming environment

2016-05-31 Thread Ufuk Celebi
t; Checkpointed. > > When receiving K,V pairs from output2, store them in a local state. > > When receiving tuple, should be able to to filter with the help of the local > state, and propagate downstream or not. > > > > > > > > > > > > > >

Re: re: Elegantly sharing state in a streaming environment

2016-05-30 Thread leon_mclare
>   > >   > >   > >   > >   > >   > >   > >   > >   > >> > Message du 30/05/16 13:41 >> > De : >> leon_mcl...@tutanota.com >> > A : "User" <>> user@flink.apache.org>> > >> > Copie à : >

re: Elegantly sharing state in a streaming environment

2016-05-30 Thread Philippe CAPARROY
e able to to filter with the help of the local state, and propagate downstream or not.                       > Message du 30/05/16 13:41 > De : leon_mcl...@tutanota.com > A : "User" > Copie à : > Objet : Elegantly sharing state in a streaming environment &

Elegantly sharing state in a streaming environment

2016-05-30 Thread leon_mclare
Hello Flink team, How can i partition and share static state among instances of a streaming operator? I have a huge list of keys and values, which are used to filter tuples in a stream. The list does not change. Currently i am sharing the list with each operator instance via the constructor, a