Re: Elegantly sharing state in a streaming environment

2016-05-31 Thread Ufuk Celebi
Aljoscha is working to properly expose this in Flink. The design document is here: https://docs.google.com/document/d/1hIgxi2Zchww_5fWUHLoYiXwSBXjv-M5eOv-MKQYN3m4/edit#heading=h.pqg5z6g0mjm7 On Mon, May 30, 2016 at 2:31 PM, Philippe CAPARROY wrote: > > Just transform the list in a DataStream. A d

Re: re: Elegantly sharing state in a streaming environment

2016-05-30 Thread leon_mclare
Dear Philippe, that is exactly what i need. Thank you for the concise explanation. This approach is excellent, as it also permits the values to be easily updated externally. Kind regards Leon 30. May 2016 14:31 by philippe.capar...@orange.fr: > > > Just transform the list in a DataStream. A

re: Elegantly sharing state in a streaming environment

2016-05-30 Thread Philippe CAPARROY
Just transform the list in a DataStream. A datastream can be finite. One solution, in the context of a Streaming environment is to use Kafka, or any other distributed broker, although Flink ships with a KafkaSource.   1)Create a Kafka Topic dedicated to your list of key/values. Inject your va