Re: Mixing Batch & Streaming

2016-03-04 Thread Jeyhun Karimov
Sabri. > > > > -- > View this message in context: > http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Mixing-Batch-Streaming-tp4530p5300.html > Sent from the Apache Flink User Mailing List archive. mailing list archive > at Nabble.com. >

Re: Mixing Batch & Streaming

2016-03-04 Thread sskhiri
://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Mixing-Batch-Streaming-tp4530p5300.html Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

Re: Mixing Batch & Streaming

2016-01-28 Thread Nick Dimiduk
If the dataset is too large for a file, you can put it behind a service and have your stream operators query the service for enrichment. You can even support updates to that dataset in a style very similar to the "lambda architecture" discussed elsewhere. On Thursday, January 28, 2016, Fabian Hues

Re: Mixing Batch & Streaming

2016-01-28 Thread Fabian Hueske
Hi, this is currently not support yet. However, this feature is on our roadmap and has been requested for a few times. So I hope somebody will pick it up soon. If the static data set is small enough, you can read the full data set (e.g., as a file) in the open method of FlatMapFunction, build a h

Mixing Batch & Streaming

2016-01-27 Thread Don Frascuchon
Hi everyone, There is any way of mixing dataStreams and dataSets ? For example, enrich messages from a dataStream with a precalculated info in a dataSet. Thanks in advance!