Is there any effort in this direction? maybe I could achieve something like that using Tachyon in some way...?
On Mon, Nov 30, 2015 at 4:52 PM, Fabian Hueske <fhue...@gmail.com> wrote: > Hi Flavio, > > Flink does not support caching of data sets in memory yet. > > Best, Fabian > > 2015-11-30 16:45 GMT+01:00 Flavio Pompermaier <pomperma...@okkam.it>: > >> Hi to all, >> I was wondering if Flink could fit a use case where a user load a dataset >> in memory and then he/she wants to explore it interactively. Let's say I >> want to load a csv, then filter out the rows where the column value match >> some criteria, then apply another criteria after seeing the results of the >> first filter. >> Is there a way to keep the dataset in memory and modify it interactively >> without re-reading all the dataset every time I want to chain another >> operation to my dataset? >> >> Best, >> Flavio >> > >
