Re: Does Flink support long term storage and complex queries

2017-08-01 Thread Fabian Hueske
Hi Basanth, Flink is not a storage system (neither for stream nor for batch data). Flink applications can be stateful and maintain very large state (in the order of several TBs) but state is always associated with an application. State can be queryable, so outside applications can run key-lookup (

Does Flink support long term storage and complex queries

2017-07-31 Thread Basanth Gowda
We are looking at Druid for long term storage and roll up metrics and adhoc queries on time series data. If Flink can support dynamic queries and rollups like Druid does, we would like to just use Flink and leave Druid aside. Does Flink support such kind of queries and what are the guidelines for