Re: Calculating metrics real time

2017-10-05 Thread Fabian Hueske
That depends on the state backend [1] that you are using. If you use the RocksDBStateBackend, state is written to RocksDB which persists to disk. [1] https://ci.apache.org/projects/flink/flink-docs-release-1.3/ops/state_backends.html 2017-10-05 14:41 GMT+02:00 Rahul Raj : > Thanks for the respon

Re: Calculating metrics real time

2017-10-05 Thread Rahul Raj
Thanks for the response. So, i am guessing windows in flink will store the records in memory before processing them. Correct? Rahul Raj On Oct 5, 2017 17:50, "Fabian Hueske" wrote: > Hi, > > I'd suggest to have a look at the window operators [1]. For example a > tumbling window of 1 minute can

Re: Calculating metrics real time

2017-10-05 Thread Fabian Hueske
Hi, I'd suggest to have a look at the window operators [1]. For example a tumbling window of 1 minute can be used to compute metrics every minute. Flink's window operators are very extensible and you can implement very custom logic if the predefined windows don't match your use case. In any case,