Re: Flink Statefun and Feature computation

2022-03-11 Thread Igal Shilman
Hello Federico, Yes you are correct, the type of the storage engine is indeed configured via the flink-yaml.conf, the state engines you have mentioned are the ones that are actively mantinted and configured by the community for a long time. I'm not sure however what are the requirements for imple

Re: Flink Statefun and Feature computation

2022-03-10 Thread Federico D'Ambrosio
Hi Igal, thank you so much for your response. As for [2], I was mainly interested in how the state is stored physically. Looking at the deployment files, I see the following file https://github.com/apache/flink-statefun-playground/blob/main/deployments/k8s/04-statefun/01-statefun-runtime.yaml

Re: Flink Statefun and Feature computation

2022-02-24 Thread Igal Shilman
Hello, For (1) I welcome you to visit our documentions, and many talks online to understand more about the motivation and the value of StateFun. I can say in a nutshell that StateFun provides few building blocks that makes building distributed stateful applications easier. For (2) checkout our pl

Flink Statefun and Feature computation

2022-02-20 Thread Federico D'Ambrosio
Hello everyone, It's been quite a while since I wrote to the Flink ML, because in my current job never actually arose the need for a stateful stream processing system, until now. Since the last version I actually tried was Flink 1.9, well before Stateful Functions, I had a few questions about som