Hi Ahmad, Yes there is [1], this feature is already in master, and if you would like, you can already try it out. Take a look at the statefun-python-greeter-example [2]. With that example, you can: (a) Make changes to the greeter function like introducing a new state type[3], or change the logic, without restarting Flink.
(b) You can modify the example's module.yaml by Removing this line[4], and then: (b.1) This will allow you to add additional function types under the "example" namespace, that will be served by the http://python-worker:8000/statefun endpoint. (b.2) Use the templating feature to define different endpoints (host and path), for different function types. For example: [5]. Please note that changes to module.yaml still require a restart of the Flink cluster, but after that you can make arbitrary changes to the function definitions, add/remove functions, and create new endpoints that serve new functions, without restarting Flink. Good luck, Igal. [1] https://issues.apache.org/jira/browse/FLINK-20264 [2] https://github.com/apache/flink-statefun/tree/master/statefun-examples/statefun-python-greeter-example [3] https://github.com/apache/flink-statefun/blob/master/statefun-examples/statefun-python-greeter-example/greeter/greeter.py#L30 [4] https://github.com/apache/flink-statefun/blob/master/statefun-examples/statefun-python-greeter-example/module.yaml#L27 [5] https://github.com/apache/flink-statefun/blob/master/statefun-flink/statefun-flink-core/src/test/resources/module-v3_0/module.yaml#L29 On Tue, Jan 12, 2021 at 7:16 PM Ahmad Alkilani <amk...@gmail.com> wrote: > That's awesome, thank you! JIRA I can follow? > > On Tue, Jan 12, 2021 at 9:01 AM Igal Shilman <i...@ververica.com> wrote: > >> Hello! >> >> Is it possible to dynamically associate Remote Modules with Remote >>> Function Endpoints to an existing/already running Flink stateful >>> application? >>> >> >> Yes, in the upcoming StateFun release we are introducing exactly that :) >> As of the upcoming version, we are adding a capability to dynamically >> register and modify function types without the need to redeploy Flink. >> >> Igal. >> >> On Mon, Jan 11, 2021 at 10:48 PM Ahmad Alkilani <amk...@gmail.com> wrote: >> >>> Hi, >>> I see that you need to tell the Flink Stateful runtime about remote >>> stateful function modules via a yaml file provided at deploy time. Given >>> remote modules and stateful functions are an external deployment concern >>> anyway, Is it possible to dynamically associate Remote Modules with Remote >>> Function Endpoints to an existing/already running Flink stateful >>> application? >>> >>> The use case is allowing dynamic composability of functions. The flink >>> stateful application would receive a request to dynamically string together >>> a new route based on some input data. The new route would be making calls >>> to lets say a newly created Flink stateful application deployed remotely in >>> an arbitrary language. >>> >>> Is this possible? On the roadmap? A bad idea? Why or why not? >>> >>> Thank you! >>> >>>>
