Sorry, forgot to cc user@ as well in the last reply. On Fri, May 22, 2020 at 12:01 PM Tzu-Li (Gordon) Tai <tzuli...@apache.org> wrote:
> As an extra note, the utilities you will find in `statefun-e2e-tests`, > such as the `StatefulFunctionsAppsContainers` is not yet intended for users. > This however was previously discussed before. Would be great to hear > feedback from you on how it works for you if you do decide to give that a > try. > > On Fri, May 22, 2020 at 11:58 AM Tzu-Li (Gordon) Tai <tzuli...@apache.org> > wrote: > >> Hi, >> >> On Fri, May 22, 2020 at 7:19 AM Boris Lublinsky < >> boris.lublin...@lightbend.com> wrote: >> >>> Also, where do I put flint-conf.yaml in Idea to add additional required >>> config parameter: >>> >>> classloader.parent-first-patterns.additional: >>> org.apache.flink.statefun;org.apache.kafka;com.google.protobuf >>> >>> >>> >>> On May 21, 2020, at 12:22 PM, Boris Lublinsky < >>> boris.lublin...@lightbend.com> wrote: >>> >>> Hi, >>> I am trying to run >>> https://github.com/apache/flink-statefun/tree/master/statefun-examples/statefun-greeter-example >>> locally >>> using >>> https://github.com/apache/flink-statefun/tree/master/statefun-examples/statefun-flink-harness-example >>> >>> And have several questions. >>> 1. It seems fairly straightforward to use it with in memory message >>> generators, but I can’t figure out how to add Kafka ingress/Egress so that >>> I can use it with Kafk >>> >>> Could you provide some context on why you would want to do that? >> >> The StateFun Flink Harness was not intended to work with the usual >> shipped ingress / egresses, but purely as a utility for users to run >> StateFun applications in a consolidated local setup. >> For testing against Kafka, I would suggest looking at how the StateFun >> end-to-end tests do it, using testcontainers. >> The tests are located under `statefun-e2e-tests` module. >> >> If you still want to use the Flink Harness for this, you may be able to >> use the withFlinkSourceFunction function to directly supply the Flink Kafka >> connector. >> This only works for the ingress side, though. >> >>> 2. GreetingModule already creates StatefulFunctionUniverse and so does >>> Harness. Is there a way to short circuit it and have Harness get >>> StatefulFunctionUniverse directly >>> >>> That is not possible. The StatefulFunctionUniverse that the Harness >> utility provides is always a "mock" one, which contains the defined >> in-memory ingress and egresses. >> As previously mentioned, that is because the Flink Harness was intended >> for running StateFun applications without the need to interact with any >> other external systems. >> >>> 3. Is there an example on how to write Flink main for stageful function? >>> >>> At the moment, it is not possible to directly integrate Flink APIs and >> Stateful Functions APIs in a single job. >> What do you have in mind for what you want to achieve? >> >>> 4. Is there an example anywhere on how to run such examples in the IDE >>> with Kafka? >>> >>> The tests in `statefun-e2e-tests` can be run in the IDE and tests >> against Kafka. It does require Docker to be available though. >> >>> 5 There is a great stateful functions example >>> https://github.com/ververica/flink-statefun-workshop, but its readme >>> does not really describe implementation and neither does this article, >>> referencing it >>> https://dev.to/morsapaes/flink-stateful-functions-where-to-start-2j39. >>> Is there anything that describes this implementation? >>> >>> I think the bottom half of the article provides some details of the >> example, including the messaging between functions and a rough sketch of >> the functions. Maybe its not detailed enough? >> In particular, what parts of the example would you want to have more >> details on? >> >> Cheers, >> Gordon >> >> >
