Hi, On Fri, May 22, 2020 at 7:19 AM Boris Lublinsky < boris.lublin...@lightbend.com> wrote:
> Also, where do I put flint-conf.yaml in Idea to add additional required > config parameter: > > classloader.parent-first-patterns.additional: > org.apache.flink.statefun;org.apache.kafka;com.google.protobuf > > > > On May 21, 2020, at 12:22 PM, Boris Lublinsky < > boris.lublin...@lightbend.com> wrote: > > Hi, > I am trying to run > https://github.com/apache/flink-statefun/tree/master/statefun-examples/statefun-greeter-example > locally > using > https://github.com/apache/flink-statefun/tree/master/statefun-examples/statefun-flink-harness-example > > And have several questions. > 1. It seems fairly straightforward to use it with in memory message > generators, but I can’t figure out how to add Kafka ingress/Egress so that > I can use it with Kafk > > Could you provide some context on why you would want to do that? The StateFun Flink Harness was not intended to work with the usual shipped ingress / egresses, but purely as a utility for users to run StateFun applications in a consolidated local setup. For testing against Kafka, I would suggest looking at how the StateFun end-to-end tests do it, using testcontainers. The tests are located under `statefun-e2e-tests` module. If you still want to use the Flink Harness for this, you may be able to use the withFlinkSourceFunction function to directly supply the Flink Kafka connector. This only works for the ingress side, though. > 2. GreetingModule already creates StatefulFunctionUniverse and so does > Harness. Is there a way to short circuit it and have Harness get > StatefulFunctionUniverse directly > > That is not possible. The StatefulFunctionUniverse that the Harness utility provides is always a "mock" one, which contains the defined in-memory ingress and egresses. As previously mentioned, that is because the Flink Harness was intended for running StateFun applications without the need to interact with any other external systems. > 3. Is there an example on how to write Flink main for stageful function? > > At the moment, it is not possible to directly integrate Flink APIs and Stateful Functions APIs in a single job. What do you have in mind for what you want to achieve? > 4. Is there an example anywhere on how to run such examples in the IDE > with Kafka? > > The tests in `statefun-e2e-tests` can be run in the IDE and tests against Kafka. It does require Docker to be available though. > 5 There is a great stateful functions example > https://github.com/ververica/flink-statefun-workshop, but its readme does > not really describe implementation and neither does this article, > referencing it > https://dev.to/morsapaes/flink-stateful-functions-where-to-start-2j39. Is > there anything that describes this implementation? > > I think the bottom half of the article provides some details of the example, including the messaging between functions and a rough sketch of the functions. Maybe its not detailed enough? In particular, what parts of the example would you want to have more details on? Cheers, Gordon
