Re: DataStream request / response

2022-04-08 Thread Jason Thomas
I will dig deeper into Statefun. Also, yes for now I also can try the Spring/Kafka solution if Statefun doesn't fit. Austin - as far rewriting our microservices in Flink here are some things I was looking for: - We need to be able to easily share/transform data with other teams. Flink SQL seems

Re: DataStream request / response

2022-04-08 Thread Roman Khachatryan
It seems to be possible now with RequestReplyHandlers from Java SDK [1] (or other SDKs) unless I'm missing something. [1] https://nightlies.apache.org/flink/flink-statefun-docs-release-3.2/docs/sdk/java/#serving-functions Regards, Roman On Fri, Apr 8, 2022 at 7:45 PM Austin Cawley-Edwards wrote

Re: DataStream request / response

2022-04-08 Thread Austin Cawley-Edwards
Good suggestion – though a common misconception with Statefun is that HTTP ingestion is possible. Last time I checked it was still under theoretical discussion. Do you know the current state there? Austin On Fri, Apr 8, 2022 at 1:19 PM Roman Khachatryan wrote: > Hi, > > Besides the solution su

Re: DataStream request / response

2022-04-08 Thread Roman Khachatryan
Hi, Besides the solution suggested by Austing, you might also want to look at Stateful Functions [1]. They provide a more convenient programming model for the use-case I think, while DataStream is a relatively low-level API. [1] https://nightlies.apache.org/flink/flink-statefun-docs-stable/ Rega

Re: DataStream request / response

2022-04-08 Thread Austin Cawley-Edwards
Hi Jason, No, there is no HTTP source/ sink support that I know of for Flink. Would running the Spring + Kafka solution in front of Flink work for you? On a higher level, what drew you to migrating the microservice to Flink? Best, Austin On Fri, Apr 8, 2022 at 12:35 PM Jason Thomas wrote: > I

DataStream request / response

2022-04-08 Thread Jason Thomas
I'm taking an existing REST based microservice application and moving all of the logic into Flink DataStreams. Is there an easy way to get a request/response from a Flink DataStream so I can 'call' into it from a REST service? For example, something similar to this Kafka streams example that use