Hi Max, Sorry for not being clearer earlier, by splitting the pipeline I mean: having a pre-processing job that does whatever transformations necessary with the DataStream and outputs to Kafka / Kinesis, and then having a separate StateFun deployment that consumes from that transformed Kafka / Kinesis [1] topic.
[1] - https://ci.apache.org/projects/flink/flink-statefun-docs-release-2.0/io-module/apache-kafka.html Good luck, Igal. On Sun, Apr 26, 2020 at 6:43 PM m@xi <makisnt...@gmail.com> wrote: > Dear Igal, > > Can you elaborate more on your proposed solution of splitting the pipeline? > > If possible, providing some skeleton pseudocode would be awesome! > > Thanks in advance. > > Best, > Max > > > > -- > Sent from: > http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/ >
