AsyncFunction retries

2020-07-09 Thread Gadi Katsovich
Hi all, I have a job with the following diagram: source -> Flat Map -> Filter -> Filter -> Filter -> async wait operator -> Process -> sink The async operation sends an HTTP post (using Apache HttpAsyncClient). In case the HTTP post times out or fails, I want to retry a few times. Is using Future

Re: Single stream, two sinks

2020-03-05 Thread Gadi Katsovich
gt; If so you can use side output in order to dump your data to db. >> >> >> https://ci.apache.org/projects/flink/flink-docs-stable/dev/stream/side_output.html >> >> On Sat, Feb 29, 2020, 23:01 Gadi Katsovich >> wrote: >> >>> Hi, >>>

Single stream, two sinks

2020-02-29 Thread Gadi Katsovich
Hi, I'm new to flink and am evaluating it to replace our existing streaming application. The use case I'm working on is reading messages from RabbitMQ queue, applying some transformation and filtering logic and sending it via HTTP to a 3rd party. A must have requirement of this flow is to to write