Re: Async Source Function in Flink

2018-05-17 Thread Federico D'Ambrosio
I see, thank you very much for your answer! I'll look into pool connection handling. Alternatively, I suppose that since it is a SourceFunction, even synchronous calls may be used without side effects in Flink? Thank you, Federico Il giorno mar 15 mag 2018 alle ore 16:16 Timo Walther ha scritto

Re: Async Source Function in Flink

2018-05-15 Thread Timo Walther
Hi Frederico, Flink's AsyncFunction is meant for enriching a record with information that needs to be queried externally. So I guess you can't use it for your use case because an async call is initiated by the input. However, your custom SourceFunction could implement a similar asynchronous lo

Async Source Function in Flink

2018-05-14 Thread Federico D'Ambrosio
Hello everyone, just wanted to ask a quick question: I have to retrieve data from 2 web services via REST calls, use them as sources and push these data to Kafka. So far, I implemented a SourceFunction which deals with making the calls with the respective clients. Now, the function does use, for