I could but the external Rest call is done with async operator and I want to
reduce the number of objects going to async and it would require that I store
the state in the async operator to.
Med venlig hilsen / Best regards
Lasse Nedergaard
> Den 3. maj 2018 kl. 13.09 skrev Aljoscha Krettek :
Couldn't you do that in one operator then? I mean doing the calls and caching
the results?
> On 3. May 2018, at 12:28, Lasse Nedergaard wrote:
>
> Hi.
>
> The idea is to cache the latest enrichment data to reuse them and thereby
> limit the number of external enrichment calls a local cache i
Hi.
The idea is to cache the latest enrichment data to reuse them and thereby limit
the number of external enrichment calls a local cache in Flink as many of our
data objects are enriched with the same data.
An alternative solution could be to store the enriched data in Kafka and then
stream
Hi,
Why do you want to do the enrichment downstream and send the data back up? The
problem is that feedback edges (or iterations, they are the same in Flink) have
some issues with fault-tolerance. Could you maybe outline a bit more in-depths
what you're doing and what the flow of data and enric
Hi.
Because the data that I will cache come from a downstream operator and
iterations was the only way to look data back to a prev. Operator as I know
Med venlig hilsen / Best regards
Lasse Nedergaard
> Den 2. maj 2018 kl. 15.35 skrev Piotr Nowojski :
>
> Hi,
>
> Why can not you use simple
Hi,
Why can not you use simple CoProcessFunction and handle cache updates within
it’s processElement1 or processElement2 method?
Piotrek
> On 1 May 2018, at 10:20, Lasse Nedergaard wrote:
>
> Hi.
>
> I have a case where I have a input stream that I want to enrich with external
> data. I wan
Hi.
I have a case where I have a input stream that I want to enrich with
external data. I want to cache some of the external lookup data to improve
the overall performances.
To update my cache (a CoProcessFunction) I would use iteration to send the
external enriched information back to the cache a
