same as triggering a stateful shutdown,
but it might be hitting similar unack issues.
John
From: Austin Cawley-Edwards
Sent: Thursday 13 May 2021 16:49
To: Jose Vargas ; John Morrow
Cc: user
Subject: Re: RabbitMQ source does not stop unless message arrives in qu
guidelines
on how to achieve that.
Cheers,
Gordon
On Fri, Oct 2, 2020, 1:38 AM John Morrow
mailto:johnniemor...@hotmail.com>> wrote:
Hi Flink Users,
I was watching Tzu-Li Tai's talk on stateful functions from Flink Forward
(https://www.youtube.com/watch?v=tuSylBadNSo) which mentioned
those two: statefun-kafka-io & statefun-kinesis-io
Is it possible to use Apache Pulsar as a Statefun ingress & egress?
Thanks,
John.
____
From: John Morrow
Sent: Wednesday 23 September 2020 11:37
To: Igal Shilman
Cc: user
Subject: Re: Stateful Fun
Thanks very much Igal - that sounds like a good solution!
I'm new to StateFun so I'll have to dig into it a bit more, but this sounds
like a good direction.
Thanks again,
John.
From: Igal Shilman
Sent: Wednesday 23 September 2020 09:06
To: John
Hi Flink Users,
I'm using Flink to process a stream of records containing a text field. The
records are sourced from a message queue, enriched as they flow through the
pipeline based on business rules and finally written to a database. We're using
the Ververica platform so it's running on Kuber
Hi Gordon,
That sounds good. My first thought was that if I have to break up the logic I'd
end up with:
BroadcastFunction1 --> AsyncFunction --> BroadcastFunction2
...with Broadcast1 & BroadcastFunction2 needing the same broadcast state, and
that state could change while an item is being proce
Hi Flink Users,
I have a BroadcastProcessFunction and in the processElement method I sometimes
need to do some http requests, depending on the broadcast state.
Because I'm doing http requests, I'd prefer the function to be async, like
RichAsyncFunction.asyncInvoke(), but RichAsyncFunction doesn
e...)
________
From: Biao Liu
Sent: Tuesday 17 December 2019 21:50
To: John Morrow
Cc: user
Subject: Re: MiniCluster with ProcessingTimeTrigger
Hi John,
The root cause is the collection source exits too fast. The window would also
exit without being triggered.
You c
Hi All,
I'm trying to test a pipeline that consists of two Flink tasks with a
MiniCluster. The 1st task has a WindowAll operator which groups items into
batches every second, and the 2nd task does an async operation with each batch
and flatMaps the result.
I've whittled it down to the bare bon
