so i went ahead and put some logging in the WatermarkGeneartor.onEvent and
.onPeriodicEmit functions in the test source watermark generator, and i do
see the watermarks come by with values through those functions. they're
just not being returned as expected via the rest api.
On Tue, Nov 30, 2021
Hi!
I see. So to test your watermark strategy you would like to fetch the
watermarks downstream.
I would suggest taking a look at
org.apache.flink.streaming.api.operators.AbstractStreamOperator. This class
has a processWatermark method, which is called when a watermark flows
through this operator
thanks for the reply caizhi!
we're on flink 1.12.3. in the test, i'm using a custom watermark strategy
that is derived from BoundedOutOfOrdernessWatermarks that emits watermarks
using processing time after a period of no events to keep the timer-reliant
operators happy. basically, it's using eve
Hi!
I believe metrics are enabled by default even for a mini cluster. Which
Flink version are you using and how do you set your watermark strategy?
Could you share your user code about how to create the datastream / SQL and
get the job graph?
I'm also curious about why do you need to extract the
bump. a more general question is what do people do for more end to end,
full integration tests to test event time based jobs with timers?
On Tue, Nov 23, 2021 at 11:26 AM Jin Yi wrote:
> i am writing an integration test where i execute a streaming flink job
> using faked, "unbounded" input wher
