Hi Gordon,
Thank you for the clarification. In that case, it sounds like I should be
using a custom extractor to emit watermarks in addition to the Kafka
timestamps. I see that the doc already has code demonstrating how to emit
the timestamps so I will start there.
Thanks,
Jia
On Tue, May 16, 20
Ah, my apologies, some misunderstanding on my side here.
FlinkKafkaConsumer010 attaches the Kafka timestamp with the records, hence a
timestamp extractor is not required, BUT you’ll still need a watermark
generator to produce the watermarks. That should explain why the windows aren’t
firing.
I
Hi Gordon,
Thanks for confirming my understanding that the extractor should not have
to be defined for 0.10. However, I'm still experiencing the case where not
using an extractor results in zero window triggers.
I've verified the timestamps in the Kafka records with the following
command:
bin/kaf
Hi Jia!
This sounds a bit fishy. The docs mention that there is no need for a timestamp
/ watermark extractor because with 0.10, the timestamps that come with Kafka
records can be used directly to produce watermarks for event time.
One quick clarification: did you also check whether the timesta
