Hi everyone!! I have a streaming job running with fixed windows of one hour and allowed lateness of two days and the number of dropped due to lateness elements is slowly, but continuously growing and I'd like to understand which elements are those.
I'd like to get the watermark from inside the job to compare it against each element and write log messages with the ones that will be potentially discarded.... Does that approach make any sense? I which case... How can I get the watermark from inside the job? Any other ideas? Thanks in advance!!
