Hi,
I have a Flink sql streaming job defined by:

SELECT
  user_id
  , hop_end(created_at, interval '30' second, interval '1' minute) as bucket_ts
  , count(name) as count
FROM event
WHERE name = 'signin'
GROUP BY
  user_id
  , hop(created_at, interval '30' second, interval '1' minute)


there is a noticeably delay of the groupBy operator. For example, I only
see the record sent out 10 min later after the record received in. see the
attached pic.

[image: image.png]

I m expecting to see the group by result after one minute since the sliding
window size is 1 min and the slide is 30 sec.

There is no such issue if I run the job locally in IntelliJ. However, I ran
into the above issue if I run the job on EMR (flink version = 1.7)

Can anybody give a clue of what could be wrong?
Thanks,

Fanbin

Reply via email to