Hello,

I have a few questions regarding flinkā€™s dashboard and monitoring tools.

I have a fixed number of records that I process through the datastreaming
API on my standalone cluster and want to know how long it takes to process
them. My questions are:

1)    How can I see the time taken in milliseconds individually for each
operator (filter, filter, map and keyed aggregate) to process these records
during run time? I essentially want to know which operator causes the most
latency in the pipeline.

2)    While viewing the records and metrics on the dashboard there is a
discrepancy between the number of records sent and received between two
operators in my job graph. Why exactly are the number of records received
by my second operator less than those sent by customsource->map and where
are they stored? Image attached below for reference.
[image: image.png]
Best regards,
Komal

Reply via email to