Caizhi Weng created FLINK-24759:
-----------------------------------

             Summary: Metrics on web UI is not correct in a filesystem source 
to filesystem sink streaming job
                 Key: FLINK-24759
                 URL: https://issues.apache.org/jira/browse/FLINK-24759
             Project: Flink
          Issue Type: Bug
          Components: Runtime / Metrics, Runtime / Web Frontend
    Affects Versions: 1.14.0
            Reporter: Caizhi Weng
         Attachments: metrics.png

I'm running a yarn-per-job streaming job which reads a large csv file 
(flights.csv in [Kaggle flight delay 
data|https://www.kaggle.com/usdot/flight-delays], ~500MB) from HDFS and writes 
to another location (csv format) on the same HDFS. The resulting file seems OK, 
but the metrics on the web UI seems strage.

I've tried other formats like reading from csv and writing to avro and the 
phenomenon is the same.

 !metrics.png! 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to