Hi I think you are right that the metrics are reset after the job restart. It is because the metrics are only stored in the memory. I think you could store the metrics to the Flink's state[1], which could be restored after the job restarted.
[1] https://ci.apache.org/projects/flink/flink-docs-release-1.13/docs/dev/datastream/fault-tolerance/state/ Best, Guowei On Mon, May 24, 2021 at 10:59 AM zzzyw <zhanyw1...@163.com> wrote: > Dear all: > I use flink for real-time data synchronization（mysql,oracle --> kafka --> > mysql,oracle）. I want to count how many pieces of data are synchronized > every day(maybe need to count the last n days ). > > I am doing this now： flink metrics send to pushgateway, and then sum the > metrics (flink_taskmanager_job_task_numRecordsOut) to count how many > pieces > of data are synchronized every day, > but i found this metrics will reset after the flink job restart, how should > I deal with this problem? or is there any better way to count? > > < > http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/file/t3167/Snipaste_2021-05-24_10-51-22.png> > > > Best regards > > > > -- > Sent from: > http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/ >
