Re: Help: how to get latency value comfortable in Flink1.5?

2018-09-26 Thread varuy322
Hi Till, I have copy the flink-metrics-graphite-1.5.2.jar to lib/, and restart flink.It seems make no difference. When I checked the jobmanager log, the metrics configured in flink-conf.yaml, could be load since it printed as below: "2018-09-27 09:50:23,953 INFO org.apache.flink.configuration.Gl

what's the meaning of latency indicator reported by flink metrics through prometheus?

2018-10-08 Thread varuy322
Hi there, I have integrated kafka with flink1.5, also with the help of prometheus and Granada to display metrics of flink 1.5, now i get three indicator about latency as below: 1)flink_taskmanager_job_latency_source_id_source_subtask_index_operator_id_operator_subtask_index_latency(short for laten

same parallelism with different taskmanager and slots, skew occurs

2019-01-01 Thread varuy322
Hi, there Recently I run streaming benchmark with flink 1.5.2 standalone on the cluster with 4 machines(1 as master and others as workers), it appears different result as below: (1). when I set the parallelism with 96, source, sink and middle operator parallelism all set to 96, start 3 taskmanager

Re: same parallelism with different taskmanager and slots, skew occurs

2019-01-02 Thread varuy322
Hi, Till It's very kind of your reply. I got your point, I'm sorry to not make it clear about my issue. I generated data by streaming benchmark just as the link: https://github.com/dataArtisans/databricks-benchmark/blob/master/src/main/scala/com/databricks/benchmark/flink/EventGenerator.scala . Wh