Re: Capturing statistics for more than 5 minutes

2017-11-18 Thread Nomchin Banga
Hi I have been able to run JMX with Flink with the following configuration applied to the flink-conf.yaml file of all nodes in the cluster: metrics.reporters: jmx metrics.reporter.jmx.class: org.apache.flink.metrics.jmx.JMXReporter metrics.reporter.jmx.port: 9020-9022 env.java.opts: -Dcom.sun.ma

Re: Capturing statistics for more than 5 minutes

2017-11-14 Thread Chesnay Schepler
Hello, the Metric System should be exactly what you're looking for. On 15.11.2017 03:55, Nomchin Banga wrote: Hi We are a group of graduate students from Purdue University who are doing an experimental st

Capturing statistics for more than 5 minutes

2017-11-14 Thread Nomchin Banga
Hi We are a group of graduate students from Purdue University who are doing an experimental study to compare different data ingestion engines. For this purpose, we are trying to collect statistics of running jobs over a few days. However, Flinkā€™s UI captures the statistics for the last 5 minutes.