Re: Counter and guage metric are not populated consistently.

2018-04-27 Thread Chesnay Schepler
If a job finishes very quickly it commonly happens that metrics are not exposed; the WebUI periodically polls metrics, but the polling only works while the job is running. Reporters that expose metrics periodically show the same behavior. On 27.04.2018 09:49, Ganesh Manal wrote: Hi, The cus

Counter and guage metric are not populated consistently.

2018-04-27 Thread Ganesh Manal
Hi, The custom counter/guage metric are generated only in special case. Like if I execute wordcount example with hdfs file as input, I am able to see the counters. But in case, wordcount is executed without hdfs file as input, i.e. using default Datasets, metric counters are not generated. I a