Re: Tiny topology shows '0' for all stats.

2015-12-16 Thread Niels Basjes
@Nick: That is what I read in the current description and comments. On Tue, Dec 15, 2015 at 6:25 PM, Nick Dimiduk wrote: > For my own understanding, are you suggesting the FLINK-2944 (or a subtask) > is the appropriate place to implement exposure of metrics such as bytes, > records in, out of St

Re: Tiny topology shows '0' for all stats.

2015-12-15 Thread Nick Dimiduk
For my own understanding, are you suggesting the FLINK-2944 (or a subtask) is the appropriate place to implement exposure of metrics such as bytes, records in, out of Streaming sources and sinks? On Tue, Dec 15, 2015 at 5:24 AM, Niels Basjes wrote: > Hi, > > @Ufuk: I added the env.disableOperato

Re: Tiny topology shows '0' for all stats.

2015-12-15 Thread Niels Basjes
Hi, @Ufuk: I added the env.disableOperatorChaining() and indeed now I see two things on the screen and there are numbers counting what has happened. @Stephan: Yes, I understand these numbers now. I found that this is already a jira ticket to add what I was looking for: https://issues.apache.org/j

Re: Tiny topology shows '0' for all stats.

2015-12-14 Thread Stephan Ewen
To sum this up, the web dashboard stats are Flink network stats. If you job has no network communication, its all zero. On Mon, Dec 14, 2015 at 5:03 PM, Ufuk Celebi wrote: > > > On 14 Dec 2015, at 16:25, Niels Basjes wrote: > > > > Hi, > > > > I have a very small topology here. > > In fact this

Re: Tiny topology shows '0' for all stats.

2015-12-14 Thread Ufuk Celebi
> On 14 Dec 2015, at 16:25, Niels Basjes wrote: > > Hi, > > I have a very small topology here. > In fact this is a thing that generates synthetic data and puts it into Kafka. > When looking at the web UI I see that all counters (i.e. Bytes received, > Records received, Bytes sent, Records sen

Tiny topology shows '0' for all stats.

2015-12-14 Thread Niels Basjes
Hi, I have a very small topology here. In fact this is a thing that generates synthetic data and puts it into Kafka. When looking at the web UI I see that all counters (i.e. Bytes received, Records received, Bytes sent, Records sent) all remain 0. I verified and I'm seeing thousands of records ar