Re: User Interface not showing the actual count received and produced

2019-05-16 Thread Fabian Hueske
Hi Shakir, This is a frequently reported issue in Flink's metrics collection / UI. Send and received records and bytes only include data that is shared between Flink tasks but not between a source system (Kafka) and Flink or Flink and a sink system (Kinesis). IIRC, there is an effort to fix this p

Re: User Interface not showing the actual count received and produced

2019-05-15 Thread PoolakkalMukkath, Shakir
Hi Flink team, I am developing a flow which uses * FlinkKafkaConsumer010 to consume message from Kafka and * FlinkKinesisProducer to produce the results to Kinesis. In the user interface, I always see Bytes and Record received from Kafka is zero even though it is receiving events a

Re: User Interface not showing the actual count received and produced

2019-05-15 Thread PoolakkalMukkath, Shakir
Hi Flink team, I am developing a flow which uses * FlinkKafkaConsumer010 to consume message from Kafka and * FlinkKinesisProducer to produce the results to Kinesis. In the user interface, I always see Bytes and Record received from Kafka is zero even though it is receiving events