Re: Monitoring the max lag of a kafka streams application.

2016-08-31 Thread Rohit Valsakumar
er-metrics, records-lag-max, -Infinity Thanks, Rohit On 8/31/16, 1:20 PM, "Rohit Valsakumar" wrote: >I will take a look at it. > >Thanks, >Rohit > >On 8/30/16, 6:10 PM, "Guozhang Wang" wrote: > >>Hi Rohit, >> >>Just for clarificati

Re: Monitoring the max lag of a kafka streams application.

2016-08-31 Thread Rohit Valsakumar
or your application, your way of passing the class name of your >> implemented MetricsReporter through the StreamsConfig is correct. Have >> you seen records being processing by your streams application, meaning >>that >> there are indeed some fetched records from the fetch r

Re: Monitoring the max lag of a kafka streams application.

2016-08-31 Thread Rohit Valsakumar
en records being processing by your streams application, meaning that >there are indeed some fetched records from the fetch response? > >Guozhang > > >On Mon, Aug 29, 2016 at 10:48 AM, Rohit Valsakumar >wrote: > >> Hi all, >> >> Any opinions about monitorin

Re: Monitoring the max lag of a kafka streams application.

2016-08-29 Thread Rohit Valsakumar
Hi all, Any opinions about monitoring the records-lag-max for a kafka streams job? Thanks, Rohit On 8/26/16, 2:53 PM, "Rohit Valsakumar" wrote: >Hi all, > >I want to monitor the max lag of a kafka streams job which is consuming >from three topics and to do that

Monitoring the max lag of a kafka streams application.

2016-08-26 Thread Rohit Valsakumar
Hi all, I want to monitor the max lag of a kafka streams job which is consuming from three topics and to do that I have implemented the MetricsReporter interface which I pass through the Streams Configuration to the KafkaStreams object. In the implementation’s metricChange() method I have logg

Re: Question about bootstrap processing in KafkaStreams.

2016-06-28 Thread Rohit Valsakumar
tractor that >associates time and hence priority for the streams: >https://kafka.apache.org/0100/javadoc/org/apache/kafka/streams/processor/T >imestampExtractor.html > >-Jay > >On Tue, Jun 28, 2016 at 2:49 PM, Rohit Valsakumar >wrote: > >> Hi all, >> >> Is

Question about bootstrap processing in KafkaStreams.

2016-06-28 Thread Rohit Valsakumar
Hi all, Is there a way to consume all the contents of a kafka topic into a KTable before doing a left join with another Kstream? I am looking at something that simulates a bootstrap topic in a Samza job. Thanks, Rohit Valsakumar This email and any attachments