Re: Latency Tracking Across All Kafka Component

2015-01-05 Thread Otis Gospodnetic
Hi, That sounds a bit like needing a full, cross-app, cross-network transaction/call tracing, and not something specific or limited to Kafka, doesn't it? Otis -- Monitoring * Alerting * Anomaly Detection * Centralized Log Management Solr & Elasticsearch Support * http://sematext.com/ On Mon, Ja

Latency Tracking Across All Kafka Component

2015-01-05 Thread Bhavesh Mistry
Hi Kafka Team/Users, We are using Linked-in Kafka data pipe-line end-to-end. Producer(s) ->Local DC Brokers -> MM -> Central brokers -> Camus Job -> HDFS This is working out very well for us, but we need to have visibility of latency at each layer (Local DC Brokers -> MM -> Central brokers -> Ca