To monitor if the consumers are keeping up, take a look at max lag and min fetch jmx beans described in http://kafka.apache.org/documentation.html#monitoring
Thanks, Jun On Sun, Aug 25, 2013 at 9:18 AM, Mark <static.void....@gmail.com> wrote: > I imagine when you start to have dozens of different consumers and > multiple consumers in each group this gets really complicated to manage. > What are people out there using to manage, start/stop and monitor their > consumer groups? Anyway to visualize the grouping and status of each > consumer or consumer group? Are these just usually one off processes that > are started/stopped via their own command or is there some governing system > managing this (similar to Sidekig for Ruby)? > > Thanks > >