I intend to write some bespoke monitoring for our internal kafka system.
Amongst others, it should give us warning if some topics are lagging behind too
much (i.e. production much faster than consumption).
What would currently be the neatest way to get a list of all topics, partitions
and consumergroups? It's the latter that I'm most unsure about.
I imagine I could actually consume the "__consumer_offsets" topic (we're using
the offsets-are-committed-in-kafka approach), but perhaps there is a neater api
exposed. I couldn't immediately find it, though.
(I am working in Java/Scala, with the latest official java kafka client).
As always, any help would be appreciated!
-J
Winton Capital Management Limited ("Winton") is a limited company registered in
England and Wales with its registered offices at 16 Old Bailey, London, EC4M
7EG (Registered Company No. 3311531). Winton is authorised and regulated by the
Financial Conduct Authority in the United Kingdom, registered as an investment
adviser with the US Securities and Exchange Commission, registered with the US
Commodity Futures Trading Commission and a member of the National Futures
Association in the United States.
This communication, including any attachments, is confidential and may be
privileged. This email is for use by the intended recipient only. If you
receive it in error, please notify the sender and delete it. You should not
copy or disclose all or any part of this email.
This email does not constitute an offer or solicitation and nothing contained
in this email constitutes, and should not be construed as, investment advice.
Prospective investors should request offering materials and consult their own
advisers with respect to investment decisions and inform themselves as to
applicable legal requirements, exchange control regulations and taxes in the
countries of their citizenship, residence or domicile. Past performance is not
indicative of future results.
Winton takes reasonable steps to ensure the accuracy and integrity of its
communications, including emails. However Winton accepts no liability for any
materials transmitted. Emails are not secure and cannot be guaranteed to be
error free.