Re: How to count number of available messages per topic?

2019-04-28 Thread jaaz jozz
> the results, and you’ll have the number of messages available in your topic. > > > > -- Peter > > > >> On Apr 28, 2019, at 1:41 AM, jaaz jozz wrote: > >> > >> Hello, > >> I want to count how many messages available in each topic in

How to count number of available messages per topic?

2019-04-28 Thread jaaz jozz
Hello, I want to count how many messages available in each topic in my kafka cluster. I understand that just looking at the latest offset available is not correct, because older messages may have been already purged due to retention policy. So what is the correct way of counting that? Thanks, Jazz

Drawbacks for configuring many partitions for a topic

2019-01-27 Thread jaaz jozz
Hello, In order to be prepared for large volume of messages i want to configure my topic with large amount of partitions (>1000). What are the drawbacks of this? Should I except any pitfalls? Best regards, jazz

Re: How to balance messages in kafka topics with newly added partitions?

2019-01-27 Thread jaaz jozz
nd > it will result in a clean partitioning. > > Hope this helps a little, feel free to get back to us if you have more > questions! > > Best regards, > Sönke > > On Sun, Jan 27, 2019 at 1:21 PM jaaz jozz wrote: > > > > Hello, > > > > I have kafka

How to balance messages in kafka topics with newly added partitions?

2019-01-27 Thread jaaz jozz
Hello, I have kafka cluster with certain topic that had too few partitions, so a large backlog of messages was collected. After i added additional partitions, only the newly messages balanced between all the new partitions. What is the preferred way to balance the "old" backlog of messages inside