You need to do a partition reassignment to increase or decrease the
replication factor. It's tediously manual, but it's just json so it's
trivial to manipulate which is probably why it's still tediously manual.
There's a guide here although it's ageing a little:
http://www.allprogrammingtutorials.
I have a cluster with 4 brokers and I want to reduce it to 2 brokers. I cannot
re-assign __consumer_offsets because it wants at least 3 brokers.
Is there a way to do this? Or am I going to have to trash my cluster and start
over?
-Dylan
(206) 855-9740 - Home
(206) 235-8809 - Cell
The in
I have some boxes that I'm using to test kafka configurations (and zookeeper).
What's the recommended procedure to clean them out to a clean state so I can
re-install kafka and zookeeper without worrying about old data or configuration
getting in the way?
-Dylan
(206) 855-9740 - Home
(206)
Hey Praveen,
I also suspect that you can get away with far fewer threads. Here's the
general starting point I recommend:
* start with just a little over 1 thread per hardware thread (accounting
for cores and hyperthreading). For example, on my machine, I have 4 cores
with 2 threads of execution e
Yep, that should also work!
-John
On Mon, Sep 17, 2018 at 8:36 AM David Espinosa wrote:
> Thank you all for your responses!
> I also asked this on the confluent slack channel (
> https://confluentcommunity.slack.com) and I got this approach:
>
>1. Query the partitions' high watermark offset
This should help: https://rmoff.net/2018/08/02/kafka-listeners-explained/
--
Robin Moffatt | Developer Advocate | ro...@confluent.io | @rmoff
On Mon, 17 Sep 2018 at 12:18, XinYi Long wrote:
> Hello, Guys,
>
> I have a Kafka cluster, which is behind a NAT.
>
> I have some devices on
Thank you all for your responses!
I also asked this on the confluent slack channel (
https://confluentcommunity.slack.com) and I got this approach:
1. Query the partitions' high watermark offset
2. Set the consumer to consume from beginning
3. Break out when you've reached the high offset
Hello, Guys,
I have a Kafka cluster, which is behind a NAT.
I have some devices on the internet, to play as consumers and producers.
And I also have some applications which are in the same LAN with the Kafka
cluster, and play as consumers and producers.
I have changed the "advertis
