Re: broker crashing when running in raft mode

2024-05-28 Thread Matthieu Patou
One more reply to myself. For reasons that are not quite clear we found that there were log directories left on brokers that corresponded to topics or partitions that no longer exist or that no longer reside on a given broker. Those directories don't and won't have a topicID which is causing kafka

Re: broker crashing when running in raft mode

2024-05-17 Thread Matthieu Patou
Seems that actually running ./bin/kafka-reassign-partitions.sh to first generate and then execute to move the topic is working. I later realized that in a cluster where the metadata have been migrated to k-raft, the following command: ./bin/kafka-topics.sh --describe --bootstrap-server broker:9092

broker crashing when running in raft mode

2024-05-17 Thread Matthieu Patou
I'm trying to finish the migration of a dev cluster that used to use ZK. I finished the migration of Metadata from ZK to raft and it completed fairly fast. I did notice an error message: * java.lang.RuntimeException: The log dir Log(dir=/opt/kafka/data/topics/ingestperf.ingest-perf.ania001.3fd04d6