Re: MirrorMaker2 Offset Replication Issue: MirrorCheckpointConnector Doesn't Replicate Final Offsets In Migrations

2024-05-28 Thread Greg Harris
Hi Mehrtens, I think you are experiencing this problem: https://issues.apache.org/jira/browse/KAFKA-15905 which just received a patch which is due to release in 3.8.0/3.7.1. Read there for more context, and you can consider building and testing with that patch to see if it resolves your issue. Ho

MirrorMaker2 Offset Replication Issue: MirrorCheckpointConnector Doesn't Replicate Final Offsets In Migrations

2024-05-28 Thread Mehrtens, M
Hi there, I’m running into an issue with MirrorMaker2 (MM2), specifically the MirrorCheckpointConnector (CPC). In short, CPC doesn’t replicate the final batch of offsets to the target Kafka cluster during a migration. I believe I can point to the sections of the MM2 code where this is happening,

Re: broker crashing when running in raft mode

2024-05-28 Thread Matthieu Patou
One more reply to myself. For reasons that are not quite clear we found that there were log directories left on brokers that corresponded to topics or partitions that no longer exist or that no longer reside on a given broker. Those directories don't and won't have a topicID which is causing kafka

Re: Kafka 3.7 Documentation

2024-05-28 Thread Luke Chen
Hi Edgar, > Is this the correct documentation on how to contribute code changes? > https://cwiki.apache.org/confluence/display/KAFKA/Contributing+Code+Changes#ContributingCodeChanges-PullRequest Yes, it is. For the KAFKA-15513 , sorry, I don't h

RE: Kafka 3.7 Documentation

2024-05-28 Thread Zubel, Edgar
Thank you for quick response! Is this the correct documentation on how to contribute code changes? https://cwiki.apache.org/confluence/display/KAFKA/Contributing+Code+Changes#ContributingCodeChanges-PullRequest Also I would like to ask you about another issue that I'm interested in - https://iss