Re: Topics marked for deletion stuck as ineligible for deletion

It doesn't exist anymore, we replaced it after a hardware failure. Thinking about it I don't think I reassigned the partitions for broker 5 to the new broker before deleting these topics, I didn't realize that it was necessary for all brokers to be online. Since broker 5 is never coming back ag

Kafka 2.4.0 & Mirror Maker 2.0 Error

Hi All,  I'm trying to set up mirror maker 2.0 with Kafka 2.4.0 however, I'm receiving the following errors on startup:  ERROR Plugin class loader for connector 'org.apache.kafka.connect.mirror.MirrorSourceConnector' was not found. Returning: org.apache.kafka.connect.runtime.isolation.Delegatin

Re: Which container should you use when deploying on docker ?

There are various Kafka images available, including: https://hub.docker.com/r/confluentinc/cp-kafka/ https://hub.docker.com/r/wurstmeister/kafka/ I'm not 100% clear what your doubt is? If these are legitimate Kafka images, or something else?

Re: Kafka 2.4.0 & Mirror Maker 2.0 Error

Hey Jamie, are you running the MM2 connectors on an existing Connect cluster, or with the connet-mirror-maker.sh driver? Given your question about plugin.path I'm guessing the former. Is the Connect cluster running 2.4.0 as well? The jars should land in the Connect runtime without any need to modif

Re: Topics marked for deletion stuck as ineligible for deletion

If it was replaced, and a new broker was brought online with the same id, wherever topic partitions had been previously assigned to it should have been recreated. At this point, however, I would shut down the cluster, delete the znodes, delete the topic directories from the brokers, then bring

[ANNOUNCE] Apache Kafka 2.4.0

The Apache Kafka community is pleased to announce the release for Apache Kafka 2.4.0 This release includes many new features, including: - Allow consumers to fetch from closest replica - Support for incremental cooperative rebalancing to the consumer rebalance protocol - MirrorMaker 2.0 (MM2), a n

Re: Missing link in online document

Hello Yu, Thanks for the reference, and I can confirm it is indeed broken. Will try to fix the link. Guozhang On Sun, Dec 15, 2019 at 3:45 PM Yu Watanabe wrote: > Hello Guozhang. > > Thank you for the reply. > The link was in this page. > > > https://kafka.apache.org/23/documentation/streams

Re: [ANNOUNCE] Apache Kafka 2.4.0

Thanks to all who contributed to the Apache blog post about 2.4. It's live now at https://blogs.apache.org/kafka/date/20191216 On Mon, Dec 16, 2019 at 10:30 PM Manikumar wrote: > The Apache Kafka community is pleased to announce the release for Apache > Kafka 2.4.0 > > This

Re: Which container should you use when deploying on docker ?

Robin. Thank you for the reply. I am about to run kafka on docker in development environment for first time and also in production. To get started, I searched images in docker hub that has "Official Images" tag to find if there is a docker image maintained by the community. But there wasn't one s

Re: Message batch & compression doesn't work as expected

Hi, I think the root cause of this is transaction. The producer we are using has enabled transaction, and batching then is not working as expected. Once we turn it off, the situation is back to normal, I can see batching is performed, and everything looks fine. Is transaction not working well with