Getting the suggested partition assignment via the Admin client

Hi, Kafka can recommend an assignment via the ReassignPartitionsCommand (with --generate), and it is also possible to get this assignment directly by calling AdminUtils.assignReplicasToBrokers. We would like our application to be able to get the suggested partition assignment and apply it to a to

started getting TopologyException: Invalid topology after moving to streams-2.5.1

Hi All, After moving to kafka-streams-2.5.1 version, one of our services started failing with below exception. Any idea what this is about and why it was passing with 2.5.0? Any changes made in 2.5.1 that is breaking this? Exception in thread "main" org.springframework.context.ApplicationContextE

Re: Getting the suggested partition assignment via the Admin client

Hi Stig, AdminUtils is not a public API, so you're right to not want to depend on it. Unfortunately the Admin client API doesn't offer functionality equivalent to `kafka-reassign-partitions.sh --generate`. That is, while you can get the broker to generate the assignments for you when you create a

KSQL should not silently overwrite Schemas in Registry with same name

Hi all See existing issue: https://github.com/confluentinc/ksql/issues/2427 Does anyone know if there is a work around for this? This problem is driving us crazy. We really don't want to allow KSQL streams to constantly change the associated

Re: Apache Kafka Windows

You can probably look at maxwell by zendesk as well for CDC. They too have a very simple producer for Kafka. On Mon, 5 Oct 2020, 04:42 Naveen D, wrote: > Hi Guys, > > We have below scenario to achieve via KAfka windows stand alone > > 1. Download apache kafka for windows > 2.Start Zookeeper > 3.

Re: started getting TopologyException: Invalid topology after moving to streams-2.5.1

Hi Pushkar, Sorry for the trouble. Can you share your config and topology description? If I read your error message correctly, it says that your app is configured with no source topics and no threads. Is that accurate? Thanks, -John On Mon, 2020-10-05 at 15:04 +0530, Pushkar Deole wrote: > Hi A

Re: Getting the suggested partition assignment via the Admin client

Thank you. You are right about the limitations of Kafka's own assignments. Thank you for letting me know about Cruise Control. I think given that Kafka's own assignment is useful enough to be exposed via the local reassign command, it should also be exposed on the Admin client. It is likely suffi

Re: MM2 offset translations not working

It seems the problem is just between kafka 0.10.x --> kafka 2.x. It is working fine for kafka 2.x --> 2.x. On Sat, Oct 3, 2020 at 4:50 PM Samuel Cantero wrote: > Hi all, > > It looks like the offsets returned by the > RemoteClusterUtils.translateOffsets are always the same as the > source/primar

Re: MM2 offset translations not working

oh no, actually I was wrong. We have the same problem. On Mon, Oct 5, 2020 at 5:17 PM Samuel Cantero wrote: > It seems the problem is just between kafka 0.10.x --> kafka 2.x. It is > working fine for kafka 2.x --> 2.x. > > On Sat, Oct 3, 2020 at 4:50 PM Samuel Cantero wrote: > >> Hi all, >> >>

Re: MM2 offset translations not working

This is working for 2.5.1 but broken for trunk (or master). On Mon, Oct 5, 2020 at 5:19 PM Samuel Cantero wrote: > oh no, actually I was wrong. We have the same problem. > > On Mon, Oct 5, 2020 at 5:17 PM Samuel Cantero wrote: > >> It seems the problem is just between kafka 0.10.x --> kafka 2.x