Re: kafka partition_assignment_strategy

2021-07-01 Thread Ran Lupovich
😅that's sorts things out בתאריך יום ה׳, 1 ביולי 2021, 18:24, מאת Marcus Schäfer ‏< marcus.schae...@gmail.com>: > Hi, > > > Hi Marcus, > > What Ran meant is that please run the following command to check the > > result. > > > > bin/kafka-topics.sh --describe --topic TOPIC_NAME --bootstrap-server >

Re: kafka partition_assignment_strategy

2021-07-01 Thread Marcus Schäfer
Hi, > Hi Marcus, > What Ran meant is that please run the following command to check the > result. > > bin/kafka-topics.sh --describe --topic TOPIC_NAME --bootstrap-server > localhost:9092 Ah, from the kafka tooling. Sorry I was confused because the aws api name their commands also --describe-som

Re: kafka partition_assignment_strategy

2021-07-01 Thread Luke Chen
Hi Marcus, What Ran meant is that please run the following command to check the result. bin/kafka-topics.sh --describe --topic TOPIC_NAME --bootstrap-server localhost:9092 Thanks. Luke On Thu, Jul 1, 2021 at 8:06 PM Ran Lupovich wrote: > I meant kafka-topics describe command , I want to make

Kafka upgrade 1.1 to 2.7.1: Corruption issue

2021-07-01 Thread Dimitris Batis
Hi everyone, we recently tried to upgrade from Kafka 1.1 to Kafka 2.7.1 (5 Kafka nodes, 3 zookeeper nodes), where we encountered a corruption issue detailed below. I should first note that: - Originally this was a Kafka 0.9.0.1 server that was upgraded to Kafka 1.1 - The Kafka clients that we use

Re: kafka partition_assignment_strategy

2021-07-01 Thread Ran Lupovich
I meant kafka-topics describe command , I want to make sure your topic really have 20 partitions בתאריך יום ה׳, 1 ביולי 2021, 14:12, מאת Marcus Schäfer ‏< marcus.schae...@gmail.com>: > Hi, > > > How many partitions do you have for the topic? Can you issue --describe > > please and share, thanks >

command to get the value of a config from the broker

2021-07-01 Thread Dhirendra Singh
Hi All, I want to get the value of a config from broker. I do not have access to the server.properties file. is there any command available for it ? Thanks, Dhirendra.

Re: kafka partition_assignment_strategy

2021-07-01 Thread Marcus Schäfer
Hi, > How many partitions do you have for the topic? Can you issue --describe > please and share, thanks I've assigned 20 partitions: aws kafka describe-configuration-revision --region eu-central-1 --arn "..." --revision 1 base64 --decode ... auto.create.topics.enable=false default.rep

Re: kafka partition_assignment_strategy

2021-07-01 Thread Ran Lupovich
How many partitions do you have for the topic? Can you issue --describe please and share, thanks בתאריך יום ה׳, 1 ביולי 2021, 13:31, מאת Marcus Schäfer ‏< marcus.schae...@gmail.com>: > Hi, > > > Your first understanding is correct, provided each “consumer” means a > > “consumer thread” > > all ri

Re: kafka partition_assignment_strategy

2021-07-01 Thread Marcus Schäfer
Hi, > Your first understanding is correct, provided each “consumer” means a > “consumer thread” all right, thanks > IMO, Second understanding about message distribution is incorrect because > there is something called as max poll records for each consumer. Its 500 by > default. And the time betw