Re: Under-replicated-partitions

2021-07-27 Thread Peter Bukowinski
Hi Sridhar, If your min.insync.replicas value is set to 3, then kafka won’t be able to move replicas until there are three replicas listed in the ISR. I would look into the health of broker 21 — it’s either down or unhealthy. It’s the only one not showing in the ISR list. — Peter Bukowinski

Re: kafka python client to create kafka user/acl info

2021-07-27 Thread Ran Lupovich
https://github.com/dpkp/kafka-python/blob/f19e4238fb47ae2619f18731f0e0e9a3762cfa11/test/test_admin_integration.py#L40 בתאריך יום ג׳, 27 ביולי 2021, 16:25, מאת Calvin Chen ‏: > Hi all > > I know there is confluent-kafka-python AdminClient to create/delete > topic/config, can AdminClient also be us

Stream msg using R

2021-07-27 Thread Paulo Ramos
Hi All, I have a technical question, regarding reading stream msg from kafka using R. This is what I am currently using: if (FALSE) { library (sparklyr ) sc <- spark_connect

kafka python client to create kafka user/acl info

2021-07-27 Thread Calvin Chen
Hi all I know there is confluent-kafka-python AdminClient to create/delete topic/config, can AdminClient also be used to create kafka user and acl info? could anybody share some link/example on this, thanks! -Calvin

Blocking stop top of the world vs continual flow incremental sticky rebalancing for conumer group autoscaling.

2021-07-27 Thread Mazen Ezzeddine
Dear all, I am running a simple kafka consumer group reactive autoscaling experiment on kubernetes, while leveraging range stop of the world assignor in the first run, and next in the second run I used incremental cooperative assignor. My workload is shown below where x-axis is the time in seco

Re: Under-replicated-partitions

2021-07-27 Thread Sridhar Rao
Hi Fabio Pardi, Thanks for your prompt response. Split brain was our suspicion and we are investigating other possibilities. Perhaps our understanding of the problem might be incorrect at the moment. The issue started when one of the broker instances went down abruptly (3 brokers, 3 zookeepers) an

Re: Under-replicated-partitions

2021-07-27 Thread Fabio Pardi
On 27/07/2021 09:19, Sridhar Rao wrote: Hi Everyone, Recently we noticed a high number of under-replicated-partitions after zookeeper split brain issue. We tried fixing the issue by executing ./kafka-reassign-partitions.sh procedure. However Kafka refuses to re-assign the partitions in ISR an

Under-replicated-partitions

2021-07-27 Thread Sridhar Rao
Hi Everyone, Recently we noticed a high number of under-replicated-partitions after zookeeper split brain issue. We tried fixing the issue by executing ./kafka-reassign-partitions.sh procedure. However Kafka refuses to re-assign the partitions in ISR and un-repl partitions remain the same. Kafka