Ah, I see you are correct. Also I misspoke saying "workers" earlier, as the
consumer is not created by the worker, but the task.
I suppose the put() could be changed to putIfAbsent() here to enable this
property to be changed. Maybe submit a PR?
Ryanne
On Thu, Oct 17, 2019 at 10:00 AM Vishal San
I am trying to test a 3 node Kafka cluster using the producer and consumer test
perf scripts that ship with the binaries. When I am trying to enable
transaction in the producer script it runs into errors. For example:
# bin/kafka-producer-perf-test.sh --topic testtopic1 --num-records 1
--th
This is a great blog post that explains how kafka works with advertised
listeners and docker
https://rmoff.net/2018/08/02/kafka-listeners-explained/
-hans
> On Oct 18, 2019, at 5:36 AM, Mich Talebzadeh
> wrote:
>
> I do not understand this.
>
> You have on a physical host running zookeeper
Hi,
Have you looked at the metrics exposed via JMX? There appears to be some
metrics around requests for topic deletion, joining and leaving a cluster,
heartbeats, etc. Here's a sample of some metrics from the "kafka.network"
domain explored via JMXTerm:
kafka.network:name=TotalTimeMs,request=Cre
Hi Guozhang,
Thanks a lot for pointing me to this KIP and providing background
information on the current performance implications. I'll track progress
on the KIP.
Regards,
Sean
On Thu, Oct 17, 2019 at 12:29 PM Guozhang Wang wrote:
> Hello Sean,
>
> Yes atm we have one producer per task when
I do not understand this.
You have on a physical host running zookeeper locally and a broker running
as well. These are using default physical host portslike 2181, 9092 etc.
Then you have installed zookeeper and kaka broker on dockers?
docker run --net=host -d --name zookeeper -p 2181:2181 -p 28
Please check your advertised.listeners and listeners config.
Thanks,
On Thu, 17 Oct 2019 at 22:13, Wang, Shuo wrote:
> Hi,
>
> I have a question regarding connecting to kafka broker from docker.
>
> I have zookeeper and kafka broker running on my local machine.
> I have a docker container runni
Hi,
I have a question regarding connecting to kafka broker from docker.
I have zookeeper and kafka broker running on my local machine.
I have a docker container running on the same local machine with
--network=host
I want to send message from inside the docker container to my local kafka
broker.
Hello Sean,
Yes atm we have one producer per task when EOS is turned on compared to one
producer per thread without EOS. There's an ongoing KIP-447 aiming to bring
this back to one producer per thread with EOS as well which involves
broker-side changes.
To answer your question:
1. Assuming each
Hello,
in an application I use a producer and a consumer. The consumer polls data from
the same topic (replication-factor 1) the producer sends to. The producer works
transactional and within a transaction
the producer sends records to the topic and also sends offsets. The application
looks som
Hmm ( I did both )
another->another_test.enabled = true
another->another_test.topics = act_post
another->another_test.emit.heartbeats.enabled = false
another->another_test.consumer.auto.offset.reset = latest
another->another_test.sync.topic.acls.enabled = false
another.consumer.auto.offset.r
This appears to be a "regression" in recent (confluent-cp docker) Kafka
versions. When running with 5.0.0 it works fine (was using 5.3.1 before).
Not quite sure what is going on here, but we can stick with the old version
for now.
Any insight would still be useful, though - and perhaps it is someth
12 matches
Mail list logo
