Re: Is there an equivalent of a "synchronous subscribe"?

2022-01-25 Thread Richard Bosch
on of TopicPartitions. It did take a bit of effort rewriting the tests, but because it saves several seconds of rebalancing per test it was worth it. I hope this helps you a bit. Kind regards, Richard Bosch On Tue, Jan 25, 2022 at 5:12 AM Sebastian Proksch wrote: > Hey all! I am actu

Re: Connection to node 432 (localhost/127.0.0.1:9094) could not be established. Broker may not be available

2022-05-31 Thread Richard Bosch
services or other hostnames to connect from other networks. If you comment out the *advertised.listeners* and use *listeners* instead with the new port number it should work. Kind regards, Richard Bosch On Mon, May 30, 2022 at 5:01 PM Ivanov, Evgeny wrote: > Hi! > > Could you please adv

Re: Clarification Kafka - MySQL

2022-07-08 Thread Richard Bosch
.html or a JDBC adapter https://github.com/aiven/jdbc-connector-for-apache-kafka. These are just a couple of examples of connectors you can use, there are quite a lot of connectors available. Kind regards, Richard Bosch On Fri, Jul 8, 2022 at 8:57 AM Alalasundaram Saravanan wrote: > Dear Team,

Re: Inquiry about using SSL encryption and SASL authentication for Kafka without specifying IP address in SAN in the CA certificate

2022-07-13 Thread Richard Bosch
ct to the broker, and the hostname must be in the SAN to successfully connect. How did you try to disable the hostname verifier? Because I'm not sure why setting the client property ssl.endpoint.identification.algorithm to an empty string did not work. Kind regards, Richard Bosch Develope

Re: Inquiry about using SSL encryption and SASL authentication for Kafka without specifying IP address in SAN in the CA certificate

2022-07-14 Thread Richard Bosch
can control that with the ssl.engine.factory.class property, This can have other side effects with the applications, and is a lot of work. Kind regards, Richard Bosch Developer Advocate Axual BV https://axual.com/ On Thu, Jul 14, 2022 at 12:46 PM Deepak Jain < deepak.j...@cumulus-systems.

Re: Apache Kafka acknowledgement

2022-07-29 Thread Richard Bosch
with the records on the topic. This will take of course some time, and your stakeholders and fellow developers might need to be convinced of this new way of working. My apologies for the long explanation, but I hope you can find some use for this. Kind regards, Richard Bosch Developer Advocate

Re: Consumer Lag-Apache_kafka_JMX metrics

2022-08-16 Thread Richard Bosch
nd regards, Richard Bosch Developer Advocate Axual BV https://axual.com/ On Mon, Aug 15, 2022 at 8:07 PM Kafka Life wrote: > Dear Kafka Experts > we need to monitor the consumer lag in kafka clusters 2.5.1 and 2.8.0 > versions of kafka in Grafana. > > 1/ What is the correc

Re: Trouble with Kafka ACLs upon startup

2022-09-01 Thread Richard Bosch
User Name in the documentation, https://kafka.apache.org/documentation/#security_authz_ssl I hope this helps. Kind regards, Richard Bosch Developer Advocate Axual BV E : richard.bo...@axual.com M : +31 6 11 850 846 W : www.axual.com On Thu, Sep 1, 2022 at 1:13 AM Rabey, Matthew

Re: mTLS client hostname validation is not working

2022-09-16 Thread Richard Bosch
this helps you to understand the Kafka Broker setup a bit better. Kind regards, Richard Bosch Developer Advocate Axual BV https://axual.com/ On Thu, Sep 15, 2022 at 9:55 PM James Ziesig wrote: > Hi, > > I have configured mTLS on a three server Kafka cluster. The servers an

Re: mTLS client hostname validation is not working

2022-09-16 Thread Richard Bosch
You're very welcome, and good luck with your installation. Kind regards, Richard Bosch On Fri, 16 Sep 2022, 17:56 James Ziesig, wrote: > Hi Richard, > > Thank you for the response. That does clear things up for me. I thought > it would be good to avoid MITM attacks by vali

Re: Imbalance in Commit Messages Across __consumer_offsets Topic Partitions

2023-05-01 Thread Richard Bosch
t now, see https://cwiki.apache.org/confluence/display/KAFKA/KIP-794%3A+Strictly+Uniform+Sticky+Partitioner I hope this helps Kind regards, Richard Bosch Developer Advocate Axual BV E : richard.bo...@axual.com M : +31 6 11 850 846 W : www.axual.com On Thu, Apr 27, 2023 at 4:19 PM Fares Ouesl

Re: Warning logs: Mixing offset types

2023-06-05 Thread Richard Bosch
in the Java client by default. There might not be an explicit consumer commitSync/commitAsync call in the consumer code, but it would be sending offset commits. I hope this helps you to find the problem Kind regards, Richard Bosch Developer Advocate Axual BV https://axual.com/ Kind regards

Re: Partition stickiness on consumer group rebalance?

2023-06-08 Thread Richard Bosch
/#consumerconfigs_partition.assignment.strategy If you search for Kafka Consumer Assignor you can find a lot of articles about this subject. The nice thing about this is that the consumer controls this behaviour, and is not fixed in the broker. Kind regards, Richard Bosch Developer Advocate Axual BV

Re: mirror-maker

2023-10-02 Thread Richard Bosch
access to all advertised ports belonging to the same Kafka broker listener (SASL, SSL, EXTERNAL-XX). Kind regards, Richard Bosch Developer Advocate Axual BV E : richard.bo...@axual.com M : +31 6 11 850 846 W : www.axual.com On Mon, Oct 2, 2023 at 2:25 PM Denny Fuchs wrote: > > hi, > &

Re: NO SCRAM-SASL AUTHENTICATION BETWEEN KRAFT CONTROL NODES

2023-11-03 Thread Richard Bosch
f for bootstrapping. Can you test specifying the controller in that setting? early.start.listeners=CONTROLLER Kind regards, Richard Bosch Developer Advocate Axual BV https://axual.com/ On Fri, Nov 3, 2023 at 4:03 PM Jesus Cea wrote: > On 3/11/23 11:25, Daniele Carminati wrote: > &g

Re: Regarding ingestion rate, topic size and retention period

2023-11-09 Thread Richard Bosch
. Then there can be delays or producer errors. I hope this answers your question. Kind regards, Richard Bosch Developer Advocate Axual BV https://axual.com/ On Thu, Nov 9, 2023 at 3:00 PM Yeikel Santana wrote: > Hi all, > > This might be a common question, but unfortunately, I

Re: Kafka Producer avoid sending more records when met exception while also keeping performance

2024-03-13 Thread Richard Bosch
of processing, as the current batch isn't finished yet. Combined with idempotence enabled and max inflight set to 5 (the maximum for idempotence tracking) it gave me relatively good performance. Kind regards, Richard Bosch Developer Advocate Axual BV https://axual.com/

Re: Strimzi kafka on k8s - only bootstrap server has public IP, brokers have Cluster IP

2024-11-05 Thread Richard Bosch
, and they provide documentation on how to configure both Kubernetes, persistent volumes and networking. Kind regards, Richard Bosch Developer Advocate Axual BV https://axual.com/ On Mon, Nov 4, 2024 at 5:50 AM karan alang wrote: > Hello All - > Anyone has installed Kafka on k8s, wit

Re: Kafka OAuth authentication using OKTA

2025-04-02 Thread Richard Bosch
Hi Anup, I don't think I can help you with your problem, but it appears you've included some credentials in your message with the KAFKA_OPTS Please check that you haven't got an issue now with leaked credentials Kind regards, Richard Bosch Developer Advocate Axual BV https://