Re: Apache Kafka Questions

Hello Team Thank you for answering the questions I reached out earlier. We have a new set, and I would really like to have them verified and confirmed by an expert. Request to answer them with specification in a way they can be replicated in local user environment. f. How are Consumer Groups c

Call for Presentations now open, ApacheCon North America 2022

[You are receiving this because you are subscribed to one or more user or dev mailing list of an Apache Software Foundation project.] ApacheCon draws participants at all levels to explore “Tomorrow’s Technology Today” across 300+ Apache projects and their diverse communities. ApacheCon showcases t

Kafka Connect - offset.storage.topic reuse across clusters

Hi, I've recently been experimenting with setting the values of the `offset,` `storage` and `status` topics within Kafka Connect. I'm aware from various sources (Robin Moffatt blogs, StackOverflow, Confluent Kafka Connect docs) that these topics should not be shared across different connect **clu

Re: Kafka Connect - offset.storage.topic reuse across clusters

Hi Jordan, Is there a good reason for wanting to do this? I can think of multiple reasons why you shouldn't do this even if technically it works in some cases. Or it's just curiosity as to whether you can/should? thanks, Robin. -- Robin Moffatt | Principal Developer Advocate | ro...@confluent

Re: Kafka Connect - offset.storage.topic reuse across clusters

Hi Robin, I'm interested in a use case in which I need to be able to have a connect cluster fail, and then bring up a new cluster with the same offset topics and connectors. By new cluster I mean a cluster with a new `group.id`. I am aware I could just use the same group id as before but I would l

Re: Kafka Connect - offset.storage.topic reuse across clusters

Connectors overwriting each other's offsets is the primary concern. If you have a guarantee that there will only ever be one connector with a given name running at once on any of the Connect clusters that use the same offsets topic, and you want offsets to be shared for all source connectors on any

Re: Need Help - getting vulnerability due to Log4j- v1.2.17 jar being used in Kafka_2.11-2.4.0.

Hi Sandip, I just merged the PR https://github.com/apache/kafka/pull/11743 that replaces log4j with reload4j. Reload4j will be part of Apache Kafka 3.2.0 and 3.1.1. Best, Bruno On 30.03.22 04:26, Luke Chen wrote: Hi Sandip, We plan to replace log4j with reload4j in v3.2.0 and v3.1.1. (KAFK

Re: Newbie looking for a connector I can configure on my mac

Thanks Liam. What is 'FOSS Kafka'? google did not find any useful definitions A tutorial would be great! I would be happy to provide feed back https://docs.confluent.io/platform/current/connect/filestream_connector.html looks really helpful. Your list of connectors is very helpful. I wonde

Re: Newbie looking for a connector I can configure on my mac

FOSS == Free Open Source Software From: andrew davidson Date: Wednesday, March 30, 2022 at 3:16 PM To: users@kafka.apache.org Subject: [EXTERNAL] Re: Newbie looking for a connector I can configure on my mac Thanks Liam. What is 'FOSS Kafka'? google did not find any useful definitions A tutoria

Re: Newbie looking for a connector I can configure on my mac

Thanks Andy, and glad I could help somewhat :) I'll start writing something up over the next week, and will share the link here for feedback :) Just a caveat, the Filestream Connector could be considered a security risk in a production environment given its direct access to the filesystem. Not tha