Re: [PROPOSAL] Add commercial support page on website

2024-01-11 Thread Francois Papon
Hi Justine, You're right, Kafka is a part of my business (training, consulting, architecture design, sla...) and most of the time, users/customers said that it was hard for them to find a commercial support (in France for my case) after searching on the Kafka website (Google didn't help them).

Re: Mirror Maker bidirectional offset sync

2024-01-11 Thread Ryanne Dolan
> b.a.replicate-me-0 That's actually impossible with MM2. It won't allow such topics. It would be pointless to replicate data from A back to A, or from B back to B. The data is already there. MM2's replication logic is significantly more advanced than just adding a prefix. Tho it does appear that

Re: [PROPOSAL] Add commercial support page on website

2024-01-11 Thread fpapon
Hi Chris, I never said that the Apache Kafka community "has to" provide this kind of page and it's not an official policy of the ASF. I just listed other projects to show that this is something that already exist so this is potentially something that could be good for the community of an ASF

Re: [PROPOSAL] Add commercial support page on website

2024-01-11 Thread Chris Egerton
Hi François, Is it an official policy of the ASF that projects provide a listing of commercial support options for themselves? I understand that other projects have chosen to provide one, but this doesn't necessarily imply that all projects should do the same, and I can't say I find this point ver

Re: [PROPOSAL] Add commercial support page on website

2024-01-11 Thread fpapon
Hi Justine, I'm not sure to see the difference between "happy users" and vendors that advertise their products in some of the company list in the "powered by" page. Btw, my initial purpose of my proposal was to help user to find support for production stuff rather than searching in google.

Re: Mirror Maker bidirectional offset sync

2024-01-11 Thread Greg Harris
Hey Jeroen, Thanks for sharing your prototype! It is very interesting! > I couldn't reproduce your hypothesis. I think my hypothesis was for another setup which didn't involve code changes, and instead relied on A->B->A round trip replication to produce the "backwards" offset syncs. I believe th

[VOTE] 3.7.0 RC2

2024-01-11 Thread Stanislav Kozlovski
Hello Kafka users, developers, and client-developers, This is the first candidate for release of Apache Kafka 3.7.0. Note it's named "RC2" because I had a few "failed" RCs that I had cut/uploaded but ultimately had to scrap prior to announcing due to new blockers arriving before I could even anno

Re: Mirror Maker bidirectional offset sync

2024-01-11 Thread Jeroen Schutrup
I see, makes complete sense to me. I built a custom version [1] based off of Kafka 3.5.1 with bidirectional offset replication enabled so I could do some more testing. Offset translation back upstream works well; I think because of the reason Ryanne pointed out, both topics contain identical data.

Re: [PROPOSAL] Add commercial support page on website

2024-01-11 Thread fpapon
Hi, About the vendors list and neutrality, what is the policy of the "Powered by" page? https://kafka.apache.org/powered-by We can see company with logo, some are talking about their product (Agoora), some are offering services (Instaclustr, Aiven), and we can also see some that just put th

Re: Mirror Maker bidirectional offset sync

2024-01-11 Thread Greg Harris
Hey Ryanne, Thanks for the context, but I still don't see the situation where this function is helpful. Also "A's topic1 and B's a.topic1 should be the same data (minus replication lag)." isn't true in the presence of failures/hard restarts, compaction, and transaction markers. Thanks, Greg On

Re: [PROPOSAL] Add commercial support page on website

2024-01-11 Thread Kenneth Eversole
I agree with Divji here and to be more pointed. I worry that if we go down the path of adding vendors to a list it comes off as supporting their product, not to mention could be a huge security risk for novice users. I would rather this be a callout to other purely open source tooling, such as crui

KAfka and syslog

2024-01-11 Thread Francisco Serrano
Hello, Is possble integrate one network devices to send syslog messages to Kafka ?

During cluster peak, KAFKA NetworkProcessorAvgIdlePercent is lower than 0.2

2024-01-11 Thread dong yu
This is my problem 1.The request queue is always at 500 2.NetworkProcessorAvgIdlePercent is lower than 0.2 This is my BROKER configuration num.io.threads=32 num.network.threads=64 How have I identified the cause and how to optimize my KAFKA cluster? THKS。

Re: [PROPOSAL] Add commercial support page on website

2024-01-11 Thread fpapon
Hi, The purpose is not to mention or list vendor, it's not a page to list product based on Apache Kafka. The purpose is to list companies that offer support for production, training or consulting only on Apache Kafka. It's a common use case where users are looking for a commercial support an