[jira] [Created] (KAFKA-13311) MM2 should allow propagating arbitrary global configurations to the Connector config

Daniel Urban created KAFKA-13311: Summary: MM2 should allow propagating arbitrary global configurations to the Connector config Key: KAFKA-13311 URL: https://issues.apache.org/jira/browse/KAFKA-13311

Re: Contribution help please

Hi Jon, I checked your PR. I think you didn't set the "indent" correctly. It looks like your indent setting is to 2, but we use 4. Please update the setting in IntelliJ. REF: https://www.jetbrains.com/help/idea/reformat-and-rearrange-code.html Thank you. Luke On Mon, Sep 20, 2021 at 2:47 PM Jon M

Re: MM2 - Overriding MirrorSourceConnector Consumer & Producer values

Hi All,  Has anyone been able to override the producer and consumer values of the MM2 MirrorSourceConnector as described below? Many Thanks,  Jamie -Original Message- From: Jamie To: us...@kafka.apache.org Sent: Thu, 16 Sep 2021 15:52 Subject: MM2 - Overriding MirrorSourceConnector Con

[ANNOUNCE] Apache Kafka 2.8.1

The Apache Kafka community is pleased to announce the release for Apache Kafka 2.8.1 Apache Kafka 2.8.1 is a bugfix release and fixes 49 issues since the 2.8.0 release. Please see the release notes for more information. All of the changes in this release can be found in the release notes: https:/

[jira] [Created] (KAFKA-13312) 'NetworkDegradeTest#test_rate' should wait until iperf server is listening

David Jacot created KAFKA-13312: --- Summary: 'NetworkDegradeTest#test_rate' should wait until iperf server is listening Key: KAFKA-13312 URL: https://issues.apache.org/jira/browse/KAFKA-13312 Project: Kaf

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #480

See Changes: -- [...truncated 494098 lines...] [2021-09-20T09:21:13.524Z] ResetConsumerGroupOffsetTest > testResetOffsetsNotExistingGroup() STARTED [2021-09-20T09:21:15.779

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 2.8 #84

See

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #481

See

[VOTE] KIP-774: Deprecate public access to Admin client's *Result constructors

Hi, I'd like to start a vote for KIP-774 which proposes to deprecate public access to the Admin client's *Result constructors: https://cwiki.apache.org/confluence/display/KAFKA/KIP-774%3A+Deprecate+public+access+to+Admin+client%27s+*Result+constructors Thanks for your time, Tom

[jira] [Resolved] (KAFKA-10643) Static membership - repetitive PreparingRebalance with updating metadata for member reason

[ https://issues.apache.org/jira/browse/KAFKA-10643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eran Levy resolved KAFKA-10643. --- Resolution: Cannot Reproduce > Static membership - repetitive PreparingRebalance with updating metad

Re: [VOTE] KIP-774: Deprecate public access to Admin client's *Result constructors

Hi Tom, Thanks for the KIP. It's a +1 (non binding) from my side. Best, ——— Josep Prat Aiven Deutschland GmbH Immanuelkirchstraße 26, 10405 Berlin Amtsgericht Charlottenburg, HRB 209739 B Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen m: +491715557497 w: aiven.io e: josep.p...@aiven.io

[GitHub] [kafka-site] rhauch opened a new pull request #374: Change 2.8.0 downloads to use archives

rhauch opened a new pull request #374: URL: https://github.com/apache/kafka-site/pull/374 Now that 2.8.1 has been released, we can change the 2.8.0 download links to use the archive site. -- This is an automated message from the Apache Git Service. To respond to the message, please log o

Re: [ANNOUNCE] Apache Kafka 2.8.1

Thank you, David, for serving as the release manager for 2.8.1. Great work! And congratulations to the Apache Kafka community! Best regards, Randall On Mon, Sep 20, 2021 at 2:48 AM David Jacot wrote: > The Apache Kafka community is pleased to announce the release for > Apache Kafka 2.8.1 > >

[GitHub] [kafka-site] rhauch merged pull request #374: Change 2.8.0 downloads to use archives

rhauch merged pull request #374: URL: https://github.com/apache/kafka-site/pull/374 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr..

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.0 #135

See Changes: -- [...truncated 482813 lines...] [Pipeline] // node [Pipeline] } [Pipeline] // timestamps [Pipeline] } [Pipeline] // timeout [Pipeline] } [Pipeline] // stage [Pi

[jira] [Resolved] (KAFKA-13254) Deadlock when expanding ISR

[ https://issues.apache.org/jira/browse/KAFKA-13254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-13254. - Resolution: Fixed > Deadlock when expanding ISR > --- > >

Re: [DISCUSS] KIP-714: Client metrics and observability

LGTM in terms of RPC separation and the new SubscriptionId to detect target metric change on the server side. On Tue, Sep 14, 2021 at 12:48 AM Magnus Edenhill wrote: > Thanks for your feedback Colin, see my updated proposal below. > > > Den tors 22 juli 2021 kl 03:17 skrev Colin McCabe : > > > O

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #482

See Changes: -- [...truncated 4438 lines...] [2021-09-20T16:53:18.402Z] [Warn] /home/jenkins/jenkins-agent/workspace/Kafka_kafka_trunk@2/core/src/test/scala/unit/kafka/log/

Re: [DISCUSS] KIP-776: Add Consumer#peek for debugging/tuning

Thanks Luke for the KIP. I think it makes sense. @Boyang, While it is possible to get the functionality using manual offset commit + offset position rewind as you stated, IMHO it could still be a very handy addition to the APIs. The way I see it, manual offset commit + offset position rewind is

Re: [DISCUSS] KIP-770: Replace "buffered.records.per.partition" with "input.buffer.max.bytes"

Hi All, Bumping this thread again. Thanks! Sagar. On Sat, Sep 11, 2021 at 2:04 PM Sagar wrote: > Hi Mathias, > > I missed out on the metrics part. > > I have added the new metric in the proposed changes section along with the > small re-wording that you talked about. > > Let me know if that ma

[jira] [Created] (KAFKA-13313) In KRaft mode, CreateTopic should return the topic configs in the response

Jun Rao created KAFKA-13313: --- Summary: In KRaft mode, CreateTopic should return the topic configs in the response Key: KAFKA-13313 URL: https://issues.apache.org/jira/browse/KAFKA-13313 Project: Kafka

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #483

See Changes: -- [...truncated 4430 lines...] [2021-09-20T17:54:38.822Z] You can use '--warning-mode all' to show the individual deprecation warnings and determine if they c

Re: [DISCUSS] KIP-714: Client metrics and observability

On Tue, Sep 14, 2021, at 00:47, Magnus Edenhill wrote: > Thanks for your feedback Colin, see my updated proposal below. > ... Hi Magnus, Thanks for the update. > > Splitting up the API into separate data and control requests makes sense. > With a split we would have one API for querying the bro

Re: [DISCUSS] KIP-714: Client metrics and observability

Some comments about subscriptionId. On Mon, Sep 20, 2021 at 11:41 AM Colin McCabe wrote: > On Tue, Sep 14, 2021, at 00:47, Magnus Edenhill wrote: > > Thanks for your feedback Colin, see my updated proposal below. > > ... > > Hi Magnus, > > Thanks for the update. > > > > > Splitting up the API in

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.0 #136

See

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #484

See Changes: -- [...truncated 492733 lines...] [2021-09-20T21:53:01.176Z] > Task :connect:json:testJar [2021-09-20T21:53:01.176Z] > Task :connect:json:testSrcJar [2021-09-20

Re: [DISCUSS] KIP-770: Replace "buffered.records.per.partition" with "input.buffer.max.bytes"

Hi Sagar, Thanks for the added metrics, about its name, if it is proposed as a task-level config, then we do not need to prefix its name as `task-`. But on the other hand, it's better to give the full description of the metrics, like its type name / tag maps / recording levels etc, an example is h

Re: [DISCUSS] KIP-714: Client metrics and observability

Thanks Magnus & Colin for the discussion. Based on KIP-714's stateless design, Client can pretty much use any connection to any broker to send metrics. We are not associating connection with client metric state. Is my understanding correct? If yes, how about the following two scenarios 1) One Cl

Re: [DISCUSS] KIP-775: Custom partitioners in foreign key joins

Hi Matthias, Thanks for having a look at the KIP! I've updated it with your suggestion to introduce a new `TableJoined` object with partitioners of type `StreamPartitioner` and `StreamPartitioner`, and to deprecate the existing FK join methods which accept a `Named` object accordingly. I agree it

Re: [DISCUSS] KIP-714: Client metrics and observability

On Mon, Sep 20, 2021, at 12:30, Feng Min wrote: > Some comments about subscriptionId. > > ApiVersion is not a good example. API Version here is actually acting like > an identifier as the client will carry this information. Forcing to > disconnect a connection from the server side is quite heavy. I

Re: [DISCUSS] KIP-714: Client metrics and observability

On Mon, Sep 20, 2021, at 17:35, Feng Min wrote: > Thanks Magnus & Colin for the discussion. > > Based on KIP-714's stateless design, Client can pretty much use any > connection to any broker to send metrics. We are not associating connection > with client metric state. Is my understanding correct?

Re: [DISCUSS] KIP-714: Client metrics and observability

Hi Colin, It was just analogy to say api version is similar to subscription Id. Every request come with api version information, broker can return an error if supported api version has been changed. It’s similar to the role of subscriptionid here. Thanks, Feng On Mon, Sep 20, 2021 at 9:51 PM C

Re: [DISCUSS] KIP-775: Custom partitioners in foreign key joins

Thanks for updating the KIP. One nit: The existing methods which accept Named will be marked for deprecation in 4.0. We can skip `in 4.0`. (1) The next release will be 3.1 (not 4.0) and (2) a KIP could always slip into a future release. About `TableJoined`: It seems you propose to add sta