[jira] [Resolved] (KAFKA-15061) CoordinatorPartitionWriter should reuse buffer

2023-12-04 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-15061. - Fix Version/s: 3.7.0 Resolution: Fixed > CoordinatorPartitionWriter should reuse buffer >

[jira] [Created] (KAFKA-15972) Add support to exclude labels in client telemetry

2023-12-04 Thread Apoorv Mittal (Jira)
Apoorv Mittal created KAFKA-15972: - Summary: Add support to exclude labels in client telemetry Key: KAFKA-15972 URL: https://issues.apache.org/jira/browse/KAFKA-15972 Project: Kafka Issue Typ

Re: [VOTE] 3.6.1 RC0

2023-12-04 Thread Justine Olshan
Not sure if all folks can see this link but the results are here: https://confluent-kafka-branch-builder-system-test-results.s3-us-west-2.amazonaws.com/system-test-kafka-branch-builder--1701739886--apache--3.6--ec5faaa90d/2023-12-04--001./2023-12-04--001./report.html Looks like there were a few f

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2447

2023-12-04 Thread Apache Jenkins Server
See Changes: -- [...truncated 334458 lines...] > Task :connect:json:publishMavenJavaPublicationToMavenLocal > Task :connect:json:publishToMavenLocal > Task :server:compileT

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.6 #124

2023-12-04 Thread Apache Jenkins Server
See

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2446

2023-12-04 Thread Apache Jenkins Server
See Changes: -- [...truncated 129942 lines...] > Task :server:compileTestJava > Task :server:testClasses > Task :server-common:compileTestJava > Task :server-common:testCla

Re: [DISCUSS] KIP-967: Support custom SSL configuration for Kafka Connect RestServer

2023-12-04 Thread Greg Harris
Hi Chris, Thank you for your comments above. I disagree with your recommendation for a new SslEngineFactory variant/hierarchy. 1. A superinterface could be more confusing to users. Since this is an interface in `clients`, the connect-specific interface would also need to be in clients, despite be

Re: [VOTE] 3.6.1 RC0

2023-12-04 Thread Justine Olshan
Just wanted to give an update on the system tests since I said I started mine last week. I accidentally misconfigured my build, so I restarted them today. I should have results and if things look good, I should be able to make a vote early tomorrow. Justine On Mon, Dec 4, 2023 at 1:55 PM David Ar

Re: [VOTE] 3.6.1 RC0

2023-12-04 Thread David Arthur
I have a fix for KAFKA-15968 here https://github.com/apache/kafka/pull/14919/. After a bit of digging, I found that this behavior has existed in the KRaft controller since the beginning, so it is not a regression. Another thing I observed while i

Re: [DISCUSS] KIP-967: Support custom SSL configuration for Kafka Connect RestServer

2023-12-04 Thread Chris Egerton
Hi Taras, Regarding slimming down the interface: IMO, we should do this right the first time, and that includes not requiring unnecessary methods from users. I think BaseSslEngineFactory is good enough as a superinterface. Regarding the parsing logic: I think the KIP needs to be more explicit. W

[jira] [Resolved] (KAFKA-15533) Ensure HeartbeatRequestManager only send out some fields once

2023-12-04 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-15533. -- Resolution: Resolved Already resolved > Ensure HeartbeatRequestManager only send out

[jira] [Created] (KAFKA-15971) Re-enable consumer integration tests for new consumer

2023-12-04 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-15971: Summary: Re-enable consumer integration tests for new consumer Key: KAFKA-15971 URL: https://issues.apache.org/jira/browse/KAFKA-15971 Project: Kafka

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2445

2023-12-04 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-15970) KIP-951, port newly added tests in FetcherTest.java to FetchRequestManagerTest.ajva

2023-12-04 Thread Mayank Shekhar Narula (Jira)
Mayank Shekhar Narula created KAFKA-15970: - Summary: KIP-951, port newly added tests in FetcherTest.java to FetchRequestManagerTest.ajva Key: KAFKA-15970 URL: https://issues.apache.org/jira/browse/KAFKA-15

[jira] [Resolved] (KAFKA-15965) Test failure: org.apache.kafka.common.requests.BrokerRegistrationRequestTest

2023-12-04 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-15965. - Fix Version/s: 3.7.0 Assignee: Colin McCabe Resolution: Fixed This is fixed by https://g

Re: [VOTE] KIP-858: Handle JBOD broker disk failure in KRaft

2023-12-04 Thread Igor Soarez
Hi Viktor, Thanks for pointing this out. I forgot to make this clear in the KIP. I'll update it. ClusterAction on Cluster resource is exactly right, see `ControllerApis.handleAssignReplicasToDirs`. [1] -- Igor [1]: https://github.com/apache/kafka/pull/14863/files#diff-91060c918c99d25342f625c1

Re: [VOTE] KIP-858: Handle JBOD broker disk failure in KRaft

2023-12-04 Thread Colin McCabe
Yes, this should be CLUSTER_ACTION on CLUSTER, to be consistent with our other internal RPCs. best, Colin On Mon, Dec 4, 2023, at 04:28, Viktor Somogyi-Vass wrote: > Hi Igor, > > I'm just reading through your KIP and noticed that the new protocol you > created doesn't say anything about ACLs of

[jira] [Created] (KAFKA-15969) Align RemoteStorageThreadPool metrics name with KIP-405

2023-12-04 Thread Lixin Yao (Jira)
Lixin Yao created KAFKA-15969: - Summary: Align RemoteStorageThreadPool metrics name with KIP-405 Key: KAFKA-15969 URL: https://issues.apache.org/jira/browse/KAFKA-15969 Project: Kafka Issue Type:

Re: [DISCUSS] KIP-997 Support fetch(fromKey, toKey, from, to) to WindowRangeQuery and unify WindowKeyQuery and WindowRangeQuery

2023-12-04 Thread Hanyu (Peter) Zheng
Thank you Alieh, After discussion with Matthias, we decide use oldTimeFrom and oldTimeTo(these two will Deprecated soom) to implement withWindowStartRange() and use timeFrom and timeTo to implement withAllKey() and withKeyRange(), I will update the KIP. Sincerely, Hanyu On Sun, Dec 3, 2023 at 3:

Re: [VOTE] 3.6.1 RC0

2023-12-04 Thread David Arthur
Mickael, I just filed https://issues.apache.org/jira/browse/KAFKA-15968 while investigating a log corruption issue on the controller. I'm still investigating the issue to see how far back this goes, but I think this could be a blocker. Essentially, the bug is that the controller does not treat a

Re: [DISCUSS] KIP-1004: Enforce tasks.max property in Kafka Connect

2023-12-04 Thread Chris Egerton
Hi all, It seems like there are no objections to this KIP, so I've kicked off a vote thread: https://lists.apache.org/thread/dgq332o5j25rwddbvfydf7ttrclldw17 Cheers, Chris On Fri, Nov 24, 2023 at 10:39 PM Chris Egerton wrote: > Hi Yash, > > Thanks for taking a look! Yeah, it looks like we'll

[VOTE] KIP-1004: Enforce tasks.max property in Kafka Connect

2023-12-04 Thread Chris Egerton
Hi all, I'd like to call for a vote on KIP-1004, which adds enforcement for the tasks.max connector property in Kafka Connect. The KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-1004%3A+Enforce+tasks.max+property+in+Kafka+Connect The discussion thread: https://lists.apache.org/thread

[jira] [Created] (KAFKA-15968) QuorumController does not treat CorruptRecordException as fatal

2023-12-04 Thread David Arthur (Jira)
David Arthur created KAFKA-15968: Summary: QuorumController does not treat CorruptRecordException as fatal Key: KAFKA-15968 URL: https://issues.apache.org/jira/browse/KAFKA-15968 Project: Kafka

Re: [DISCUSS] KIP-995: Allow users to specify initial offsets while creating connectors

2023-12-04 Thread Chris Egerton
Oh, one more thing--can we add the KIP to the list of KIPs? https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals#KafkaImprovementProposals-KIPsunderdiscussion On Mon, Dec 4, 2023 at 10:33 AM Chris Egerton wrote: > Hi Ashwin, > > Thanks for the KIP! This would be a nice s

Re: [DISCUSS] KIP-995: Allow users to specify initial offsets while creating connectors

2023-12-04 Thread Chris Egerton
Hi Ashwin, Thanks for the KIP! This would be a nice simplification to the process for migrating connectors enabled by KIP-980, and would also add global support for a feature I've seen implemented by hand in at least a couple connectors over the years. High-level thoughts: 1. If there are lefto

Re: [DISCUSS] KIP-971 Expose replication-offset-lag MirrorMaker2 metric

2023-12-04 Thread Viktor Somogyi-Vass
Elkhan, do you want to propose a vote for this KIP or do you have any other ideas to include? On Tue, Oct 17, 2023 at 2:47 PM Viktor Somogyi-Vass < viktor.somo...@cloudera.com> wrote: > Hi hudeqi, > > Good thinking about the OOM and resource leaks. > The "update.replication.lag.interval.time" I t

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2444

2023-12-04 Thread Apache Jenkins Server
See

Re: [VOTE] KIP-858: Handle JBOD broker disk failure in KRaft

2023-12-04 Thread Viktor Somogyi-Vass
Hi Igor, I'm just reading through your KIP and noticed that the new protocol you created doesn't say anything about ACLs of the new AssignReplicasToDirs API. Would it make sense to authorize these requests as other inter-broker protocol calls are usually authorized, that is ClusterAction on Cluste

Re: [VOTE] 3.6.1 RC0

2023-12-04 Thread Luke Chen
Hi Mickael: I did: 1. Validated all checksums, signatures, and hashes 2. Ran quick start for KRaft using scala 2.12 artifacts 3. Spot checked the documentation and Javadoc 4. Validated the licence file When running the validation to scala 2.12 package, I found these libraries are miss

[jira] [Created] (KAFKA-15967) Fix revocation in reconcilation logic

2023-12-04 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-15967: -- Summary: Fix revocation in reconcilation logic Key: KAFKA-15967 URL: https://issues.apache.org/jira/browse/KAFKA-15967 Project: Kafka Issue Type: Sub-tas

[jira] [Resolved] (KAFKA-15690) EosIntegrationTest is flaky.

2023-12-04 Thread Lucas Brutschy (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lucas Brutschy resolved KAFKA-15690. Resolution: Fixed > EosIntegrationTest is flaky. > > >

Re: [REVIEW REQUEST] ConsumerGroupCommand move to tools

2023-12-04 Thread Николай Ижиков
Hello. Dear Kafka committers. As far as I know - we moving Kafka from scala to java. I prepared a series of PRs to move `ConsumerGroupCommand` from scala to java. From my experience, right now, Mickael Maison and Justine Olshan are overwhelmed with other activities and can review my patches from

[jira] [Resolved] (KAFKA-14438) Throw error when consumer configured with empty/whitespace-only group.id for AsyncKafkaConsumer

2023-12-04 Thread Bruno Cadonna (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruno Cadonna resolved KAFKA-14438. --- Resolution: Fixed > Throw error when consumer configured with empty/whitespace-only group.id