[jira] [Resolved] (KAFKA-17449) Move Quota classes to server-common module

2024-08-30 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17449. Fix Version/s: 4.0.0 Resolution: Fixed > Move Quota classes to server-common module

[jira] [Resolved] (KAFKA-17433) Add a CI job to run a single test N times

2024-08-30 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17433. Fix Version/s: 4.0.0 Resolution: Fixed > Add a CI job to run a single test N times

Re: [DISCUSS] KIP-1076: Metrics for client applications a KIP-714 extension

2024-08-30 Thread Matthias J. Sax
Thanks Bill. The KIP reads great. Overall LGTM. Just one question out of curiosity. Why did you switch from passing in a `Collection` to a single metric? -Matthias On 8/26/24 3:22 PM, Bill Bejeck wrote: All, I had originally planned to call for a vote, but during some early implementation

Re: [EXT] Re: [VOTE] KIP-1033: Add Kafka Streams exception handler for exceptions occurring during processing

2024-08-30 Thread Matthias J. Sax
Guess it is a question for Colin, who is the RM for 3.9. -Matthias On 8/30/24 2:02 AM, Sebastien Viale wrote: Hi, All PRs related to KIP-1033 have been merged. However, after a last review from Matthias J. Sax and Bill Bejeck, we updated the KIP to include the timestamp in the ErrorHandl

Re: [DISCUSS] KIP-655: Add deduplication processor in kafka-streams

2024-08-30 Thread Matthias J. Sax
Thanks for updating the KIP. A few comments/question: (100): For `deduplicateByKey(...)` the input stream might still be repartitioned if the key was changed upstream, right (similar to how `groupByKey()` and `join()` works)? builder.stream(...).deduplicateByKey(); // no repartitioing

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #3252

2024-08-30 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-1081: Graduation Steps for Features

2024-08-30 Thread Matthias J. Sax
Great discussion. Also wanted to follow up with a few things. I believe the term "usable" is not well defined leading to confusion... I agree with Viktor that "usable" in the context of level 2 should just mean: I can enable the feature and it does something... not more, not less. It might cr

Re: [DISCUSS] KIP-1050: Consistent error handling for Transactions

2024-08-30 Thread Justine Olshan
Hey Matthias, 102/103) Sorry for the confusion on the TransactionAbortableException. Here is the error -- we have an error name and an exception name -- this is the same error mentioned in KIP-890. It is also implemented so that new clients throw this error when transaction verification fails. htt

Re: [DISCUSS] KIP-1050: Consistent error handling for Transactions

2024-08-30 Thread Matthias J. Sax
Thanks for updating the KIP. It's much clearer now what you propose. I have a bunch of question about the proposal: (100) nit (typo / missing word?): We would new error types (101) `TransactionAbortableException`, `ProducerFencedException`, and `UnknownProducerIdException` are listed tw

[jira] [Created] (KAFKA-17455) `TaskCorruptedException` After Client Quota Throttling

2024-08-30 Thread Colt McNealy (Jira)
Colt McNealy created KAFKA-17455: Summary: `TaskCorruptedException` After Client Quota Throttling Key: KAFKA-17455 URL: https://issues.apache.org/jira/browse/KAFKA-17455 Project: Kafka Issue

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #3251

2024-08-30 Thread Apache Jenkins Server
See

Re: New release branch 3.9

2024-08-30 Thread Chia-Ping Tsai
hi Colin I open the https://issues.apache.org/jira/browse/KAFKA-17454 to be a blocker for 3.9 since the e2e transactions_mixed_versions_test fail on 3.9 definitely We will fix it tomorrow. Best, Chia-Ping On 2024/08/30 15:38:48 Colin McCabe wrote: > No worries. Thanks for checking. > > best,

[jira] [Created] (KAFKA-17454) Fix failed transactions_mixed_versions_test.py when running with 3.2

2024-08-30 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-17454: -- Summary: Fix failed transactions_mixed_versions_test.py when running with 3.2 Key: KAFKA-17454 URL: https://issues.apache.org/jira/browse/KAFKA-17454 Project: Kaf

[jira] [Created] (KAFKA-17453) Fix flaky PlaintextConsumerFetchTest#testFetchOutOfRangeOffsetResetConfigLatest

2024-08-30 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-17453: -- Summary: Fix flaky PlaintextConsumerFetchTest#testFetchOutOfRangeOffsetResetConfigLatest Key: KAFKA-17453 URL: https://issues.apache.org/jira/browse/KAFKA-17453 P

[jira] [Created] (KAFKA-17452) Fix flaky QuorumControllerTest#testUncleanShutdownBroker

2024-08-30 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-17452: -- Summary: Fix flaky QuorumControllerTest#testUncleanShutdownBroker Key: KAFKA-17452 URL: https://issues.apache.org/jira/browse/KAFKA-17452 Project: Kafka

Re: [ANNOUNCE] New committer: Lianet Magrans

2024-08-30 Thread Colin McCabe
Congratulations, Lianet! best, Colin On Fri, Aug 30, 2024, at 04:46, Igor Soarez wrote: > Congratulations Lianet! > > -- > Igor

Re: [DISCUSS] KIP-1081: Graduation Steps for Features

2024-08-30 Thread Colin McCabe
On Mon, Aug 26, 2024, at 10:51, Josep Prat wrote: > Hi Colin, > > Names are in the KIP. Level 1 to 4 are never meant to be used outside of > this discussion. It's my, apparently successful, attempt to focus on what > the levels mean instead of their names: > >> Names > > "In Development" >

Re: [VOTE] KIP-1042: Support for wildcard when creating new acls

2024-08-30 Thread Colin McCabe
Hi Claude, I think this is great work. Speeding up the Authorizer will be a big win for us. I don't think we need to add additional interfaces for this, though. Just get rid of the old slower implementation that I wrote, and replace it with your newer, faster one. Also, I think we should conti

Re: New release branch 3.9

2024-08-30 Thread Colin McCabe
No worries. Thanks for checking. best, Colin On Thu, Aug 29, 2024, at 19:00, Kirk True wrote: > Thanks Chia-Ping! > > Sorry for the noise, everyone else :) > >> On Aug 29, 2024, at 6:36 PM, Chia-Ping Tsai wrote: >> >> hi Kirk >> >> I have updated the fix versions of KAFKA-17335 to include 3.9

[jira] [Created] (KAFKA-17451) Remove deprecated Consumer#committed

2024-08-30 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-17451: -- Summary: Remove deprecated Consumer#committed Key: KAFKA-17451 URL: https://issues.apache.org/jira/browse/KAFKA-17451 Project: Kafka Issue Type: Sub-task

[jira] [Resolved] (KAFKA-15909) Throw error when consumer configured with empty/whitespace-only group.id for LegacyKafkaConsumer

2024-08-30 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-15909. Resolution: Fixed > Throw error when consumer configured with empty/whitespace-only group.

[jira] [Resolved] (KAFKA-17386) Remove broker-list, threads, num-fetch-threads in ConsumerPerformance

2024-08-30 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17386. Fix Version/s: 4.0.0 Resolution: Fixed > Remove broker-list, threads, num-fetch-thr

Re: [DISCUSS] KIP-1082: Enable ID Generation for Clients over the ConsumerGroupHeartbeat RPC

2024-08-30 Thread Chia-Ping Tsai
hi TengYao KT2: +1 to second approach Best, Chia-Ping David Jacot 於 2024年8月30日 週五 下午9:15寫道: > Hi TengYao, > > KT2: I don't think that we can realistically validate the uuid on the > server. It is basically a string of chars. So I lean towards having a good > recommendation in the KIP and in t

Re: [DISCUSS] KIP-1034: Dead letter queue in Kafka Streams

2024-08-30 Thread Damien Gasparina
Hi everyone, We just updated KIP-1034, we changed the following: - We included the ProcessingExceptionHandler (KIP-1033) directly in the KIP; - We provided examples to clarify the new configuration, and how it could be leveraged. I think we can resume the conversation on this KIP. Cheers, Da

[jira] [Created] (KAFKA-17450) Optimise the handler methods in ShareConsumeRequestManager.

2024-08-30 Thread Shivsundar R (Jira)
Shivsundar R created KAFKA-17450: Summary: Optimise the handler methods in ShareConsumeRequestManager. Key: KAFKA-17450 URL: https://issues.apache.org/jira/browse/KAFKA-17450 Project: Kafka

Re: [DISCUSS] KIP-1082: Enable ID Generation for Clients over the ConsumerGroupHeartbeat RPC

2024-08-30 Thread David Jacot
Hi TengYao, KT2: I don't think that we can realistically validate the uuid on the server. It is basically a string of chars. So I lean towards having a good recommendation in the KIP and in the document of the field in the RPC's definition. Best, David On Fri, Aug 30, 2024 at 3:02 PM TengYao Chi

[jira] [Created] (KAFKA-17449) Move Quota classes to server module

2024-08-30 Thread Mickael Maison (Jira)
Mickael Maison created KAFKA-17449: -- Summary: Move Quota classes to server module Key: KAFKA-17449 URL: https://issues.apache.org/jira/browse/KAFKA-17449 Project: Kafka Issue Type: Sub-task

Re: [DISCUSS] KIP-1082: Enable ID Generation for Clients over the ConsumerGroupHeartbeat RPC

2024-08-30 Thread TengYao Chi
Hello Kirk ! Thank you for your comments ! KT1: Yes, you are correct. The issue is not unique to the initial heartbeat; there can always be cases where the broker might lose connection with a member. KT2: Currently, if the client doesn't have a member ID and the memberEpoch equals 0, the coordin

Re: [ANNOUNCE] New committer: Lianet Magrans

2024-08-30 Thread Igor Soarez
Congratulations Lianet! -- Igor

[jira] [Created] (KAFKA-17448) New consumer seek should update positions in background thread

2024-08-30 Thread Lianet Magrans (Jira)
Lianet Magrans created KAFKA-17448: -- Summary: New consumer seek should update positions in background thread Key: KAFKA-17448 URL: https://issues.apache.org/jira/browse/KAFKA-17448 Project: Kafka

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #3250

2024-08-30 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-16968) Make 3.8-IV0 a stable MetadataVersion and create 3.9-IV0

2024-08-30 Thread TaiJuWu (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TaiJuWu resolved KAFKA-16968. - Resolution: Fixed > Make 3.8-IV0 a stable MetadataVersion and create 3.9-IV0 > -

[jira] [Created] (KAFKA-17447) Changed fetch queue processing to reduce the no. of locking and unlocking activity

2024-08-30 Thread Abhinav Dixit (Jira)
Abhinav Dixit created KAFKA-17447: - Summary: Changed fetch queue processing to reduce the no. of locking and unlocking activity Key: KAFKA-17447 URL: https://issues.apache.org/jira/browse/KAFKA-17447

Re: [DISCUSS] KIP-655: Add deduplication processor in kafka-streams

2024-08-30 Thread Ayoub Omari
Hi Bill, Thanks for your answer. > Can you update the KIP to state that deduplication by value will result in > auto-repartiting by Kafka Streams Updated the KIP to the latest proposal. > For option 3, what about `deduplicateByKeyValue`? (If during the PR phase > we stumble across a better name

RE: [EXT] Re: [VOTE] KIP-1033: Add Kafka Streams exception handler for exceptions occurring during processing

2024-08-30 Thread Sebastien Viale
Hi, All PRs related to KIP-1033 have been merged. However, after a last review from Matthias J. Sax and Bill Bejeck, we updated the KIP to include the timestamp in the ErrorHandlerContext interface. A new PR has been initialized. KAFKA-16448 Add timestamp to error handler context (https://gith

Re: [VOTE] KIP-1042: Support for wildcard when creating new acls

2024-08-30 Thread Claude Warren, Jr
I made it easier to replace the existing StandardAuthorizerData with a different implementation in order show the Trie implementation met all the requirements of the StandardAuthorizerData and could be replaced without changing the StandardAuthorizer implementation. Replacing the current StandardA