[jira] [Resolved] (KAFKA-16887) document remote copy/fetch quotas metrics

[ https://issues.apache.org/jira/browse/KAFKA-16887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana resolved KAFKA-16887. Resolution: Fixed > document remote copy/fetch quotas metrics > --

[jira] [Created] (KAFKA-17324) Set config {{group.protocol}} to {{classic}} in Streams

Bruno Cadonna created KAFKA-17324: - Summary: Set config {{group.protocol}} to {{classic}} in Streams Key: KAFKA-17324 URL: https://issues.apache.org/jira/browse/KAFKA-17324 Project: Kafka Iss

Re: [DISCUSS] KIP-1075: Introduce delayed remote list offsets purgatory to make LIST_OFFSETS async

Hi Kamal, Thanks for the update. LC1: I see. Thanks. LC2: What I still don't understand is what is the relationship between remote.list.offsets.request.timeout.ms V.S. request.timeout/default.api.timeout. Suppose we set request timeout to 30 seconds, default.api.timeout=5 mins and remote.list.offs

Re: [VOTE]: KIP-1006: Remove SecurityManager Support

Hi Greg, Thanks for the KIP! This is important when we move to the new jdk version. Just a minor comment, could we make it much clearer in the compatibility section? Like in the 1st line, we can directly say, "this change is backward compatible", then explain if SecurityManager is unsupported, we

[jira] [Created] (KAFKA-17325) Clients : Revisit result handling in ShareConsumeRequestManager

Shivsundar R created KAFKA-17325: Summary: Clients : Revisit result handling in ShareConsumeRequestManager Key: KAFKA-17325 URL: https://issues.apache.org/jira/browse/KAFKA-17325 Project: Kafka

[jira] [Created] (KAFKA-17326) The LIST_OFFSET request is removed from the "Api Keys" page

Chia-Ping Tsai created KAFKA-17326: -- Summary: The LIST_OFFSET request is removed from the "Api Keys" page Key: KAFKA-17326 URL: https://issues.apache.org/jira/browse/KAFKA-17326 Project: Kafka

[jira] [Resolved] (KAFKA-17292) Add SHARE to group.coordinator.rebalance.protocols

[ https://issues.apache.org/jira/browse/KAFKA-17292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-17292. -- Resolution: Fixed > Add SHARE to group.coordinator.rebalance.protocols > -

[jira] [Resolved] (KAFKA-17225) Refactor consumer membership managers

[ https://issues.apache.org/jira/browse/KAFKA-17225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-17225. -- Resolution: Fixed > Refactor consumer membership managers > --

[jira] [Created] (KAFKA-17327) Add support of group in kafka-configs.sh

Lan Ding created KAFKA-17327: Summary: Add support of group in kafka-configs.sh Key: KAFKA-17327 URL: https://issues.apache.org/jira/browse/KAFKA-17327 Project: Kafka Issue Type: Improvement

Re: New release branch 3.9

Hi Colin, Just to make sure you (as a Release Manager) are aware of the change. ASF Infra just communicated the removal of the home.apache.org machines (in 4 weeks they will be gone). This means the release.py script wouldn't work if executed after that date and would need to be modified to store

[jira] [Created] (KAFKA-17328) Update Release.py script to point to dist.apache.org/dev

Josep Prat created KAFKA-17328: -- Summary: Update Release.py script to point to dist.apache.org/dev Key: KAFKA-17328 URL: https://issues.apache.org/jira/browse/KAFKA-17328 Project: Kafka Issue Ty

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #3196

See

[jira] [Created] (KAFKA-17329) Implement DefaultShareStatePersister

Sushant Mahajan created KAFKA-17329: --- Summary: Implement DefaultShareStatePersister Key: KAFKA-17329 URL: https://issues.apache.org/jira/browse/KAFKA-17329 Project: Kafka Issue Type: Sub-ta

[jira] [Created] (KAFKA-17330) Introduce share-coordinator module

Sushant Mahajan created KAFKA-17330: --- Summary: Introduce share-coordinator module Key: KAFKA-17330 URL: https://issues.apache.org/jira/browse/KAFKA-17330 Project: Kafka Issue Type: Sub-task

Re: [DISCUSS] KIP-1075: Introduce delayed remote list offsets purgatory to make LIST_OFFSETS async

Hi Luke, Thanks for the review! > LC2: a. If the time taken to process the request is less than 5 mins, then the Admin client will get a response. b. If the time taken to process the request is more than 5 mins, then the Admin client will itself timeout the request due to the default-api-timeout.

[jira] [Resolved] (KAFKA-17319) Update latestVersionUnstable of ListOffsetsRequest

[ https://issues.apache.org/jira/browse/KAFKA-17319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17319. Resolution: Fixed > Update latestVersionUnstable of ListOffsetsRequest > -

Re: [DISCUSS] KIP-1058: Txn consumer exerts pressure on remote storage when reading non-txn topic

Bumping this thread for KIP review! We can go for the simplest solution that is proposed in this KIP and it can be improved in the subsequent iteration. PTAL. Thanks, Kamal On Fri, Aug 2, 2024 at 11:42 AM Kamal Chandraprakash < kamal.chandraprak...@gmail.com> wrote: > Hi Divij, > > Thanks for t

[jira] [Resolved] (KAFKA-17309) Fix flaky testCallFailWithUnsupportedVersionExceptionDoesNotHaveConcurrentModificationException

[ https://issues.apache.org/jira/browse/KAFKA-17309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17309. Resolution: Fixed > Fix flaky > testCallFailWithUnsupportedVersionExceptionDoesNotHaveCon

[jira] [Created] (KAFKA-17331) Throw/return unsupported version exception if the server/client does NOT support EarliestLocalSpec and LatestTieredSpec

Chia-Ping Tsai created KAFKA-17331: -- Summary: Throw/return unsupported version exception if the server/client does NOT support EarliestLocalSpec and LatestTieredSpec Key: KAFKA-17331 URL: https://issues.apache.or

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.9 #31

See

Re: [DISCUSS] KIP-1082: Enable ID Generation for Clients over the ConsumerGroupHeartbeat RPC

hi TengYao thanks for this KIP. 1) could you please describe the before/after behavior in the "Proposed Changes" section? IIRC, current RPC allows HB having member id generated by client, right? If HB has no member ID, server will generate one and then return. The new behavior will enforce HB

Re: [VOTE] KIP-512: make Record Headers available in onAcknowledgement and onComplete

Hello Rich, Sorry for the late reply, but thanks for your answers on the discussion thread and updates, it makes sense to me and the final proposal looks right. +1 (non-binding) Thanks! Lianet On Mon, Aug 12, 2024 at 10:29 AM Andrew Schofield wrote: > Hi Rich, > Thanks for the KIP. Looks goo

Re: [DISCUSS] KIP-1071: Streams Rebalance Protocol

Hi Lucas, Thanks for the KIP update. I think that `kafka-streams-groups.sh` looks like a good equivalent to the tools for the other types of groups. AS12: In kafka-streams-groups.sh, the description for the --input-topics option seems insufficient. Why is an input topic specified with this option

Re: [DISCUSS] KIP-1082: Enable ID Generation for Clients over the ConsumerGroupHeartbeat RPC

Hi Chia-Ping, Thanks for review and suggestions. I have updated the content of KIP accordingly. Please take a look. Best regards, TengYao Chia-Ping Tsai 於 2024年8月13日 週二 下午9:45寫道： > hi TengYao > > thanks for this KIP. > > 1) could you please describe the before/after behavior in the "Proposed >

[jira] [Resolved] (KAFKA-16689) Move LogValidatorTest to storage module

[ https://issues.apache.org/jira/browse/KAFKA-16689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-16689. Fix Version/s: 4.0.0 Resolution: Fixed > Move LogValidatorTest to storage module >

[jira] [Created] (KAFKA-17332) Crash when dynamically removing the active controller

José Armando García Sancio created KAFKA-17332: -- Summary: Crash when dynamically removing the active controller Key: KAFKA-17332 URL: https://issues.apache.org/jira/browse/KAFKA-17332 Proj

[jira] [Created] (KAFKA-17333) KRaft notifies the controller of leadership too early

José Armando García Sancio created KAFKA-17333: -- Summary: KRaft notifies the controller of leadership too early Key: KAFKA-17333 URL: https://issues.apache.org/jira/browse/KAFKA-17333 Proj

Re: [DISCUSS] KIP-1082: Enable ID Generation for Clients over the ConsumerGroupHeartbeat RPC

Hi TengYao, Thanks for the KIP. I wonder if there’s a different way to close what is quite a small window. AS1: It is true that the initial heartbeat is not idempotent, but this remains true with this KIP. It’s just differently not idempotent. If the client makes its own member ID, sends a reques

[jira] [Resolved] (KAFKA-16682) Rewrite JassTestUtils by Java

[ https://issues.apache.org/jira/browse/KAFKA-16682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-16682. Fix Version/s: 4.0.0 Resolution: Fixed > Rewrite JassTestUtils by Java > --

[jira] [Created] (KAFKA-17334) Fix flaky TopicCommandIntegrationTest#testDescribeAtMinIsrPartitions

Chia-Ping Tsai created KAFKA-17334: -- Summary: Fix flaky TopicCommandIntegrationTest#testDescribeAtMinIsrPartitions Key: KAFKA-17334 URL: https://issues.apache.org/jira/browse/KAFKA-17334 Project: Kaf

[jira] [Resolved] (KAFKA-17247) Revised share group record schemas

[ https://issues.apache.org/jira/browse/KAFKA-17247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17247. Resolution: Fixed > Revised share group record schemas > -

[jira] [Created] (KAFKA-17335) Lack of default for missing URL encoding option for OAuth causes NPE

Kirk True created KAFKA-17335: - Summary: Lack of default for missing URL encoding option for OAuth causes NPE Key: KAFKA-17335 URL: https://issues.apache.org/jira/browse/KAFKA-17335 Project: Kafka

Re: [VOTE] KIP-932: Queues for Kafka

Hi, During the implementation of the group management code for KIP-932, we learnt that the decision not to persist assignments for share groups was making it difficult to fit with the coordinator framework, in particular the use of timeline structures. As a result, I decided to change the KIP to fo

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.9 #32

See

[jira] [Created] (KAFKA-17336) Add IT to make sure the production MV does not use unstable version of LIST_OFFSET

Chia-Ping Tsai created KAFKA-17336: -- Summary: Add IT to make sure the production MV does not use unstable version of LIST_OFFSET Key: KAFKA-17336 URL: https://issues.apache.org/jira/browse/KAFKA-17336

[jira] [Resolved] (KAFKA-17239) Kafka admin client doesn't report node request-latency metrics

[ https://issues.apache.org/jira/browse/KAFKA-17239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17239. Fix Version/s: 4.0.0 Resolution: Fixed > Kafka admin client doesn't report node req

[jira] [Reopened] (KAFKA-17308) Topic Replication failure :: Config properties exclude should be backwards compatible.

[ https://issues.apache.org/jira/browse/KAFKA-17308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai reopened KAFKA-17308: > Topic Replication failure :: Config properties exclude should be backwards > compatible. >

[jira] [Resolved] (KAFKA-17308) Topic Replication failure :: Config properties exclude should be backwards compatible.

[ https://issues.apache.org/jira/browse/KAFKA-17308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17308. Fix Version/s: (was: 3.7.1) Resolution: Won't Fix > Topic Replication failure :

[jira] [Created] (KAFKA-17337) Make CONSUMER group protocol default

Kirk True created KAFKA-17337: - Summary: Make CONSUMER group protocol default Key: KAFKA-17337 URL: https://issues.apache.org/jira/browse/KAFKA-17337 Project: Kafka Issue Type: Task Com

[jira] [Created] (KAFKA-17338) Add validation to ConsumerConfig to prevent using partition assignors with CONSUMER group protocol

Kirk True created KAFKA-17338: - Summary: Add validation to ConsumerConfig to prevent using partition assignors with CONSUMER group protocol Key: KAFKA-17338 URL: https://issues.apache.org/jira/browse/KAFKA-17338

Re: [VOTE] KIP-932: Queues for Kafka

Hi, Andrew, Thanks for the update. A couple of followup questions. 1. ShareGroupPartitionMetadataValue: Is NumPartitions redundant given PartitionMetadata? 2. I assume that ShareGroupPartitionMetadataValue contains initialized partitions. Does that make ShareGroupStatePartitionMetadataValue.Init

[jira] [Created] (KAFKA-17339) LocalLogManager should support RaftClient#schedulePreparedAppend

José Armando García Sancio created KAFKA-17339: -- Summary: LocalLogManager should support RaftClient#schedulePreparedAppend Key: KAFKA-17339 URL: https://issues.apache.org/jira/browse/KAFKA-17339

Build failed in Jenkins: Kafka » Kafka PowerPC Daily » test-powerpc #25

See Changes: -- [...truncated 552 lines...] [2024-08-13T23:40:13.229Z] > Task :metadata:classes [2024-08-13T23:40:13.229Z] > Task :raft:checkstyleMai

Hello fellow friends from Apache Kafka

As you might already know, there is the "Community Over Code NA" conference in October in Denver: https://communityovercode.org/. Together with Ismaël, for the 4th time in a row at 'Community Over Code" series of events we are chairing the Data Engineering track at the event. You can see all the t

Re: [DISCUSS] KIP-1075: Introduce delayed remote list offsets purgatory to make LIST_OFFSETS async

Hi Kamal, Thanks for the response. I saw we added some new configs/metrics. Comments: LC5: Do you think this is a commonly happened issue that we need to add a separate `remote.log.offset.reader.threads` for it? I thought this rarely happened. If so, maybe the additional config/metrics are not n

Re: [DISCUSS] KIP-1075: Introduce delayed remote list offsets purgatory to make LIST_OFFSETS async

Hi Luke, > LC5 Agree, this is a rare scenario. Given that we have a common pool of request handler threads to accept all the incoming requests and there are no quotas to handle for each request. I'm OK with reusing the same remote-log-reader threads for LIST_OFFSETS requests. There may be noisy ne

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #3199

See