[DISCUSS] KIP-1098: Reverse Checkpointing

2024-10-18 Thread Dániel Urbán
Hi everyone, I'd like to start the discussion on KIP-1098: Reverse Checkpointing ( https://cwiki.apache.org/confluence/display/KAFKA/KIP-1098%3A+Reverse+Checkpointing) which aims to minimize message reprocessing for consumers in failbacks. TIA, Daniel

Re: [DISCUSS] KIP-1098: Reverse Checkpointing

2024-10-18 Thread Viktor Somogyi-Vass
Hey Dan, I think this is a very useful idea. Two questions: SVV1: Do you think we need the feature flag at all? I know that not having this flag may technically render the KIP unnecessary (however it may still be useful to discuss this topic and create a concensus). As you wrote in the KIP, we ma

Re: [VOTE] KIP-1073: Return fenced brokers in DescribeCluster response

2024-10-18 Thread Gantigmaa Selenge
Hi, I have raised a draft PR implementing this KIP here: https://github.com/apache/kafka/pull/17524, in case anyone is interested in taking a look. Regards, Tina On Mon, Oct 7, 2024 at 12:53 PM Gantigmaa Selenge wrote: > Thank you for voting Federico and Luke! > > Is there anyone else who woul

[jira] [Resolved] (KAFKA-17447) Changed fetch queue processing to reduce the no. of locking and unlocking activity

2024-10-18 Thread Apoorv Mittal (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apoorv Mittal resolved KAFKA-17447. --- Resolution: Fixed > Changed fetch queue processing to reduce the no. of locking and unlockin

[jira] [Resolved] (KAFKA-17654) Fix flaky ProducerIdManagerTest#testUnrecoverableErrors

2024-10-18 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17654. Fix Version/s: 4.0.0 Resolution: Fixed > Fix flaky ProducerIdManagerTest#testUnreco

[jira] [Created] (KAFKA-17835) Move ProducerIdManager and RPCProducerIdManager to server module

2024-10-18 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-17835: -- Summary: Move ProducerIdManager and RPCProducerIdManager to server module Key: KAFKA-17835 URL: https://issues.apache.org/jira/browse/KAFKA-17835 Project: Kafka

[jira] [Created] (KAFKA-17833) Convert DescribeAuthorizedOperationsTest to use kraft

2024-10-18 Thread PoAn Yang (Jira)
PoAn Yang created KAFKA-17833: - Summary: Convert DescribeAuthorizedOperationsTest to use kraft Key: KAFKA-17833 URL: https://issues.apache.org/jira/browse/KAFKA-17833 Project: Kafka Issue Type: B

Re: [VOTE] KIP-1092: Extend Consumer#close with an option to leave the group or not

2024-10-18 Thread TengYao Chi
Hello everyone, The vote is now closed, and the KIP has been accepted with 3 binding +1s from Chia-Ping, Sophie, Matthias, as well as 3 non-binding +1 from Andrew, Kirk, Apoorv. Thank you all for your participation! Sincerely, TengYao Matthias J. Sax 於 2024年10月19日 週六 上午1:54寫道: > +1 (binding)

Re: [DISCUSS] KIP-1050: Consistent error handling for Transactions

2024-10-18 Thread Artem Livshits
Hi Kaushik, Thank you for the KIP! I think it'll make writing transactional application easier and less error prone. I have a couple comments: AL1. The keep proposes changing the semantics of UnknownProducerIdException. Currently, this error is never returned by the broker so we cannot valida

[jira] [Resolved] (KAFKA-12894) KIP-750: Drop support for Java 8 in Kafka 4.0 (deprecate in 3.0)

2024-10-18 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-12894. Resolution: Fixed all sub tasks are completed. resolve this now :) > KIP-750: Drop suppor

[jira] [Resolved] (KAFKA-17832) Remove all EnabledForJreRange

2024-10-18 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17832. Fix Version/s: 4.0.0 Resolution: Fixed > Remove all EnabledForJreRange > --

Re: [DISCUSS] Apache Kafka 4.0.0 release

2024-10-18 Thread TengYao Chi
Hi David, I would like to request the inclusion of KIP-1092 in the 4.0 release plan. This KIP is newly accepted, and I believe it will bring valuable enhancements for both the Consumer and Kafka Streams components. Thank you for considering this addition. Best, TengYao Colin McCabe 於 2024年10月1

[jira] [Resolved] (KAFKA-17817) Remove cache from FetchRequest#fetchData

2024-10-18 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17817. Fix Version/s: 4.0.0 Resolution: Fixed > Remove cache from FetchRequest#fetchData >

[jira] [Created] (KAFKA-17834) Improvement the e2e Dockerfile

2024-10-18 Thread Jira
黃竣陽 created KAFKA-17834: --- Summary: Improvement the e2e Dockerfile Key: KAFKA-17834 URL: https://issues.apache.org/jira/browse/KAFKA-17834 Project: Kafka Issue Type: Improvement Affects Versions: 4.

Re: [VOTE] KIP-1092: Extend Consumer#close with an option to leave the group or not

2024-10-18 Thread Matthias J. Sax
+1 (binding) On 10/11/24 3:15 AM, Apoorv Mittal wrote: Hi TengYao, Thanks for the KIP. +1 (non-binding) Regards, Apoorv Mittal On Fri, Oct 11, 2024 at 12:55 AM Sophie Blee-Goldman wrote: +1 (binding) Thanks for this KIP! On Mon, Oct 7, 2024 at 9:22 AM Kirk True wrote: Hi TengYao,

[jira] [Resolved] (KAFKA-17827) cleanup the mockit version

2024-10-18 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17827. Fix Version/s: 4.0.0 Resolution: Fixed > cleanup the mockit version > -

[jira] [Created] (KAFKA-17832) Remove all EnabledForJreRange

2024-10-18 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-17832: -- Summary: Remove all EnabledForJreRange Key: KAFKA-17832 URL: https://issues.apache.org/jira/browse/KAFKA-17832 Project: Kafka Issue Type: Sub-task

[jira] [Resolved] (KAFKA-17780) Heartbeat interval is not configured in the heartbeatrequest manager

2024-10-18 Thread Arpit Goyal (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Goyal resolved KAFKA-17780. - Resolution: Invalid > Heartbeat interval is not configured in the heartbeatrequest manager > ---

[jira] [Created] (KAFKA-17828) Reverse Checkpointing in MirrorMaker2

2024-10-18 Thread Daniel Urban (Jira)
Daniel Urban created KAFKA-17828: Summary: Reverse Checkpointing in MirrorMaker2 Key: KAFKA-17828 URL: https://issues.apache.org/jira/browse/KAFKA-17828 Project: Kafka Issue Type: Improvement

[jira] [Resolved] (KAFKA-17099) Improve the process exception logs with the exact processor node name in which processing exceptions occur

2024-10-18 Thread Bruno Cadonna (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruno Cadonna resolved KAFKA-17099. --- Resolution: Fixed > Improve the process exception logs with the exact processor node name in

[jira] [Created] (KAFKA-17829) Add an integration test verifying ShareFetch requests return a future on purgatory close

2024-10-18 Thread Abhinav Dixit (Jira)
Abhinav Dixit created KAFKA-17829: - Summary: Add an integration test verifying ShareFetch requests return a future on purgatory close Key: KAFKA-17829 URL: https://issues.apache.org/jira/browse/KAFKA-17829

[jira] [Resolved] (KAFKA-17809) Fix flaky test: testExplicitAcknowledgementCommitAsync

2024-10-18 Thread Apoorv Mittal (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apoorv Mittal resolved KAFKA-17809. --- Resolution: Fixed > Fix flaky test: testExplicitAcknowledgementCommitAsync > ---

[jira] [Created] (KAFKA-17830) Cover unit test for TBRLMM init failure cases

2024-10-18 Thread Kamal Chandraprakash (Jira)
Kamal Chandraprakash created KAFKA-17830: Summary: Cover unit test for TBRLMM init failure cases Key: KAFKA-17830 URL: https://issues.apache.org/jira/browse/KAFKA-17830 Project: Kafka

[jira] [Created] (KAFKA-17831) Transaction coordinators returning COORDINATOR_LOAD_IN_PROGRESS until leader changes or brokers are restarted after network instability

2024-10-18 Thread Kay Hartmann (Jira)
Kay Hartmann created KAFKA-17831: Summary: Transaction coordinators returning COORDINATOR_LOAD_IN_PROGRESS until leader changes or brokers are restarted after network instability Key: KAFKA-17831 URL: https://iss