[jira] [Resolved] (KAFKA-17114) DefaultStateUpdater::handleRuntimeException should update isRunning before calling `addToExceptionsAndFailedTasksThenClearUpdatingAndPausedTasks`

2025-01-17 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-17114. - Fix Version/s: 4.1.0 Resolution: Fixed > DefaultStateUpdater::handleRuntimeExcept

[jira] [Resolved] (KAFKA-18480) Fix fail e2e `test_offset_truncate`

2025-01-17 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-18480. Resolution: Fixed trunk: [https://github.com/apache/kafka/commit/78e35457ee966695bd392aa4

[jira] [Created] (KAFKA-18582) Rename num_zk parameter in e2e

2025-01-17 Thread TengYao Chi (Jira)
TengYao Chi created KAFKA-18582: --- Summary: Rename num_zk parameter in e2e Key: KAFKA-18582 URL: https://issues.apache.org/jira/browse/KAFKA-18582 Project: Kafka Issue Type: Improvement

Jenkins build is still unstable: Kafka » Kafka PowerPC Daily » test-powerpc #182

2025-01-17 Thread Apache Jenkins Server
See

Re: [VOTE] KIP-1091: Improved Kafka Streams operator metrics

2025-01-17 Thread Matthias J. Sax
We made a small last minute change to the KIP, adding `processId` tag to the newly added `thread-state` metric. Cf https://github.com/apache/kafka/pull/18581 W/o this tag, it's not possible to map threads to KS clients, as we use AdminClient to collect KS client metrics, but the KafkaConsumer

Re: [DISCUSS] Changing which commit we build in PRs

2025-01-17 Thread David Arthur
Thanks for raising the correctness aspect, José. We currently have a compromise solution since PRs are not required to be up-to-date with trunk before merging. Basically, as long as a PR does not have conflicts and has passing tests, it can be merged. That's the situation today. We rely on the trun

[jira] [Resolved] (KAFKA-18403) Check all dynamic properites, which can't support in KRaft

2025-01-17 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-18403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 黃竣陽 resolved KAFKA-18403. - Resolution: Duplicate > Check all dynamic properites, which can't support in KRaft > ---

Re: [DISCUSS] Changing which commit we build in PRs

2025-01-17 Thread José Armando García Sancio
Thanks David. On Fri, Jan 17, 2025 at 11:55 AM David Arthur wrote: > > I have a simple patch which changes our PRs to build the HEAD of the PR > rather than the merge ref. > > https://github.com/apache/kafka/pull/18449 We shouldn't sacrifice correctness for performance. The tests need to run aga

[jira] [Created] (KAFKA-18581) Allow sub-modules to use ClusterTest without core dependency

2025-01-17 Thread David Arthur (Jira)
David Arthur created KAFKA-18581: Summary: Allow sub-modules to use ClusterTest without core dependency Key: KAFKA-18581 URL: https://issues.apache.org/jira/browse/KAFKA-18581 Project: Kafka

[jira] [Resolved] (KAFKA-806) Index may not always observe log.index.interval.bytes

2025-01-17 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-806. --- Fix Version/s: 4.1.0 Resolution: Fixed merged [https://github.com/apache/kafka/pull/18012] to trunk >

Re: [DISCUSS] KIP-1122: Create a dedicated data module for Kafka Connect data classes

2025-01-17 Thread Greg Harris
Hi Mario, Thanks for your responses. > Do you have some examples for this? In my experience I never had the need > to add a new type. Nobody has added a physical type because it's not possible. But we can see the latent desire through very general types appearing as logical types [1-2], and in u

[jira] [Resolved] (KAFKA-18513) Add record count validation for share group state topic to ShareConsumerTest

2025-01-17 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-18513. -- Fix Version/s: 4.1.0 Resolution: Fixed > Add record count validation for share

[jira] [Created] (KAFKA-18580) Dockerfile used for system tests should use newer Debian version

2025-01-17 Thread Jonah Hooper (Jira)
Jonah Hooper created KAFKA-18580: Summary: Dockerfile used for system tests should use newer Debian version Key: KAFKA-18580 URL: https://issues.apache.org/jira/browse/KAFKA-18580 Project: Kafka

Re: [DISCUSS] KIP-1124: Providing a clear Kafka Client upgrade path

2025-01-17 Thread Kuan Po Tseng
Thanks, Chia-Ping, for the comments. I’ve addressed comments chia00 and chia01 in the KIP! Also, thanks to Sophie for reminding me that 2.4 introduced cooperative rebalancing. I’ve added a paragraph about Kafka Streams and provided an example. By the way, I’ve also updated the Test Plan. We can

Streams component Classes

2025-01-17 Thread Swikar Patel
Hi Team, As I am new contributing Kafka project, though I use Kafka before. While I was looking at this Jira issue. I found following list of classes are prominent. KAFKA-18498 Kafka Streams main thread does not release lock I am curious and

[DISCUSS] Changing which commit we build in PRs

2025-01-17 Thread David Arthur
Hey folks, I have a PR up that changes which commit we build in our PRs. Currently, our PRs are building a synthetic "merge" commit which does not actually exist in the repo. This is done by taking the base branch and merging the PR into it. The benefit of this approach is that you will see the re

[jira] [Resolved] (KAFKA-18514) Refactor share module to server and server-common

2025-01-17 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-18514. - Resolution: Fixed > Refactor share module to server and server-common >

[jira] [Resolved] (KAFKA-17675) Add tests to RaftEventSimulationTest

2025-01-17 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-17675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] José Armando García Sancio resolved KAFKA-17675. Fix Version/s: 4.0.0 Resolution: Fixed > Add tests to RaftE

[jira] [Resolved] (KAFKA-17643) Response handling for pre-vote set to True

2025-01-17 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-17643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] José Armando García Sancio resolved KAFKA-17643. Resolution: Fixed > Response handling for pre-vote set to True > -

[jira] [Resolved] (KAFKA-16607) Have metrics implementation include the new state

2025-01-17 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-16607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] José Armando García Sancio resolved KAFKA-16607. Resolution: Fixed > Have metrics implementation include the new st

[jira] [Resolved] (KAFKA-17642) Add ProspectiveState and ProspectiveStateTest

2025-01-17 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-17642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] José Armando García Sancio resolved KAFKA-17642. Resolution: Fixed > Add ProspectiveState and ProspectiveStateTest

[jira] [Created] (KAFKA-18579) Add TransactionAbortableException instruction in docs

2025-01-17 Thread Kaushik Raina (Jira)
Kaushik Raina created KAFKA-18579: - Summary: Add TransactionAbortableException instruction in docs Key: KAFKA-18579 URL: https://issues.apache.org/jira/browse/KAFKA-18579 Project: Kafka Issue

[jira] [Resolved] (KAFKA-18413) Remove AdminZkClient

2025-01-17 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-18413. Resolution: Fixed > Remove AdminZkClient > > > Key: K

Re: [DISCUSS] KIP-1122: Create a dedicated data module for Kafka Connect data classes

2025-01-17 Thread Andrew Schofield
Hi Mario, Thanks for the KIP. My view is that it would be nice for Kafka to have a data model so that Kafka could do natively the things that people use schema registries for today. I'm not convinced that the Kafka Connect data classes are really up to the job, so I'm not sure that there's a lot o

[jira] [Resolved] (KAFKA-18318) Add more logs to the migration path

2025-01-17 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-18318. - Fix Version/s: 4.0.0 Resolution: Fixed > Add more logs to the migration path > --

[jira] [Resolved] (KAFKA-18150) Maybe downgrade the consumer group if a consumer member leaves the group though admin client

2025-01-17 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-18150. - Fix Version/s: 4.0.0 Resolution: Fixed > Maybe downgrade the consumer group if a consumer

[jira] [Resolved] (KAFKA-18431) Remove KafkaController

2025-01-17 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-18431. - Resolution: Fixed > Remove KafkaController > -- > > Key: KAF

Re: [DISCUSS] KIP-1122: Create a dedicated data module for Kafka Connect data classes

2025-01-17 Thread Mario Fiore Vitale
Hi all, Any other feedback on this? I'll take the discussion open for another week and then start the vote. Thanks, Mario. On Fri, Jan 10, 2025 at 10:30 AM Mario Fiore Vitale wrote: > Hi Greg, thanks for giving a look. > > > It's a closed type system which cannot have new "physical" types adde

[jira] [Resolved] (KAFKA-18373) Remove ZkMetadataCache

2025-01-17 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-18373. Fix Version/s: 4.0.0 Resolution: Fixed > Remove ZkMetadataCache > -

[jira] [Resolved] (KAFKA-18577) Remove UpdateMetadataRequest in MetadataCacheTest

2025-01-17 Thread TaiJuWu (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TaiJuWu resolved KAFKA-18577. - Resolution: Duplicate > Remove UpdateMetadataRequest in MetadataCacheTest >

[jira] [Created] (KAFKA-18578) Remove UpdateMetadataRequest in metadataCacheTest

2025-01-17 Thread TaiJuWu (Jira)
TaiJuWu created KAFKA-18578: --- Summary: Remove UpdateMetadataRequest in metadataCacheTest Key: KAFKA-18578 URL: https://issues.apache.org/jira/browse/KAFKA-18578 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-18577) Remove UpdateMetadataRequest in MetadataCacheTest

2025-01-17 Thread TaiJuWu (Jira)
TaiJuWu created KAFKA-18577: --- Summary: Remove UpdateMetadataRequest in MetadataCacheTest Key: KAFKA-18577 URL: https://issues.apache.org/jira/browse/KAFKA-18577 Project: Kafka Issue Type: Bug

[jira] [Resolved] (KAFKA-18557) ShareCoordinatorServiceTest can leverage ShareCoordinatorTestConfig#testConfig to streamline the codebase

2025-01-17 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-18557. -- Fix Version/s: 4.1.0 Resolution: Fixed > ShareCoordinatorServiceTest can levera