[jira] [Created] (KAFKA-14296) Partition leaders are not demoted during kraft controlled shutdown

David Jacot created KAFKA-14296: --- Summary: Partition leaders are not demoted during kraft controlled shutdown Key: KAFKA-14296 URL: https://issues.apache.org/jira/browse/KAFKA-14296 Project: Kafka

[jira] [Created] (KAFKA-14297) Automated protocol should support namespace

David Jacot created KAFKA-14297: --- Summary: Automated protocol should support namespace Key: KAFKA-14297 URL: https://issues.apache.org/jira/browse/KAFKA-14297 Project: Kafka Issue Type: Sub-tas

[jira] [Created] (KAFKA-14298) Getting null pointer exception

Ramakrishna created KAFKA-14298: --- Summary: Getting null pointer exception Key: KAFKA-14298 URL: https://issues.apache.org/jira/browse/KAFKA-14298 Project: Kafka Issue Type: Bug Compon

[jira] [Created] (KAFKA-14299) Benchmark and stabilize state updater

Lucas Brutschy created KAFKA-14299: -- Summary: Benchmark and stabilize state updater Key: KAFKA-14299 URL: https://issues.apache.org/jira/browse/KAFKA-14299 Project: Kafka Issue Type: Task

[DISCUSS] (continued) KIP-848: The Next Generation of the Consumer Rebalance Protocol

Hi, David, Thanks for the reply and the updated KIP. A few more comments on the interfaces and the protocols. 60. On the consumer side, do we need both PartitionAssignor.onAssignment and ConsumerRebalanceListener.onPartitionsAssigned? My understanding is that the former was added for cooperative

Re: [jira] [Created] (KAFKA-14293) Basic Auth filter should set the SecurityContext after a successful login

On Wednesday, October 12, 2022, Patrik Márton (Jira) wrote: > Patrik Márton created KAFKA-14293: > - > > Summary: Basic Auth filter should set the SecurityContext > after a successful login > Key: KAFKA-14293 > URL

Kafka Client trying to reconnect resulting in application crash

Hello, I have a Spring Web Application using Kafka. I am using Apache Kafka Client 3.1.0 to connect to Kafka. I have noticed that if I give a wrong Kafka port to connect to, the client keeps on trying to connect to Kafka and at that time I am unable to call my application API. It returns 404. So

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1291

See Changes: -- [...truncated 506302 lines...] [2022-10-13T17:00:50.201Z] [2022-10-13T17:00:50.201Z] Gradle Test Run :streams:integrationTest > Gradle Test Executor 167 >

Re: [DISCUSS] KIP-864: Add End-To-End Latency Metrics to Connectors

Hi Jorge, Thanks for the KIP. I agree with the overall direction and think this would be a nice improvement to Kafka Connect. Here are my initial thoughts on the details: 1. The motivation section outlines the gaps in Kafka Connect's task metrics nicely. I think it'd be useful to include more con

Re: [DISCUSS] KIP-866 ZooKeeper to KRaft Migration

Hi, Colin, Thanks for the reply. 10. This is a bit on the implementation side. If you look at the existing ZK-based controller, most of the logic is around maintaining an in-memory state of all the resources (broker, topic, partition, etc), reading/writing to ZK, sending LeaderAndIsr and UpdateMe

[jira] [Created] (KAFKA-14300) KRaft controller snapshot not trigger after resign

José Armando García Sancio created KAFKA-14300: -- Summary: KRaft controller snapshot not trigger after resign Key: KAFKA-14300 URL: https://issues.apache.org/jira/browse/KAFKA-14300 Project

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1292

See Changes: -- [...truncated 427006 lines...] [2022-10-13T20:18:30.723Z] [2022-10-13T20:18:30.723Z] Gradle Test Run :streams:integrationTest > Gradle Test Executor 167 >

[jira] [Resolved] (KAFKA-14292) KRaft broker controlled shutdown can be delayed indefinitely

[ https://issues.apache.org/jira/browse/KAFKA-14292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-14292. - Fix Version/s: 3.4.0 3.3.2 Resolution: Fixed > KRaft broker co

Re: [DISCUSS] KIP-875: First-class offsets support in Kafka Connect

Hi all, I noticed a fairly large gap in the first version of this KIP that I published last Friday, which has to do with accommodating connectors that target different Kafka clusters than the one that the Kafka Connect cluster uses for its internal topics and source connectors with dedicated offse

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.3 #102

See Changes: -- [...truncated 501024 lines...] [2022-10-13T21:05:52.909Z] [INFO] Using 'UTF-8' encoding to copy filtered resources. [2022-10-13T21:05:52.909Z] [INFO] Copying

RE: Re: [DISCUSS] KIP-875: First-class offsets support in Kafka Connect

Hey Chris, Thanks for the KIP! I think this is an important feature for both development and operations use-cases, and it's an obvious gap in the REST feature set. I also appreciate the incremental nature of the KIP and the future extensions that will now be possible. I had a couple of questions

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #1293

See

[jira] [Created] (KAFKA-14301) Simulation validation that raft listener see NO_LEADER on leader

José Armando García Sancio created KAFKA-14301: -- Summary: Simulation validation that raft listener see NO_LEADER on leader Key: KAFKA-14301 URL: https://issues.apache.org/jira/browse/KAFKA-14301

[jira] [Resolved] (KAFKA-14296) Partition leaders are not demoted during kraft controlled shutdown

[ https://issues.apache.org/jira/browse/KAFKA-14296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-14296. - Fix Version/s: 3.4.0 3.3.2 Resolution: Fixed > Partition leade

[VOTE] KIP-876: Time based cluster metadata snapshots

Hello all, I would like to start voting for "KIP-876: Time based cluster metadata snapshots." KIP: https://cwiki.apache.org/confluence/x/MY3GDQ Discussion thread: https://lists.apache.org/thread/ww67h9d4xvgw1f7jn4zxwydmt8x1mq72 Thanks! -- -José

Re: [DISCUSS] KIP-876: Time based cluster metadata snapshots

Thanks for your feedback David Jacot, Colin McCabe and Niket Goel. I started the vote thread at https://lists.apache.org/thread/yzzhbvdqxg9shttgbzooc2f42l1cv2sj -- -José

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1294

See

Re: [DISCUSS] (continued) KIP-848: The Next Generation of the Consumer Rebalance Protocol

Hi David, A few more questions: 1. We will store the "targetAssignment" into log now. But as we know, there's max batch size limit (default 1MB), which means, we cannot support 1M partitions in one group (actually, it should be less than 60k partitions since we'll store {topicID+partition id}) by

Jenkins build is back to stable : Kafka » Kafka Branch Builder » trunk #1295

See

Re: [VOTE] KIP-876: Time based cluster metadata snapshots

Thanks for this KIP, +1 for this(binding). -- Best, Ziming > On Oct 14, 2022, at 8:11 AM, José Armando García Sancio > wrote: > > Hello all, > > I would like to start voting for "KIP-876: Time based cluster metadata > snapshots." > > KIP: https://cwiki.apache.org/confluence/x/MY3GDQ > Discu

Re: [DISCUSS] KIP-875: First-class offsets support in Kafka Connect

Thanks for KIP Chris - I think this is a useful feature. Can you please elaborate on the following in the KIP - 1. How would the response of GET /connectors/{connector}/offsets look like if the worker has both global and connector specific offsets topic ? 2. How can we pass the reset options lik

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.3 #103

See

Re: [VOTE] KIP-876: Time based cluster metadata snapshots

+1 (binding) Thanks for the KIP! Le ven. 14 oct. 2022 à 05:47, deng ziming a écrit : > Thanks for this KIP, > > +1 for this(binding). > > -- > Best, > Ziming > > > On Oct 14, 2022, at 8:11 AM, José Armando García Sancio > wrote: > > > > Hello all, > > > > I would like to start voting for "KIP-

Re: [DISCUSS] KIP-876: Time based cluster metadata snapshots

Hi José, Thanks for the KIP. Adding support to generate snapshot based on time makes sense to me. The only thing I'd like to point out is the compatibility section. Since this new config is default to 1 hour, which means if users explicitly set the config `metadata.log.max.record.bytes.between.sn