Re: [DISCUSS] KIP-877: Mechanism for plugins and connectors to register metrics

2022-12-19 Thread Yash Mayya
Hi Mickael, Thanks for creating this KIP, this will be a super useful feature to enhance existing connectors in the Kafka Connect ecosystem. I have some similar concerns to the ones that Chris has outlined above, especially with regard to directly exposing Connect's Metrics object to plugins. I b

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1449

2022-12-19 Thread Apache Jenkins Server
See Changes: -- [...truncated 528878 lines...] [2022-12-20T05:57:30.329Z] Gradle Test Run :core:integrationTest > Gradle Test Executor 169 > KafkaZkClientTest > testCreate

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1448

2022-12-19 Thread Apache Jenkins Server
See Changes: -- [...truncated 523182 lines...] [2022-12-20T02:07:29.399Z] > Task :streams:jar UP-TO-DATE [2022-12-20T02:07:29.399Z] > Task :streams:generateMetadataFileFor

[jira] [Resolved] (KAFKA-12736) KafkaProducer.flush holds onto completed ProducerBatch(s) until flush completes

2022-12-19 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-12736. - Fix Version/s: 3.0.0 Assignee: Lucas Bradstreet Resolution: Fixed > KafkaProducer.flush

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.4 #14

2022-12-19 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-890 Server Side Defense

2022-12-19 Thread Jun Rao
Hi, Justine, Thanks for the explanation. It makes sense to me now. Jun On Mon, Dec 19, 2022 at 1:42 PM Justine Olshan wrote: > Hi Jun, > > My understanding of the mechanism is that when we get to the last epoch, we > increment to the fencing/last epoch and if any further requests come in for >

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.3 #139

2022-12-19 Thread Apache Jenkins Server
See Changes: -- [...truncated 501889 lines...] [2022-12-19T22:55:59.945Z] + mvn compile [2022-12-19T22:56:00.997Z] [INFO] Scanning for projects... [2022-12-19T22:56:00.997Z] [

[jira] [Resolved] (KAFKA-14466) Refactor ClassLoaderAwareRemoteStorageManager.scala to ClassLoaderAwareRemoteStorageManager.java and move it to storage module.

2022-12-19 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-14466. - Reviewer: Ismael Juma Resolution: Fixed > Refactor ClassLoaderAwareRemoteStorageManager.sc

[jira] [Created] (KAFKA-14535) Flaky test PlaintextEndToEndAuthorizationTest.testNoConsumeWithoutDescribeAclViaSubscribe

2022-12-19 Thread Greg Harris (Jira)
Greg Harris created KAFKA-14535: --- Summary: Flaky test PlaintextEndToEndAuthorizationTest.testNoConsumeWithoutDescribeAclViaSubscribe Key: KAFKA-14535 URL: https://issues.apache.org/jira/browse/KAFKA-14535

[jira] [Created] (KAFKA-14534) Flaky Test TransactionsExpirationTest.testTransactionAfterProducerIdExpires

2022-12-19 Thread Greg Harris (Jira)
Greg Harris created KAFKA-14534: --- Summary: Flaky Test TransactionsExpirationTest.testTransactionAfterProducerIdExpires Key: KAFKA-14534 URL: https://issues.apache.org/jira/browse/KAFKA-14534 Project: Ka

[jira] [Created] (KAFKA-14533) Flaky Test SmokeTestDriverIntegrationTest.shouldWorkWithRebalance

2022-12-19 Thread Greg Harris (Jira)
Greg Harris created KAFKA-14533: --- Summary: Flaky Test SmokeTestDriverIntegrationTest.shouldWorkWithRebalance Key: KAFKA-14533 URL: https://issues.apache.org/jira/browse/KAFKA-14533 Project: Kafka

Re: [DISCUSS] KIP-890 Server Side Defense

2022-12-19 Thread Justine Olshan
Hi Jun, My understanding of the mechanism is that when we get to the last epoch, we increment to the fencing/last epoch and if any further requests come in for this producer ID they are fenced. Then the producer gets a new ID and restarts with epoch/sequence 0. The fenced epoch sticks around for t

[jira] [Created] (KAFKA-14532) IllegalStateException when fetch failure happens after assignment changed

2022-12-19 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-14532: -- Summary: IllegalStateException when fetch failure happens after assignment changed Key: KAFKA-14532 URL: https://issues.apache.org/jira/browse/KAFKA-14532 Project

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1447

2022-12-19 Thread Apache Jenkins Server
See

Re: [VOTE] KIP-889 Versioned State Stores

2022-12-19 Thread Matthias J. Sax
+1 (binding) On 12/15/22 1:27 PM, John Roesler wrote: Thanks for the thorough KIP, Victoria! I'm +1 (binding) -John On 2022/12/15 19:56:21 Victoria Xia wrote: Hi all, I'd like to start a vote on KIP-889 for introducing versioned key-value state stores to Kafka Streams: https://cwiki.apache.

Re: [DISCUSS] KIP-890 Server Side Defense

2022-12-19 Thread Jun Rao
Hi, Justine, Thanks for the explanation. 70. The proposed fencing logic doesn't apply when pid changes, is that right? If so, I am not sure how complete we are addressing this issue if the pid changes more frequently. Thanks, Jun On Fri, Dec 16, 2022 at 9:16 AM Justine Olshan wrote: > Hi J

[jira] [Created] (KAFKA-14531) KRaft controller time-based snapshots are too frequent

2022-12-19 Thread David Arthur (Jira)
David Arthur created KAFKA-14531: Summary: KRaft controller time-based snapshots are too frequent Key: KAFKA-14531 URL: https://issues.apache.org/jira/browse/KAFKA-14531 Project: Kafka Issue

Kafka AdminClient DEFAULT_API_TIMEOUT_MS_CONFIG property not working as expected.

2022-12-19 Thread shruti pandey
Hi, I have previously send this query. In my java application for kafkaProducer i created Admin and used this to list topics. Admin admin1 = Admin.create(properties). ListTopicsResult listTopicResult = admin1.listTopics(); When producer was not able to connect to broker, thread get stucks at l

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #1446

2022-12-19 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-889 Versioned State Stores

2022-12-19 Thread Bruno Cadonna
Hi Victoria, I am +1 on the KIP. I just have one minor comment: Why do we need method public static VersionedRecord make(final V value, final long timestamp) in the VersionedRecord? The public constructor would do exactly the same, wouldn't it? I would make the constructor public and remov

[jira] [Created] (KAFKA-14530) Check state updater more than once in process loops

2022-12-19 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-14530: -- Summary: Check state updater more than once in process loops Key: KAFKA-14530 URL: https://issues.apache.org/jira/browse/KAFKA-14530 Project: Kafka Issue

[jira] [Resolved] (KAFKA-9990) Supporting transactions in tiered storage

2022-12-19 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana resolved KAFKA-9990. --- Resolution: Fixed > Supporting transactions in tiered storage > -