Re: [DISCUSS] KIP-939: Support Participation in 2PC

2023-08-22 Thread Arjun Satish
Hello Artem, Thanks for the KIP. I have the same question as Roger on concurrent writes, and an additional one on consumer behavior. Typically, transactions will timeout if not committed within some time interval. With the proposed changes in this KIP, consumers cannot consume past the ongoing tr

[DISCUSS] KIP-970: Deprecate and remove Connect's redundant task configurations endpoint

2023-08-22 Thread Yash Mayya
Hi all, I'd like to start a discussion thread for this KIP - https://cwiki.apache.org/confluence/display/KAFKA/KIP-970%3A+Deprecate+and+remove+Connect%27s+redundant+task+configurations+endpoint . It proposes the deprecation and eventual removal of Kafka Connect's redundant task configurations end

Re: [REVIEW REQUEST] Move ReassignPartitionsCommandArgsTest to java

2023-08-22 Thread Николай Ижиков
Hello. Please, join the simple review) We have few steps left to completely rewrite ReassignPartitionsCommand in java. > 17 авг. 2023 г., в 17:16, Николай Ижиков написал(а): > > Hello. > > I’m working on [1]. > The goal of ticket is to rewire `ReassignPartitionCommand` in java. > > The PR tha

[jira] [Created] (KAFKA-15391) Delete topic may lead to directory offline

2023-08-22 Thread Divij Vaidya (Jira)
Divij Vaidya created KAFKA-15391: Summary: Delete topic may lead to directory offline Key: KAFKA-15391 URL: https://issues.apache.org/jira/browse/KAFKA-15391 Project: Kafka Issue Type: Bug

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2128

2023-08-22 Thread Apache Jenkins Server
See Changes: -- [...truncated 306231 lines...] Gradle Test Run :core:test > Gradle Test Executor 93 > ZooKeeperClientTest > testConnectionViaNettyClient() PASSED Gradle

Re: [DISCUSS] KIP-970: Deprecate and remove Connect's redundant task configurations endpoint

2023-08-22 Thread Chris Egerton
Hi Yash, Thanks for driving this, and for putting out a well-written KIP. LGTM! Cheers, Chris On Tue, Aug 22, 2023 at 6:13 AM Yash Mayya wrote: > Hi all, > > I'd like to start a discussion thread for this KIP - > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-970%3A+Deprecate+and+rem

Requesting permissions to contribute to Apache Kafka

2023-08-22 Thread Animesh Kumar
Hi Team, Please provide access to contribute to Apache Kafka JIRA id -- akanimesh7 Wiki Id -- akanimesh7 -- Animesh Kumar 8120004556

Re: [DISCUSS] KIP-910: Update Source offsets for Source Connectors without producing records

2023-08-22 Thread Yash Mayya
Hi Sagar, Thanks for the updates and apologies for the delayed response. > Hmm the question is how do you qualify a > partition as stale or old? Let's say a connector > has implemented updateOffsets and for a certain > partition for which no records are received then it > will update it's offset

[jira] [Resolved] (KAFKA-15213) Provide the exact offset to QuorumController.replay

2023-08-22 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-15213. -- Fix Version/s: 3.6.0 Resolution: Fixed > Provide the exact offset to QuorumController.r

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2129

2023-08-22 Thread Apache Jenkins Server
See Changes: -- [...truncated 307524 lines...] Gradle Test Run :core:test > Gradle Test Executor 90 > ZkMigrationClientTest > testUpdateExistingPartitions() STARTED Gradl

[jira] [Created] (KAFKA-15392) RestServer starts but does not stop ServletContextHandler

2023-08-22 Thread Greg Harris (Jira)
Greg Harris created KAFKA-15392: --- Summary: RestServer starts but does not stop ServletContextHandler Key: KAFKA-15392 URL: https://issues.apache.org/jira/browse/KAFKA-15392 Project: Kafka Issue

Re: [DISCUSS] KIP-939: Support Participation in 2PC

2023-08-22 Thread Artem Livshits
Hi Roger, Arjun, Thank you for the questions. > It looks like the application must have stable transactional ids over time? The transactional id should uniquely identify a producer instance and needs to be stable across the restarts. If the transactional id is not stable across restarts, then zo

[jira] [Created] (KAFKA-15393) MirrorMaker2 integration tests are shutting down uncleanly

2023-08-22 Thread Greg Harris (Jira)
Greg Harris created KAFKA-15393: --- Summary: MirrorMaker2 integration tests are shutting down uncleanly Key: KAFKA-15393 URL: https://issues.apache.org/jira/browse/KAFKA-15393 Project: Kafka Issu

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2130

2023-08-22 Thread Apache Jenkins Server
See Changes: -- [...truncated 304607 lines...] Gradle Test Run :core:test > Gradle Test Executor 93 > ZkMigrationClientTest > testUpdateExistingPartitions() STARTED Gradl

Re: [DISCUSS] KIP-939: Support Participation in 2PC

2023-08-22 Thread Roger Hoover
Artem, Thanks for the reply. If I understand correctly, Kafka does not support concurrent transactions from the same producer (transactional id). I think this means that applications that want to support in-process concurrency (say thread-level concurrency with row-level DB locking) would need t

Re: [VOTE] KIP-953: partition method to be overloaded to accept headers as well.

2023-08-22 Thread Jack Tomy
Hi Ismael, That would be totally different from the pattern currently being followed in all the interfaces, for example serializer. I personally don't favour that either. Let's see if the community has any opinions on the same. Hey everyone, please share your thoughts on using a DTO instead of se

Issue with Kafka ACLs: Unexpected Permissions for User

2023-08-22 Thread Bharath Achar
Hello Community, I'm facing an unexpected situation while working with Kafka ACLs. Despite having provided only read access permissions to the user "rbactest22sep," I've noticed that this user is still able to add ACLs for Kafka topics. Here are the details: User: rbactest22sep Current Pe

Re: Requesting permissions to contribute to Apache Kafka

2023-08-22 Thread Luke Chen
Hi Animesh, Your accounts are all set. Thanks. Luke On Tue, Aug 22, 2023 at 9:25 PM Animesh Kumar wrote: > Hi Team, > Please provide access to contribute to Apache Kafka > JIRA id -- akanimesh7 > Wiki Id -- akanimesh7 > -- > Animesh Kumar > 8120004556 >