[DISCUSS] KIP-744: Migrate TaskMetadata to interface with internal implementation

Hi there, I would like to propose KIP-744, to introduce TaskMetadata as an interface, to keep the its implementation as internal use. This KIP can be seen as a spin-off of KIP-740. https://cwiki.apache.org/confluence/x/XIrOCg Best, -- Josep Prat *Aiven Deutschland GmbH* Immanuelkirchstraße 26

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #167

See

Re: [DISCUSS] KIP-744: Migrate TaskMetadata to interface with internal implementation

I deliberately picked the most conservative approach of creating a new Interface, instead of transforming the current class into an interface. Feedback is most welcome! Best, On Thu, May 27, 2021 at 10:26 AM Josep Prat wrote: > Hi there, > I would like to propose KIP-744, to introduce TaskMetad

[jira] [Created] (KAFKA-12855) Update ssl certificates of kafka connect worker runtime without restarting the worker process.

kaushik srinivas created KAFKA-12855: Summary: Update ssl certificates of kafka connect worker runtime without restarting the worker process. Key: KAFKA-12855 URL: https://issues.apache.org/jira/browse/KAFKA-1

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #168

See

[jira] [Created] (KAFKA-12856) Upgrade Jackson to 2.12.3

Ismael Juma created KAFKA-12856: --- Summary: Upgrade Jackson to 2.12.3 Key: KAFKA-12856 URL: https://issues.apache.org/jira/browse/KAFKA-12856 Project: Kafka Issue Type: Bug Reporter:

Kafka getting down every week due to log file deletion.

Hi team, Our Kafka is getting down almost once or twice a month due to log file deletion failure. There is single node kafka broker is running in our system and gets down every time it tires to delete the log files as cleanup and fails. Sharing the Error Logs, we need a robust solution for this

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #169

See

Re: Kafka getting down every week due to log file deletion.

Seems you log dir is sending your data to tmp folder, if I am bot mistken this dir automatically removing files from itself, causing the log deletuon procedure of the kafka internal to fail and shutdown broker on file not found בתאריך יום ה׳, 27 במאי 2021, 17:52, מאת Neeraj Gulia ‏< neeraj.gu...@o

Re: [VOTE] KIP-741: Change default serde to be null

Thanks all, I think we can go ahead and close this now. KIP-741 passes with 4 binding votes (Guozhang, Sophie, John, Bruno) and 3 non-binding (Walker, Lee, and myself). On Tue, May 25, 2021 at 8:32 AM Dongjin Lee wrote: > Hi Bruno, > > Oh, thanks for pointing out my mistake. Yes, the KIP is not

[jira] [Resolved] (KAFKA-12856) Upgrade Jackson to 2.12.3

[ https://issues.apache.org/jira/browse/KAFKA-12856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-12856. - Fix Version/s: 3.0.0 Resolution: Fixed > Upgrade Jackson to 2.12.3 >

Re: Kafka getting down every week due to log file deletion.

The main purpose of the /*tmp* directory is to temporarily store *files* when installing an OS or software. If any *files* in the /*tmp* directory have not been accessed for a while, they will be automatically *deleted* from the system בתאריך יום ה׳, 27 במאי 2021, 19:04, מאת Ran Lupovich ‏: > See

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #170

See Changes: -- [...truncated 410879 lines...] [Pipeline] sh [2021-05-27T18:32:44.105Z] [2021-05-27T18:32:44.105Z] PlaintextConsumerTest > testMaxPollRecords() PASSED [2021

Build failed in Jenkins: Kafka » Kafka Branch Builder » 2.8 #29

See Changes: -- [...truncated 463539 lines...] [2021-05-27T18:55:44.124Z] AuthorizerIntegrationTest > testCommitWithNoAccess() STARTED [2021-05-27T18:55:46.100Z] [2021-05-27T

Re: [DISCUSS] KIP-744: Migrate TaskMetadata to interface with internal implementation

Thanks for the KIP! I'm on board with the overall proposal, just a few comments: 1) The motivation section says TaskMetadata should have never been a class available for the general > public, but more of an internal class which is a bit misleading as it seems to imply that TaskMetadata itself w

Re: [DISCUSS] KIP-744: Migrate TaskMetadata to interface with internal implementation

Hi Sophie, Thanks for the feedback, I'll update the KIP tomorrow with your feedback. They are all good points, and you are right, my phrasing could be misleading. Best, On Thu, May 27, 2021 at 10:02 PM Sophie Blee-Goldman wrote: > Thanks for the KIP! I'm on board with the overall proposal, ju

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #171

See Changes: -- [...truncated 341892 lines...] [2021-05-27T20:48:18.208Z] > Task :clients:jar UP-TO-DATE [2021-05-27T20:48:18.208Z] > Task :server-common:compileJava UP-TO-D

Re: [DISCUSS] KIP-618: Atomic commit of source connector records and offsets

Chris, all, I've just read KIP-618, and let me congratulate you first of all for this impressive piece of work! Here's a few small suggestions and questions I had while reading: * TransactionContext: What's the use case for the methods accepting a source record (commitTransaction(SourceRecord rec

Jenkins build is back to normal : Kafka » kafka-2.7-jdk8 #157

See

Re: [DISCUSS] KIP-618: Atomic commit of source connector records and offsets

Chris, One follow-up question after thinking some more about this; is there any limit in terms of duration or size of in-flight, connector-controlled transactions? In case of Debezium for instance, there may be cases where we tail the TX log from an upstream source database, not knowing whether th

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #172

See

[jira] [Created] (KAFKA-12857) Using Connect Sink with CooperativeStickyAssignor results in commit offsets failure

Oliver Hsu created KAFKA-12857: -- Summary: Using Connect Sink with CooperativeStickyAssignor results in commit offsets failure Key: KAFKA-12857 URL: https://issues.apache.org/jira/browse/KAFKA-12857 Proje

Puzzle about InterBrokerSendThread.scala

Hi team, I'm leaning the source code recently，the method logic seems wants to collect all timeout request, but it acutually just remove the first expire request of each broker, is it a deliberate design? will it lose some callbacks ? Looking forward to your reply！ Source file: kafka.comm

[jira] [Created] (KAFKA-12858) dynamically update the ssl certificates of kafka connect worker without restarting connect process.

kaushik srinivas created KAFKA-12858: Summary: dynamically update the ssl certificates of kafka connect worker without restarting connect process. Key: KAFKA-12858 URL: https://issues.apache.org/jira/browse/KA

[jira] [Created] (KAFKA-12859) Kafka Server Repeated Responses

Lea created KAFKA-12859: --- Summary: Kafka Server Repeated Responses Key: KAFKA-12859 URL: https://issues.apache.org/jira/browse/KAFKA-12859 Project: Kafka Issue Type: Bug Components: clients