Re: [DISCUSS] Apache Kafka 3.1.0 release

Hi Justine, I am +1 on getting this in the 3.1 release as it is a serious regression in clusters with a high number of partitions. Thanks, David On Tue, Dec 7, 2021 at 10:39 PM Justine Olshan wrote: > > Hi all, > I've filed a bug for an extra map allocation that is used in the fetch > path. htt

[jira] [Created] (KAFKA-13517) Add ConfigurationKeys to ConfigResource class

Vikas Singh created KAFKA-13517: --- Summary: Add ConfigurationKeys to ConfigResource class Key: KAFKA-13517 URL: https://issues.apache.org/jira/browse/KAFKA-13517 Project: Kafka Issue Type: Impro

Re: [VOTE] KIP-792: Add "generation" field into consumer protocol

Hi Colin, I'm not quite sure if I understand your thoughts correctly. If I was wrong, please let me know. Also, I'm not quite sure how I could lock this feature to a new IBP version. I saw "KIP-584: Versioning scheme for features" is still under development. Not sure if I need to lock the IBP ver

Re: [DISCUSS] KIP-782: Expandable batch size in producer

Hi, Luke, Thanks for the KIP. A few comments below. 10. Accumulating small batches could improve memory usage. Will that introduce extra copying when generating a produce request? Currently, a produce request takes a single MemoryRecords per partition. 11. Do we need to introduce a new config ba

[jira] [Created] (KAFKA-13516) Connection level metrics are not closed

Aman Agarwal created KAFKA-13516: Summary: Connection level metrics are not closed Key: KAFKA-13516 URL: https://issues.apache.org/jira/browse/KAFKA-13516 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-13515) Fix KRaft config validation issues

Colin McCabe created KAFKA-13515: Summary: Fix KRaft config validation issues Key: KAFKA-13515 URL: https://issues.apache.org/jira/browse/KAFKA-13515 Project: Kafka Issue Type: Bug

Re: [DISCUSS] KIP-802: Validation Support for Kafka Connect SMT Options

Hi Gunnar, Thanks for the KIP! The section on backwards compatibility is especially impressive and was enjoyable to read. Overall I like the direction of the KIP (and in fact just ran into a situation yesterday where it would be valuable). I only have one major thought: could we add similar valid

Re: [Discuss] KIP-803: Add Task ID and Connector Name to Connect Task Context

Hi Sarah, Thanks for the KIP! I have two major thoughts: 1. Adding new methods like this to the Connect API comes with the risk that connectors that invoke them become incompatible with older versions of Connect. For example, if I updated my connector to use the newly-proposed SourceTaskContext::

Re: [DISCUSS] Apache Kafka 3.1.0 release

Hi all, I've filed a bug for an extra map allocation that is used in the fetch path. https://issues.apache.org/jira/browse/KAFKA-13512 I think it qualifies as a blocker since this path is used pretty frequently and it looks to be a regression. I also have a PR open to fix the issue. With this chan

[jira] [Created] (KAFKA-13514) Flakey test StickyAssignorTest

Matthias J. Sax created KAFKA-13514: --- Summary: Flakey test StickyAssignorTest Key: KAFKA-13514 URL: https://issues.apache.org/jira/browse/KAFKA-13514 Project: Kafka Issue Type: Test

[jira] [Created] (KAFKA-13513) Flaky test AdjustStreamThreadCountTest

Matthias J. Sax created KAFKA-13513: --- Summary: Flaky test AdjustStreamThreadCountTest Key: KAFKA-13513 URL: https://issues.apache.org/jira/browse/KAFKA-13513 Project: Kafka Issue Type: Test

[jira] [Created] (KAFKA-13512) topicIdsToNames and topicNamesToIds allocate unnecessary maps

Justine Olshan created KAFKA-13512: -- Summary: topicIdsToNames and topicNamesToIds allocate unnecessary maps Key: KAFKA-13512 URL: https://issues.apache.org/jira/browse/KAFKA-13512 Project: Kafka

Re: [Discuss] KIP-803: Add Task ID and Connector Name to Connect Task Context

Hi all! Just wanted to bump this KIP for adding Task ID and Connector Name to the task context. It's a small change, and I'd love some feedback on it! Thanks! Sarah On Wed, Nov 24, 2021 at 10:26 AM Sarah Story < sa...@sarahstoryengineering.com> wrote: > I have written a KIP for adding Task ID an

[jira] [Created] (KAFKA-13511) Update TimestampConverter SMT to support unix epoch as millis, micros, and seconds

Julien Chanaud created KAFKA-13511: -- Summary: Update TimestampConverter SMT to support unix epoch as millis, micros, and seconds Key: KAFKA-13511 URL: https://issues.apache.org/jira/browse/KAFKA-13511

Re: [VOTE] KIP-792: Add "generation" field into consumer protocol

Hi Colin, Thanks for your comments. I've updated the KIP to mention about the KIP won't affect current broker side behavior. > One scenario that we need to consider is what happens during a rolling upgrade. If the coordinator moves back and forth between brokers with different IBPs, it seems that

Re: [DISCUSS] KIP-784: Add top-level error code field to DescribeLogDirsResponse

Hi Magnus, That's a good point, I've updated the KIP. Considering it's a very small KIP, if I don't see any more feedback, I'll start a vote in the next couple of days. Thanks, Mickael On Mon, Nov 22, 2021 at 11:05 AM Magnus Edenhill wrote: > > Hey Mickael and thanks for the KIP. > > I'm a bit

[jira] [Created] (KAFKA-13510) KIP-769: Connect APIs to list all connector plugins and retrieve their configuration definitions

Mickael Maison created KAFKA-13510: -- Summary: KIP-769: Connect APIs to list all connector plugins and retrieve their configuration definitions Key: KAFKA-13510 URL: https://issues.apache.org/jira/browse/KAFKA-135

Re: [DISCUSS] KIP-682: Connect TimestampConverter support for multiple fields and multiple input formats

Thanks Joshua for this KIP, it looks like a useful addition. I have a few questions: 1. In Public Interfaces and Proposed Changes, the KIP mentions the current "field" setting will be renamed to "fields". Do you instead mean a new setting "fields" will be added and the existing setting will be ma

Re: Revoke Access

Hi Dnyaneshwar, You need to do this yourself by sending an email to dev-unsubscr...@kafka.apache.org from your subscribed email address. The subject and body can be empty. No one else can unsubscribe you on your behalf. Kind regards, Tom On Tue, Dec 7, 2021 at 8:38 AM Dnyaneshwar Jadhav < dnyan

Revoke Access

Hi, I would like to unsubscribe from kafka maintenance emails Accidentally I have been registered to the dev team. Hopefully in the future I might be in a good shape to contribute. *Thanks & Regards* Dnyaneshwar Dattaram Jadhav New Mumbai, INDIA +91-8097020379 LinkedIn Profile