Re: [DISCUSS] KIP-1086: Add ability to specify a custom produce request parser.

2024-12-03 Thread Maxim Fortun
gt; running code on the Kafka brokers themselves. > > I hope this context is helpful. > > Thanks, > Andrew > > From: Maxim Fortun > Sent: 02 December 2024 22:00 > To: dev@kafka.apache.org > Subject: Re: [DISCUSS] KIP-1086: Add ability to specif

Re: [DISCUSS] KIP-1086: Add ability to specify a custom produce request parser.

2024-12-02 Thread Maxim Fortun
(maybe others?) request parsing. Thanks > On Sep 3, 2024, at 4:42 PM, Maxim Fortun wrote: > > Based on feedback from Kirk and Colin I added configuring the parser class > name via server.properties, added some tests, and updated the docs to reflect > this. > I find the conf

[DISCUSS] KIP-1096: Add ability to pass headers to ProducerPerformance.

2024-10-10 Thread Maxim Fortun
Hi all, I would like to introduce a minor enhancement to ProducerPerformance class to pass headers to the create produce requests. KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-1096 Headers are useful for tracking many aspects of the performance testing. Like regions, hosts, etc...

Re: [VOTE] KIP-1086: Add ability to specify a custom produce request parser.

2024-09-14 Thread Maxim Fortun
Maybe give the >> committers a bit more time to give feedback on the KIP. >> >> Cheers, >> David >> >> On Thu, Sep 12, 2024 at 1:13 PM Maxim Fortun wrote: >> >>> Hello everyone, >>> >>> I would like to call for

[VOTE] KIP-1086: Add ability to specify a custom produce request parser.

2024-09-12 Thread Maxim Fortun
Hello everyone, I would like to call for a vote on KIP-1086: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=318606528 Discussion: https://lists.apache.org/thread/wtgt9jql43qmfsmvqcz0y1phc2n08440 Thank you, Max

Re: [DISCUSS] KIP-1086: Add ability to specify a custom produce request parser.

2024-09-03 Thread Maxim Fortun
ssing this config in. Hopefully this is ok and is not considered a code bloat. Thanks! Max > On Aug 29, 2024, at 10:25 AM, Maxim Fortun wrote: > > Hi all, > I would like to introduce a minor code change to allow custom produce request > parsers. > > KIP: > https:/

Re: [DISCUSS] KIP-1086: Add ability to specify a custom produce request parser.

2024-08-29 Thread Maxim Fortun
d be a very > significant constraint on development, which we probably wouldn't adopt > unless there was no other way forward. > > best, > Colin > > On Thu, Aug 29, 2024, at 11:27, Maxim Fortun wrote: >> Hi Colin, >> Thank you for the background. As a new

Re: [DISCUSS] KIP-1086: Add ability to specify a custom produce request parser.

2024-08-29 Thread Maxim Fortun
l want to give > access to records, not to internal data structures like Requests. This could > involve a big performance hit, but perhaps people will be willing to pay it. > > best, > Colin > > > On Thu, Aug 29, 2024, at 09:36, Maxim Fortun wrote: >> Oooh! All grea

Re: [DISCUSS] KIP-1086: Add ability to specify a custom produce request parser.

2024-08-29 Thread Maxim Fortun
esume you mean to test for a custom class specified via props, via envs, being absent, throwing exceptions at init, throwing exceptions at parse time? I'll look into creating these. Thanks, Max > > Thanks, > Kirk > >> On Aug 29, 2024, at 7:25 AM, Maxim Fortun wrote: >

[DISCUSS] KIP-1086: Add ability to specify a custom produce request parser.

2024-08-29 Thread Maxim Fortun
Hi all, I would like to introduce a minor code change to allow custom produce request parsers. KIP: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=318606528 JIRA: https://issues.apache.org/jira/browse/KAFKA-17348 PR: https://github.com/apache/kafka/pull/16812 There are many po

Re: Can't create a KIP

2024-08-29 Thread Maxim Fortun
I am now able to create a draft. Thank you, Max > On Aug 29, 2024, at 9:00 AM, Maxim Fortun wrote: > > Ah, right :) I should have started with that :) > Username: maxfortun > Thank you! > > >> On Aug 29, 2024, at 8:58 AM, Bill Bejeck wrote: >> >> Hi

Re: Can't create a KIP

2024-08-29 Thread Maxim Fortun
Ah, right :) I should have started with that :) Username: maxfortun Thank you! > On Aug 29, 2024, at 8:58 AM, Bill Bejeck wrote: > > Hi Max, > > If can share your username, and I'll set up your permissions. > > Thanks, > Bill > > On Thu, Aug 29, 2024

Can't create a KIP

2024-08-29 Thread Maxim Fortun
Hi, I created a new wiki account via selfserve yesterday, logged into wiki and tried to create a KIP, but something doesn't quite seem to connect. When I hover over "Create KIP" there is a popup that says that I do not have permissions to create content. When I click it, it yields 404. Screensh

Contributing to Kafka

2024-08-16 Thread Maxim Fortun
Hi, My Jira id is maxfortun, I do not have a wiki id. I submitted a request(https://issues.apache.org/jira/browse/INFRA-25451) for it last week, but received no response. The company I work for, Dow Jones, is trying to adopt Kafka, but one of the features we need is missing. I am trying to submit

Re: Contributing to Kafka

2024-08-15 Thread Maxim Fortun
e jira is used to describe your idea briefly, display the fix version, and > other details. Also, we can keep tech discussion over there. > > The KIP is used to discuss the public APIs or big changes. > > Hence, please file jira for your PR first. > > Best, > Chia-Ping > &g

Re: Contributing to Kafka

2024-08-15 Thread Maxim Fortun
I have described it in a pull request mentioned in the original email. Pasting below: https://github.com/apache/kafka/pull/16812 Feature/add custom produce request parsers by maxfortun · Pull Request #16812 · apache/kafka github.com Add ability to specify a custom produce request parser. A cust

Contributing to Kafka

2024-08-14 Thread Maxim Fortun
Hi, My Jira id is maxfortun, I do not have a wiki id. I submitted a request(https://issues.apache.org/jira/browse/INFRA-25451) for it last week, but received no response. The company I work for, Dow Jones, is trying to adopt Kafka, but one of the features we need is missing. I am trying to submit

Kafka PR16802: Custom produce request parsers

2024-08-07 Thread Maxim Fortun
CONTRIBUTING doc says to nag :) Please check out my PR that adds server side ability to intercept incoming messages. My org needs to be able to apply lineage and certain other tiny transforms to all the messages on the server side, and this feature would allow us to adopt Kafka. The alternative

Re: Kafka PR16802: Custom produce request parsers

2024-08-07 Thread Maxim Fortun
My Apologies, the branch was misnamed. The new PR is 16812. https://github.com/apache/kafka/pull/16812 Feature/add custom produce request parsers by maxfortun · Pull Request #16812 · apache/kafka github.com > On Aug 6, 2024, at 9:21 AM, Maxim Fortun wrote: > > CONTRIBUTING doc sa