Re: [ANNOUNCE] New Kafka PMC Member: Tom Bentley

2021-11-19 Thread Tom Bentley
Thanks folks! On Fri, Nov 19, 2021 at 5:16 AM Satish Duggana wrote: > Congratulations Tom! > > On Fri, 19 Nov 2021 at 05:53, John Roesler wrote: > > > Congratulations, Tom! > > > > On Thu, Nov 18, 2021, at 17:53, Konstantine Karantasis wrote: > > > Congratulations Tom! > > > > > > Konstantine >

Re: [DISCUSS] Bringing Kafka towards Scala 3

2021-11-19 Thread Josep Prat
Hi there, I just wanted to bump this thread as there has been a great development. Gradle 7.3 is now released and it comes with Scala 3 support (release notes ). This means that one of the roadblocks to migrate Kafka to Scala 3 has been cleared. Shall

[jira] [Created] (KAFKA-13466) when kafka-console-producer.sh, batch.size defaults is Inconsistent with official documentation

2021-11-19 Thread peterwanner (Jira)
peterwanner created KAFKA-13466: --- Summary: when kafka-console-producer.sh, batch.size defaults is Inconsistent with official documentation Key: KAFKA-13466 URL: https://issues.apache.org/jira/browse/KAFKA-13466

Re: KIP-800: Add reason to LeaveGroupRequest

2021-11-19 Thread David Jacot
Thank you all for your feedback. Let me address all your points below. Luke, 1. I use a tag field so bumping the request version is not necessary. In this case, using a tag field does not seem to be the best approach so I will use a regular one and bump the version. 2. Sounds good. I will fix that

Re: [VOTE] KIP-779: Allow Source Tasks to Handle Producer Exceptions

2021-11-19 Thread Knowles Atchison Jr
Thank you all for voting. We still need two more binding votes. I have rebased and updated the PR to be ready to go once this vote passes: https://github.com/apache/kafka/pull/11382 Knowles On Tue, Nov 16, 2021 at 3:43 PM Chris Egerton wrote: > +1 (non-binding). Thanks Knowles! > > On Tue, No

Re: KIP-800: Add reason to LeaveGroupRequest

2021-11-19 Thread David Jacot
I have updated the KIP. Best, David On Fri, Nov 19, 2021 at 3:00 PM David Jacot wrote: > > Thank you all for your feedback. Let me address all your points below. > > Luke, > 1. I use a tag field so bumping the request version is not necessary. In > this case, using a tag field does not seem to b

[jira] [Resolved] (KAFKA-9648) Add configuration to adjust listen backlog size for Acceptor

2021-11-19 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-9648. Fix Version/s: 3.2.0 Reviewer: David Jacot Resolution: Fixed > Add configuration to

Re: [VOTE} KIP-796: Interactive Query v2

2021-11-19 Thread Vasiliki Papavasileiou
I think this KIP will greatly improve how we handle IQ in streams so +1 (non-binding) from me. Thank you John! On Thu, Nov 18, 2021 at 9:45 PM Patrick Stuedi wrote: > +1 (non-binding), thanks John! > -Patrick > > On Thu, Nov 18, 2021 at 12:27 AM John Roesler wrote: > > > Hello all, > > > > I'd

[GitHub] [kafka-site] mumrah merged pull request #384: Update David Arthur photo

2021-11-19 Thread GitBox
mumrah merged pull request #384: URL: https://github.com/apache/kafka-site/pull/384 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr..

[jira] [Created] (KAFKA-13467) Clients never refresh cached bootstrap IPs

2021-11-19 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-13467: --- Summary: Clients never refresh cached bootstrap IPs Key: KAFKA-13467 URL: https://issues.apache.org/jira/browse/KAFKA-13467 Project: Kafka Issue Type:

[jira] [Resolved] (KAFKA-13405) Kafka Streams restore-consumer fails to refresh broker IPs after upgrading Kafka cluster

2021-11-19 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-13405. - Resolution: Not A Bug > Kafka Streams restore-consumer fails to refresh broker IPs after

Re: [DISCUSS] KIP-778 KRaft Upgrades

2021-11-19 Thread Jun Rao
Hi, David, Thanks for the reply. The new CLI sounds reasonable to me. 16. For case C, choosing the latest version sounds good to me. For case B, for metadata.version, we pick version 1 since it just happens that for metadata.version version 1 is backward compatible. How do we make this more gener

[VOTE] KIP-798 Add possibility to write kafka headers in Kafka Console Producer

2021-11-19 Thread flo

Re: [DISCUSS] KIP-794: Strictly Uniform Sticky Partitioner

2021-11-19 Thread Artem Livshits
Hello, During implementation it turned out that the existing Partitioner.partition method doesn't have enough arguments to accurately estimate record size in bytes (e.g. it doesn't have headers, cannot take compression into account, etc.). So I'm proposing to add a new Partitioner.partition metho

Re: Do we want to add more SMTs to Apache Kafka?

2021-11-19 Thread Gunnar Morling
Hi all, Just came across this thread, I hope the late reply is ok. FWIW, we're in a similar situation in Debezium, where users often request new (Debezium-specific) SMTs, and we generally tend to recommend them to be maintained by users themselves, unless they are truly generic. This excludes a s

Re: Do we want to add more SMTs to Apache Kafka?

2021-11-19 Thread Brandon Brown
I agree, if the desire is to keep the internal SMTs collection small then providing an ease of discovery like Gunnar suggestions would be extremely helpful. Brandon Brown > On Nov 19, 2021, at 6:13 PM, Gunnar Morling > wrote: > > Hi all, > > Just came across this thread, I hope the late r

Re: Errors thrown from a KStream transformer are swallowed, eg. StackOverflowError

2021-11-19 Thread Matthias J. Sax
Not sure what version you are using, but it say `Thrwoable` in `trunk` https://github.com/apache/kafka/blob/trunk/streams/src/main/java/org/apache/kafka/streams/processor/internals/StreamThread.java#L577 -Matthias On 11/18/21 6:09 AM, John Roesler wrote: Thanks for pointing that out, Scott!

Re: [ANNOUNCE] New Kafka PMC Member: Tom Bentley

2021-11-19 Thread Matthias J. Sax
Congrats! On 11/19/21 2:29 AM, Tom Bentley wrote: Thanks folks! On Fri, Nov 19, 2021 at 5:16 AM Satish Duggana wrote: Congratulations Tom! On Fri, 19 Nov 2021 at 05:53, John Roesler wrote: Congratulations, Tom! On Thu, Nov 18, 2021, at 17:53, Konstantine Karantasis wrote: Congratulatio

[jira] [Created] (KAFKA-13468) Consumers may hang because IOException in Log# does not trigger KafkaStorageException

2021-11-19 Thread Haoze Wu (Jira)
Haoze Wu created KAFKA-13468: Summary: Consumers may hang because IOException in Log# does not trigger KafkaStorageException Key: KAFKA-13468 URL: https://issues.apache.org/jira/browse/KAFKA-13468 Project

Re: [ANNOUNCE] New Kafka PMC Member: Tom Bentley

2021-11-19 Thread Dongjin Lee
Congratulations, Tom! Thanks, Dongjin On Sat, Nov 20, 2021 at 9:50 AM Matthias J. Sax wrote: > Congrats! > > On 11/19/21 2:29 AM, Tom Bentley wrote: > > Thanks folks! > > > > On Fri, Nov 19, 2021 at 5:16 AM Satish Duggana > > > wrote: > > > >> Congratulations Tom! > >> > >> On Fri, 19 Nov 2021