Re: Errors thrown from a KStream transformer are swallowed, eg. StackOverflowError

Yes, I confirmed that in KAFKA-9331 ( https://github.com/apache/kafka/pull/9487), we removed the `catch (exception)` block for adding uncaught exception handler. Then, in KAFKA-12537(https://github.com/apache/kafka/pull/10387), we added `catch (Thrwoable)` (in v2.8.0). So, @Sinclair, if you upgrad

Re: poll block question

Hi xusheng, I checked the code stack, and mapped to the kafka code, I can see we either use Selector#selectNow, or Selector#select(timeoutMs), which should never hang forever. If so, I think it might be the `timeoutMS` is too large, and from your code stack, the timeoutMS came from the Consumer#pol

Re: KIP-800: Add reason to LeaveGroupRequest

Hi David, Sorry for the late reply. Thanks for the update. It looks good now. I love the idea to add joinGroup request reason, as well as the `enforceRebalance` API! One minor comment, since we extended the original KIP from leaveGroup to joinGroup request, Could you please update the KIP title an

[jira] [Created] (KAFKA-13481) poll(Duration) hung forever need restart

jimmy huang created KAFKA-13481: --- Summary: poll(Duration) hung forever need restart Key: KAFKA-13481 URL: https://issues.apache.org/jira/browse/KAFKA-13481 Project: Kafka Issue Type: Bug

[jira] [Resolved] (KAFKA-13480) IQv2: Track Position in KeyValue stores

[ https://issues.apache.org/jira/browse/KAFKA-13480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler resolved KAFKA-13480. -- Resolution: Fixed > IQv2: Track Position in KeyValue stores >

[jira] [Created] (KAFKA-13480) IQv2: Track Position in KeyValue stores

John Roesler created KAFKA-13480: Summary: IQv2: Track Position in KeyValue stores Key: KAFKA-13480 URL: https://issues.apache.org/jira/browse/KAFKA-13480 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-13479) Interactive Query v2

John Roesler created KAFKA-13479: Summary: Interactive Query v2 Key: KAFKA-13479 URL: https://issues.apache.org/jira/browse/KAFKA-13479 Project: Kafka Issue Type: New Feature Compon

Re: [VOTE] KIP-800: Add reason to LeaveGroupRequest

+1 Thanks for driving David. Super useful. On Wed, Nov 24, 2021 at 8:53 AM David Jacot wrote: > Hi folks, > > I'd like to start a vote on KIP-800: Add reason to LeaveGroupRequest. > > KIP: https://cwiki.apache.org/confluence/x/eYyqCw > > Please let me know what you think. > > Best, > David >

Permission to contribute to Apache Kafka

Hi, I would like to be able to contribute to Apache Kafka. Wiki ID: brett.jordan Jira ID: brett.jordan Cheers, [image: Airwallex] Brett Jordan Engineering Lead - FX Product +61 423 105 564 <+61423105564> brett.jor...@airwallex.com [image: Airwallex]

[jira] [Resolved] (KAFKA-13357) Controller snapshot contains producer ids records but broker does not

[ https://issues.apache.org/jira/browse/KAFKA-13357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jose Armando Garcia Sancio resolved KAFKA-13357. Resolution: Fixed > Controller snapshot contains producer ids reco

[VOTE] KIP-800: Add reason to LeaveGroupRequest

Hi folks, I'd like to start a vote on KIP-800: Add reason to LeaveGroupRequest. KIP: https://cwiki.apache.org/confluence/x/eYyqCw Please let me know what you think. Best, David

[DISCUSS] KIP-802: Validation Support for Kafka Connect SMT Options

Hey all, I would like to propose a KIP for Apache Kafka Connect which adds validation support for SMT-related configuration options: https://cwiki.apache.org/confluence/display/KAFKA/KIP-802%3A+Validation+Support+for+Kafka+Connect+SMT+Options This feature allows users to make sure an SMT is con

[Discuss] KIP-803: Add Task ID and Connector Name to Connect Task Context

I have written a KIP for adding Task ID and Connector name to the Connect API task context. Here is the doc: https://cwiki.apache.org/confluence/x/4pKqCw Looking forward to hearing all of your thoughts!

[jira] [Created] (KAFKA-13478) KIP-802: Validation Support for Kafka Connect SMT Options

Gunnar Morling created KAFKA-13478: -- Summary: KIP-802: Validation Support for Kafka Connect SMT Options Key: KAFKA-13478 URL: https://issues.apache.org/jira/browse/KAFKA-13478 Project: Kafka

[jira] [Created] (KAFKA-13477) Add Task ID and Connector Name to Connect Task Context

Sarah Story created KAFKA-13477: --- Summary: Add Task ID and Connector Name to Connect Task Context Key: KAFKA-13477 URL: https://issues.apache.org/jira/browse/KAFKA-13477 Project: Kafka Issue Ty

poll block question

hi i find something not sure about poll. i need some help my kafka server version is 1.1.0 my kafka client version is 2.3.0 then 128 partition of topic xxx, start 128 thread in one application to consume message. always run well, but run about a week long , i find there is a consumer hang forever

[jira] [Created] (KAFKA-13476) Streams crashes when non Base64 Offset Metadata is found

Richard Bosch created KAFKA-13476: - Summary: Streams crashes when non Base64 Offset Metadata is found Key: KAFKA-13476 URL: https://issues.apache.org/jira/browse/KAFKA-13476 Project: Kafka Is

[jira] [Created] (KAFKA-13475) max-compaction-delay-secs reported at one clean "behind" current state

Joe created KAFKA-13475: --- Summary: max-compaction-delay-secs reported at one clean "behind" current state Key: KAFKA-13475 URL: https://issues.apache.org/jira/browse/KAFKA-13475 Project: Kafka Issue T

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.1 #22

See Changes: -- [...truncated 499919 lines...] [2021-11-24T12:14:21.430Z] MetricsTest > testBrokerStateMetric(String) > kafka.metrics.MetricsTest.testBrokerStateMetric(String)

Re: [DISCUSS] Apache Kafka 3.1.0 release

Hi Mickael, Thanks for reporting it. It makes sense to include it in the 3.1 release as well as it is a regression. Thanks, David On Tue, Nov 23, 2021 at 6:52 PM Mickael Maison wrote: > > Hi David, > > Can we also consider https://issues.apache.org/jira/browse/KAFKA-13397? > It's essentially a

Re: [DISCUSS] KIP-782: Expandable batch size in producer

Hi Artem, Yes, I agree if we go with random selection instead of round-robin selection, the latency issue will be more fair. That is, if there are 10 partitions, the 10th partition will always be the last choice in each round in current design, but with random selection, the chance to be selected i

[jira] [Resolved] (KAFKA-13457) SocketChannel in Acceptor#accept is not closed upon IOException

[ https://issues.apache.org/jira/browse/KAFKA-13457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-13457. - Fix Version/s: 3.2.0 Reviewer: David Jacot Resolution: Fixed > SocketChannel in

Re: [VOTE] KIP-798 Add possibility to write kafka headers in Kafka Console Producer

Hi Florin, Yes, you can close the vote. Best, David On Wed, Nov 24, 2021 at 3:19 AM Luke Chen wrote: > > Hi Florin, > I'm not a committer, but yes, this vote be concluded now. > > Thank you. > Luke > > On Wed, Nov 24, 2021 at 3:08 AM Florin Akermann > wrote: > > > Thanks all. > > > > The 72h w