Thanks Eduwer for reporting this problem...
It's a regression bug, introduced with
https://github.com/apache/kafka/commit/f13a22af0b3a48a4ca1bf2ece5b58f31e3b26b7d
The commit is doing some internal refactoring/cleanup, to just reverting
the commit should be fine: https://github.com/apache/kafka/pull/20398
I believe, we need a new RC...
I created https://issues.apache.org/jira/browse/KAFKA-19638 as blocker
for 4.2 release, to fix-forward.
-Matthias
On 8/22/25 2:33 PM, Eduwer Camacaro wrote:
Hello!
I just found a problem in Kafka Streams 4.1.0. I'm getting this exception
on kafka streams 4.1.0:
```
15:44:16 ERROR [STREAMS] KafkaStreams - stream-client [app1] Encountered
the following exception during processing and the registered exception
handler opted to SHUTDOWN_CLIENT. The streams client is going to shut down
now. org.apache.kafka.streams.errors.StreamsException: failed to initialize
processor random-value-processor at
org.apache.kafka.streams.processor.internals.ProcessorNode.init(ProcessorNode.java:131)
~[kafka-streams-4.1.0.jar:?] at
org.apache.kafka.streams.processor.internals.ProcessorNode.init(ProcessorNode.java:140)
~[kafka-streams-4.1.0.jar:?] at
org.apache.kafka.streams.processor.internals.StreamTask.initializeTopology(StreamTask.java:1095)
~[kafka-streams-4.1.0.jar:?] at
org.apache.kafka.streams.processor.internals.StreamTask.completeRestoration(StreamTask.java:296)
~[kafka-streams-4.1.0.jar:?] at
org.apache.kafka.streams.processor.internals.TaskManager.tryToCompleteRestoration(TaskManager.java:887)
~[kafka-streams-4.1.0.jar:?] at
org.apache.kafka.streams.processor.internals.StreamThread.initializeAndRestorePhase(StreamThread.java:1409)
~[kafka-streams-4.1.0.jar:?] at
org.apache.kafka.streams.processor.internals.StreamThread.runOnceWithoutProcessingThreads(StreamThread.java:1211)
~[kafka-streams-4.1.0.jar:?] at
org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:926)
~[kafka-streams-4.1.0.jar:?] at
org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:886)
[kafka-streams-4.1.0.jar:?] Caused by: java.lang.NullPointerException:
Cannot invoke
"org.apache.kafka.streams.processor.internals.ProcessorRecordContext.timestamp()"
because the return value of
"org.apache.kafka.streams.processor.internals.InternalProcessorContext.recordContext()"
is null at
org.apache.kafka.streams.state.internals.ChangeLoggingKeyValueBytesStore.put(ChangeLoggingKeyValueBytesStore.java:69)
~[kafka-streams-4.1.0.jar:?] at
org.apache.kafka.streams.state.internals.ChangeLoggingKeyValueBytesStore.put(ChangeLoggingKeyValueBytesStore.java:32)
~[kafka-streams-4.1.0.jar:?] at
org.apache.kafka.streams.state.internals.MeteredKeyValueStore.lambda$put$6(MeteredKeyValueStore.java:303)
~[kafka-streams-4.1.0.jar:?] at
org.apache.kafka.streams.processor.internals.metrics.StreamsMetricsImpl.maybeMeasureLatency(StreamsMetricsImpl.java:901)
~[kafka-streams-4.1.0.jar:?] at
org.apache.kafka.streams.state.internals.MeteredKeyValueStore.put(MeteredKeyValueStore.java:303)
~[kafka-streams-4.1.0.jar:?] at
org.apache.kafka.streams.processor.internals.AbstractReadWriteDecorator$KeyValueStoreReadWriteDecorator.put(AbstractReadWriteDecorator.java:123)
~[kafka-streams-4.1.0.jar:?] at
io.littlehorse.simulations.stateful.app.RandomValueProcessor.init(RandomValueProcessor.java:21)
~[kafka-streams-stateful-unspecified.jar:?] at
org.apache.kafka.streams.processor.internals.ProcessorNode.init(ProcessorNode.java:123)
~[kafka-streams-4.1.0.jar:?] ... 8 more
```
I reported the issue in the Kafka Streams community, and I just confirmed
that this PR solves the issue: https://github.com/apache/kafka/pull/20398
On Thu, Aug 21, 2025 at 11:17 AM Christo Lolov <christolo...@gmail.com>
wrote:
Hello!
I carried out the following checks:
* Built Kafka from source using JDK 24
* Ran unit tests
* Validated signatures and checksums
* Ran the quickstart tutorial
* Tested disabling and reenabling of ELR
* Tested ELR defaulting to enabled after an upgrade from a 4.0.0 cluster to
4.1.0
* Tested enabling, producing, consuming and disabling of queues
* Spot checked the Javadocs
+1 (non-binding)
Best,
Christo
On Wed, 20 Aug 2025 at 18:23, Federico Valeri <fedeval...@gmail.com>
wrote:
Hello Mickael,
I did the following:
- Build from source using JDK 17
- Ran all unit and integration tests
- Ran Docker image
- Ran clients from Kafka examples module
- Spot checked documentation
- Tested share group using staging Maven artifacts
- Tested KIP-1152
- Tested KIP-1131
- Tested KIP-891
+1 non binding
Cheers
Fede
On Tue, Aug 5, 2025 at 7:57 PM Mickael Maison <mickael.mai...@gmail.com>
wrote:
Hello Kafka users, developers and client-developers,
This is the third candidate for release of Apache Kafka 4.1.0.
The release brings many new features and improvements:
- Mechanism for plugin to register metrics
- Allow running multiple versions of connector plugins
- Queue are now in preview access
- New Streams rebalance protocol in early access
- Support for OAuth jwt-bearer grant type
- Improved metadata replication
Release notes for the 4.1.0 release:
https://dist.apache.org/repos/dist/dev/kafka/4.1.0-rc2/RELEASE_NOTES.html
*** Please download, test and vote by Friday August 8.
Kafka's KEYS file containing PGP keys we use to sign the release:
https://kafka.apache.org/KEYS
* Release artifacts to be voted upon (source and binary):
https://dist.apache.org/repos/dist/dev/kafka/4.1.0-rc2/
* Docker release artifacts to be voted upon:
apache/kafka:4.1.0-rc2
apache/kafka-native:4.1.0-rc2
* Maven artifacts to be voted upon:
https://repository.apache.org/content/groups/staging/org/apache/kafka/
* Javadoc:
https://dist.apache.org/repos/dist/dev/kafka/4.1.0-rc2/javadoc/
* Tag to be voted upon (off 4.1 branch) is the 4.1.0 tag:
https://github.com/apache/kafka/releases/tag/4.1.0-rc2
* Documentation:
https://kafka.apache.org/41/documentation.html
PR (https://github.com/apache/kafka-site/pull/702) updated for RC2 is
not merged yet
* Protocol:
https://kafka.apache.org/41/protocol.html
PR (https://github.com/apache/kafka-site/pull/702) updated for RC2 is
not merged yet
* Successful CI builds for the 4.1 branch:
Unit/integration tests:
https://github.com/apache/kafka/actions/runs/16753255070
System tests: Tests are currently running, I'll post the results once
they complete
* Successful Docker Image Github Actions Pipeline for 4.1 branch:
Docker Build Test Pipeline (JVM):
https://github.com/apache/kafka/actions/runs/16753270537
Docker Build Test Pipeline (Native):
https://github.com/apache/kafka/actions/runs/16753280218
Thanks,
Mickael
