Karsten Schnitter created KAFKA-10173:
-----------------------------------------

             Summary: BufferUnderflowException during Kafka Streams Upgrade
                 Key: KAFKA-10173
                 URL: https://issues.apache.org/jira/browse/KAFKA-10173
             Project: Kafka
          Issue Type: Bug
          Components: streams
    Affects Versions: 2.5.0
            Reporter: Karsten Schnitter


I migrated a Kafka Streams application from version 2.3.1 to 2.5.0. I followed 
the steps described in the upgrade guide and set the property 
{{migrate.from=2.3}}. On my dev system with just one running instance I got the 
following exception:

{noformat}
stream-thread [0-StreamThread-2] Encountered the following error during 
processing:
java.nio.BufferUnderflowException: null
        at java.base/java.nio.HeapByteBuffer.get(Unknown Source)
        at java.base/java.nio.ByteBuffer.get(Unknown Source)
        at 
org.apache.kafka.streams.state.internals.BufferValue.extractValue(BufferValue.java:94)
        at 
org.apache.kafka.streams.state.internals.BufferValue.deserialize(BufferValue.java:83)
        at 
org.apache.kafka.streams.state.internals.InMemoryTimeOrderedKeyValueBuffer.restoreBatch(InMemoryTimeOrderedKeyValueBuffer.java:368)
        at 
org.apache.kafka.streams.processor.internals.CompositeRestoreListener.restoreBatch(CompositeRestoreListener.java:89)
        at 
org.apache.kafka.streams.processor.internals.StateRestorer.restore(StateRestorer.java:92)
        at 
org.apache.kafka.streams.processor.internals.StoreChangelogReader.processNext(StoreChangelogReader.java:350)
        at 
org.apache.kafka.streams.processor.internals.StoreChangelogReader.restore(StoreChangelogReader.java:94)
        at 
org.apache.kafka.streams.processor.internals.TaskManager.updateNewAndRestoringTasks(TaskManager.java:401)
        at 
org.apache.kafka.streams.processor.internals.StreamThread.runOnce(StreamThread.java:779)
        at 
org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:697)
        at 
org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:670)
{noformat}

I figured out, that this problem only occurs for stores, where I use the 
suppress feature. If I rename the changelog topics during the migration, the 
problem will not occur. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to