[ https://issues.apache.org/jira/browse/KAFKA-15648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
David Arthur updated KAFKA-15648: --------------------------------- Labels: flaky-test good-first-issue (was: ) > QuorumControllerTest#testBootstrapZkMigrationRecord is flaky > ------------------------------------------------------------ > > Key: KAFKA-15648 > URL: https://issues.apache.org/jira/browse/KAFKA-15648 > Project: Kafka > Issue Type: Bug > Components: controller, unit tests > Reporter: David Arthur > Priority: Minor > Labels: flaky-test, good-first-issue > > Noticed that this test failed on Jenkins with > {code} > org.apache.kafka.server.fault.FaultHandlerException: fatalFaultHandler: > exception while completing controller activation: Should not have ZK > migrations enabled on a cluster running metadata.version 3.0-IV1 > at > app//org.apache.kafka.controller.ActivationRecordsGenerator.recordsForNonEmptyLog(ActivationRecordsGenerator.java:154) > at > app//org.apache.kafka.controller.ActivationRecordsGenerator.generate(ActivationRecordsGenerator.java:229) > at > app//org.apache.kafka.controller.QuorumController$CompleteActivationEvent.generateRecordsAndResult(QuorumController.java:1237) > at > app//org.apache.kafka.controller.QuorumController$ControllerWriteEvent.run(QuorumController.java:784) > at > app//org.apache.kafka.queue.KafkaEventQueue$EventContext.run(KafkaEventQueue.java:127) > at > app//org.apache.kafka.queue.KafkaEventQueue$EventHandler.handleEvents(KafkaEventQueue.java:210) > at > app//org.apache.kafka.queue.KafkaEventQueue$EventHandler.run(KafkaEventQueue.java:181) > at java.base@11.0.16.1/java.lang.Thread.run(Thread.java:829) > Caused by: java.lang.RuntimeException: Should not have ZK migrations enabled > on a cluster running metadata.version 3.0-IV1 > ... 8 more > {code} > When trying to reproduce this failure locally, I ran into a separate flaky > failure > {code} > [2023-10-19 13:42:09,442] INFO Elected new leader: > LeaderAndEpoch(leaderId=OptionalInt[0], epoch=1). > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:300) > [2023-10-19 13:42:09,442] DEBUG > append(batch=LeaderChangeBatch(newLeader=LeaderAndEpoch(leaderId=OptionalInt[0], > epoch=1)), nextEndOffset=0) > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:276) > [2023-10-19 13:42:09,442] DEBUG [LocalLogManager 0] Node 0: running log > check. (org.apache.kafka.metalog.LocalLogManager:536) > [2023-10-19 13:42:09,442] DEBUG [LocalLogManager 0] initialized local log > manager for node 0 (org.apache.kafka.metalog.LocalLogManager:685) > [2023-10-19 13:42:09,442] DEBUG [QuorumController id=0] Creating in-memory > snapshot -1 (org.apache.kafka.timeline.SnapshotRegistry:203) > [2023-10-19 13:42:09,442] INFO [QuorumController id=0] Creating new > QuorumController with clusterId K8TDRiYZQuepVQHPgwP91A. ZK migration mode is > enabled. (org.apache.kafka.controller.QuorumController:1912) > [2023-10-19 13:42:09,442] INFO [LocalLogManager 0] Node 0: registered > MetaLogListener 1238203422 (org.apache.kafka.metalog.LocalLogManager:703) > [2023-10-19 13:42:09,443] DEBUG [LocalLogManager 0] Node 0: running log > check. (org.apache.kafka.metalog.LocalLogManager:536) > [2023-10-19 13:42:09,443] DEBUG [LocalLogManager 0] Node 0: Executing > handleLeaderChange LeaderAndEpoch(leaderId=OptionalInt[0], epoch=1) > (org.apache.kafka.metalog.LocalLogManager:578) > [2023-10-19 13:42:09,443] DEBUG [QuorumController id=0] Executing > handleLeaderChange[1]. (org.apache.kafka.controller.QuorumController:577) > [2023-10-19 13:42:09,443] INFO [QuorumController id=0] In the new epoch 1, > the leader is (none). (org.apache.kafka.controller.QuorumController:1179) > [2023-10-19 13:42:09,443] DEBUG [QuorumController id=0] Processed > handleLeaderChange[1] in 25 us > (org.apache.kafka.controller.QuorumController:510) > [2023-10-19 13:42:09,443] DEBUG [QuorumController id=0] Executing > handleLeaderChange[1]. (org.apache.kafka.controller.QuorumController:577) > [2023-10-19 13:42:09,443] INFO [QuorumController id=0] Becoming the active > controller at epoch 1, next write offset 1. > (org.apache.kafka.controller.QuorumController:1175) > [2023-10-19 13:42:09,443] DEBUG [QuorumController id=0] Processed > handleLeaderChange[1] in 34 us > (org.apache.kafka.controller.QuorumController:510) > [2023-10-19 13:42:09,443] WARN [QuorumController id=0] Performing controller > activation. The metadata log appears to be empty. Appending 1 bootstrap > record(s) at metadata.version 3.4-IV0 from bootstrap source 'test'. Putting > the controller into pre-migration mode. No metadata updates will be allowed > until the ZK metadata has been migrated. > (org.apache.kafka.controller.QuorumController:108) > [2023-10-19 13:42:09,443] INFO [QuorumController id=0] Replayed a > FeatureLevelRecord setting metadata version to 3.4-IV0 > (org.apache.kafka.controller.FeatureControlManager:400) > [2023-10-19 13:42:09,443] INFO [QuorumController id=0] Replayed a > ZkMigrationStateRecord changing the migration state from NONE to > PRE_MIGRATION. (org.apache.kafka.controller.FeatureControlManager:421) > [2023-10-19 13:42:09,443] DEBUG append(batch=LocalRecordBatch(leaderEpoch=1, > appendTimestamp=10, > records=[ApiMessageAndVersion(FeatureLevelRecord(name='metadata.version', > featureLevel=8) at version 0), > ApiMessageAndVersion(ZkMigrationStateRecord(zkMigrationState=2) at version > 0)]), nextEndOffset=2) > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:276) > [2023-10-19 13:42:09,443] DEBUG [QuorumController id=0] Creating in-memory > snapshot 2 (org.apache.kafka.timeline.SnapshotRegistry:203) > [2023-10-19 13:42:09,443] DEBUG [QuorumController id=0] Read-write operation > completeActivation[1](1689476270) will be completed when the log reaches > offset 2. (org.apache.kafka.controller.QuorumController:849) > [2023-10-19 13:42:09,443] DEBUG [LocalLogManager 0] Node 0: running log > check. (org.apache.kafka.metalog.LocalLogManager:536) > [2023-10-19 13:42:09,443] DEBUG [QuorumController id=0] Executing > handleCommit[baseOffset=1]. (org.apache.kafka.controller.QuorumController:577) > [2023-10-19 13:42:09,443] DEBUG [QuorumController id=0] Completing purgatory > items up to offset 2 and epoch 1. > (org.apache.kafka.controller.QuorumController:1065) > [2023-10-19 13:42:09,443] DEBUG [QuorumController id=0] Deleting in-memory > snapshot -1 (org.apache.kafka.timeline.SnapshotRegistry:247) > [2023-10-19 13:42:09,443] DEBUG [QuorumController id=0] completeUpTo(2): > successfully completing completeActivation[1](1689476270) > (org.apache.kafka.deferred.DeferredEventQueue:61) > [2023-10-19 13:42:09,443] DEBUG [QuorumController id=0] Processed > completeActivation[1](1689476270) in 462 us > (org.apache.kafka.controller.QuorumController:510) > [2023-10-19 13:42:09,443] DEBUG [QuorumController id=0] Processed > handleCommit[baseOffset=1] in 209 us > (org.apache.kafka.controller.QuorumController:510) > [2023-10-19 13:42:09,447] DEBUG [QuorumController id=0] Processed read > migration state(565300828) in 9 us > (org.apache.kafka.controller.QuorumController:510) > [2023-10-19 13:42:09,447] INFO [QuorumController id=0] > QuorumController#beginShutdown: shutting down event queue. > (org.apache.kafka.queue.KafkaEventQueue:492) > [2023-10-19 13:42:09,447] DEBUG [QuorumController id=0] > KafkaEventQueue#close: Event queue is already shutting down. > (org.apache.kafka.queue.KafkaEventQueue:489) > [2023-10-19 13:42:09,448] INFO [QuorumController id=0] closed event queue. > (org.apache.kafka.queue.KafkaEventQueue:514) > [2023-10-19 13:42:09,448] INFO [LocalLogManager 0] beginShutdown: shutting > down event queue. (org.apache.kafka.queue.KafkaEventQueue:492) > [2023-10-19 13:42:09,448] DEBUG [LocalLogManager 0] Node 0: closing. > (org.apache.kafka.metalog.LocalLogManager:653) > [2023-10-19 13:42:09,448] DEBUG [LocalLogManager 0] Node 0: beginning > shutdown. (org.apache.kafka.metalog.LocalLogManager:637) > [2023-10-19 13:42:09,448] DEBUG [LocalLogManager 0] beginShutdown: Event > queue is already shutting down. (org.apache.kafka.queue.KafkaEventQueue:489) > [2023-10-19 13:42:09,448] DEBUG [LocalLogManager 0] KafkaEventQueue#close: > Event queue is already shutting down. > (org.apache.kafka.queue.KafkaEventQueue:489) > [2023-10-19 13:42:09,448] DEBUG > append(batch=LeaderChangeBatch(newLeader=LeaderAndEpoch(leaderId=OptionalInt.empty, > epoch=2)), nextEndOffset=3) > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:276) > [2023-10-19 13:42:09,448] INFO Elected new leader: > LeaderAndEpoch(leaderId=OptionalInt[0], epoch=3). > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:300) > [2023-10-19 13:42:09,448] DEBUG > append(batch=LeaderChangeBatch(newLeader=LeaderAndEpoch(leaderId=OptionalInt[0], > epoch=3)), nextEndOffset=4) > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:276) > [2023-10-19 13:42:09,448] DEBUG [QuorumController id=0] > MetaLogManager.Listener: Event queue is already shutting down. > (org.apache.kafka.queue.KafkaEventQueue:489) > [2023-10-19 13:42:09,448] INFO [LocalLogManager 0] closed event queue. > (org.apache.kafka.queue.KafkaEventQueue:514) > [2023-10-19 13:42:09,449] INFO Elected new leader: > LeaderAndEpoch(leaderId=OptionalInt[0], epoch=1). > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:300) > [2023-10-19 13:42:09,450] DEBUG > append(batch=LeaderChangeBatch(newLeader=LeaderAndEpoch(leaderId=OptionalInt[0], > epoch=1)), nextEndOffset=0) > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:276) > [2023-10-19 13:42:09,450] DEBUG [LocalLogManager 0] Node 0: running log > check. (org.apache.kafka.metalog.LocalLogManager:536) > [2023-10-19 13:42:09,450] DEBUG [LocalLogManager 0] initialized local log > manager for node 0 (org.apache.kafka.metalog.LocalLogManager:685) > [2023-10-19 13:42:09,450] DEBUG [QuorumController id=0] Creating in-memory > snapshot -1 (org.apache.kafka.timeline.SnapshotRegistry:203) > [2023-10-19 13:42:09,450] INFO [QuorumController id=0] Creating new > QuorumController with clusterId jhXUIK37QHCACVQD4CArkQ. > (org.apache.kafka.controller.QuorumController:1912) > [2023-10-19 13:42:09,450] INFO [LocalLogManager 0] Node 0: registered > MetaLogListener 521943667 (org.apache.kafka.metalog.LocalLogManager:703) > [2023-10-19 13:42:09,450] DEBUG [LocalLogManager 0] Node 0: running log > check. (org.apache.kafka.metalog.LocalLogManager:536) > [2023-10-19 13:42:09,450] DEBUG [LocalLogManager 0] Node 0: Executing > handleLeaderChange LeaderAndEpoch(leaderId=OptionalInt[0], epoch=1) > (org.apache.kafka.metalog.LocalLogManager:578) > [2023-10-19 13:42:09,450] DEBUG [QuorumController id=0] Executing > handleLeaderChange[1]. (org.apache.kafka.controller.QuorumController:577) > [2023-10-19 13:42:09,450] INFO [QuorumController id=0] In the new epoch 1, > the leader is (none). (org.apache.kafka.controller.QuorumController:1179) > [2023-10-19 13:42:09,450] DEBUG [QuorumController id=0] Processed > handleLeaderChange[1] in 24 us > (org.apache.kafka.controller.QuorumController:510) > [2023-10-19 13:42:09,450] DEBUG [QuorumController id=0] Executing > handleLeaderChange[1]. (org.apache.kafka.controller.QuorumController:577) > [2023-10-19 13:42:09,450] INFO [QuorumController id=0] Becoming the active > controller at epoch 1, next write offset 1. > (org.apache.kafka.controller.QuorumController:1175) > [2023-10-19 13:42:09,450] DEBUG [QuorumController id=0] Processed > handleLeaderChange[1] in 34 us > (org.apache.kafka.controller.QuorumController:510) > [2023-10-19 13:42:09,451] WARN [QuorumController id=0] Performing controller > activation. The metadata log appears to be empty. Appending 1 bootstrap > record(s) at metadata.version 3.4-IV0 from bootstrap source 'test'. Setting > the ZK migration state to NONE since this is a de-novo KRaft cluster. > (org.apache.kafka.controller.QuorumController:108) > [2023-10-19 13:42:09,451] INFO [QuorumController id=0] Replayed a > FeatureLevelRecord setting metadata version to 3.4-IV0 > (org.apache.kafka.controller.FeatureControlManager:400) > [2023-10-19 13:42:09,451] DEBUG [QuorumController id=0] Replayed a > ZkMigrationStateRecord which did not alter the state from NONE. > (org.apache.kafka.controller.FeatureControlManager:417) > [2023-10-19 13:42:09,451] DEBUG append(batch=LocalRecordBatch(leaderEpoch=1, > appendTimestamp=10, > records=[ApiMessageAndVersion(FeatureLevelRecord(name='metadata.version', > featureLevel=8) at version 0), > ApiMessageAndVersion(ZkMigrationStateRecord(zkMigrationState=0) at version > 0)]), nextEndOffset=2) > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:276) > [2023-10-19 13:42:09,451] DEBUG [QuorumController id=0] Creating in-memory > snapshot 2 (org.apache.kafka.timeline.SnapshotRegistry:203) > [2023-10-19 13:42:09,451] DEBUG [QuorumController id=0] Read-write operation > completeActivation[1](211991183) will be completed when the log reaches > offset 2. (org.apache.kafka.controller.QuorumController:849) > [2023-10-19 13:42:09,451] DEBUG [LocalLogManager 0] Node 0: running log > check. (org.apache.kafka.metalog.LocalLogManager:536) > [2023-10-19 13:42:09,451] DEBUG [QuorumController id=0] Executing > handleCommit[baseOffset=1]. (org.apache.kafka.controller.QuorumController:577) > [2023-10-19 13:42:09,451] DEBUG [QuorumController id=0] Completing purgatory > items up to offset 2 and epoch 1. > (org.apache.kafka.controller.QuorumController:1065) > [2023-10-19 13:42:09,451] DEBUG [QuorumController id=0] Deleting in-memory > snapshot -1 (org.apache.kafka.timeline.SnapshotRegistry:247) > [2023-10-19 13:42:09,451] DEBUG [QuorumController id=0] completeUpTo(2): > successfully completing completeActivation[1](211991183) > (org.apache.kafka.deferred.DeferredEventQueue:61) > [2023-10-19 13:42:09,451] DEBUG [QuorumController id=0] Processed > completeActivation[1](211991183) in 233 us > (org.apache.kafka.controller.QuorumController:510) > [2023-10-19 13:42:09,451] DEBUG [QuorumController id=0] Processed > handleCommit[baseOffset=1] in 64 us > (org.apache.kafka.controller.QuorumController:510) > [2023-10-19 13:42:09,454] DEBUG [QuorumController id=0] Processed read > migration state(144519107) in 15 us > (org.apache.kafka.controller.QuorumController:510) > [2023-10-19 13:42:09,455] INFO [QuorumController id=0] > QuorumController#beginShutdown: shutting down event queue. > (org.apache.kafka.queue.KafkaEventQueue:492) > [2023-10-19 13:42:09,455] DEBUG [QuorumController id=0] > KafkaEventQueue#close: Event queue is already shutting down. > (org.apache.kafka.queue.KafkaEventQueue:489) > [2023-10-19 13:42:09,455] INFO [QuorumController id=0] closed event queue. > (org.apache.kafka.queue.KafkaEventQueue:514) > [2023-10-19 13:42:09,455] INFO [LocalLogManager 0] beginShutdown: shutting > down event queue. (org.apache.kafka.queue.KafkaEventQueue:492) > [2023-10-19 13:42:09,455] DEBUG [LocalLogManager 0] Node 0: closing. > (org.apache.kafka.metalog.LocalLogManager:653) > [2023-10-19 13:42:09,455] DEBUG [LocalLogManager 0] beginShutdown: Event > queue is already shutting down. (org.apache.kafka.queue.KafkaEventQueue:489) > [2023-10-19 13:42:09,455] DEBUG [LocalLogManager 0] KafkaEventQueue#close: > Event queue is already shutting down. > (org.apache.kafka.queue.KafkaEventQueue:489) > [2023-10-19 13:42:09,455] DEBUG [LocalLogManager 0] Node 0: beginning > shutdown. (org.apache.kafka.metalog.LocalLogManager:637) > [2023-10-19 13:42:09,456] DEBUG > append(batch=LeaderChangeBatch(newLeader=LeaderAndEpoch(leaderId=OptionalInt.empty, > epoch=2)), nextEndOffset=3) > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:276) > [2023-10-19 13:42:09,456] INFO Elected new leader: > LeaderAndEpoch(leaderId=OptionalInt[0], epoch=3). > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:300) > [2023-10-19 13:42:09,456] DEBUG > append(batch=LeaderChangeBatch(newLeader=LeaderAndEpoch(leaderId=OptionalInt[0], > epoch=3)), nextEndOffset=4) > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:276) > [2023-10-19 13:42:09,456] DEBUG [QuorumController id=0] > MetaLogManager.Listener: Event queue is already shutting down. > (org.apache.kafka.queue.KafkaEventQueue:489) > [2023-10-19 13:42:09,456] INFO [LocalLogManager 0] closed event queue. > (org.apache.kafka.queue.KafkaEventQueue:514) > [2023-10-19 13:42:09,458] INFO Elected new leader: > LeaderAndEpoch(leaderId=OptionalInt[0], epoch=1). > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:300) > [2023-10-19 13:42:09,458] DEBUG > append(batch=LeaderChangeBatch(newLeader=LeaderAndEpoch(leaderId=OptionalInt[0], > epoch=1)), nextEndOffset=0) > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:276) > [2023-10-19 13:42:09,458] DEBUG [LocalLogManager 0] Node 0: running log > check. (org.apache.kafka.metalog.LocalLogManager:536) > [2023-10-19 13:42:09,458] DEBUG [LocalLogManager 0] initialized local log > manager for node 0 (org.apache.kafka.metalog.LocalLogManager:685) > [2023-10-19 13:42:09,458] DEBUG [QuorumController id=0] Creating in-memory > snapshot -1 (org.apache.kafka.timeline.SnapshotRegistry:203) > [2023-10-19 13:42:09,458] INFO [QuorumController id=0] Creating new > QuorumController with clusterId ACZHODtYRUWy_02iltPCfQ. > (org.apache.kafka.controller.QuorumController:1912) > [2023-10-19 13:42:09,458] INFO [LocalLogManager 0] Node 0: registered > MetaLogListener 1558249098 (org.apache.kafka.metalog.LocalLogManager:703) > [2023-10-19 13:42:09,458] DEBUG [LocalLogManager 0] Node 0: running log > check. (org.apache.kafka.metalog.LocalLogManager:536) > [2023-10-19 13:42:09,458] DEBUG [LocalLogManager 0] Node 0: Executing > handleLeaderChange LeaderAndEpoch(leaderId=OptionalInt[0], epoch=1) > (org.apache.kafka.metalog.LocalLogManager:578) > [2023-10-19 13:42:09,458] DEBUG [QuorumController id=0] Executing > handleLeaderChange[1]. (org.apache.kafka.controller.QuorumController:577) > [2023-10-19 13:42:09,458] INFO [QuorumController id=0] In the new epoch 1, > the leader is (none). (org.apache.kafka.controller.QuorumController:1179) > [2023-10-19 13:42:09,458] DEBUG [QuorumController id=0] Processed > handleLeaderChange[1] in 65 us > (org.apache.kafka.controller.QuorumController:510) > [2023-10-19 13:42:09,458] DEBUG [QuorumController id=0] Executing > handleLeaderChange[1]. (org.apache.kafka.controller.QuorumController:577) > [2023-10-19 13:42:09,458] INFO [QuorumController id=0] Becoming the active > controller at epoch 1, next write offset 1. > (org.apache.kafka.controller.QuorumController:1175) > [2023-10-19 13:42:09,458] DEBUG [QuorumController id=0] Processed > handleLeaderChange[1] in 93 us > (org.apache.kafka.controller.QuorumController:510) > [2023-10-19 13:42:09,458] WARN [QuorumController id=0] Performing controller > activation. The metadata log appears to be empty. Appending 1 bootstrap > record(s) at metadata.version 3.3-IV0 from bootstrap source 'test'. > (org.apache.kafka.controller.QuorumController:108) > [2023-10-19 13:42:09,458] INFO [QuorumController id=0] Replayed a > FeatureLevelRecord setting metadata version to 3.3-IV0 > (org.apache.kafka.controller.FeatureControlManager:400) > [2023-10-19 13:42:09,459] DEBUG append(batch=LocalRecordBatch(leaderEpoch=1, > appendTimestamp=10, > records=[ApiMessageAndVersion(FeatureLevelRecord(name='metadata.version', > featureLevel=4) at version 0)]), nextEndOffset=1) > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:276) > [2023-10-19 13:42:09,459] DEBUG [QuorumController id=0] Creating in-memory > snapshot 1 (org.apache.kafka.timeline.SnapshotRegistry:203) > [2023-10-19 13:42:09,459] DEBUG [QuorumController id=0] Read-write operation > completeActivation[1](482477678) will be completed when the log reaches > offset 1. (org.apache.kafka.controller.QuorumController:849) > [2023-10-19 13:42:09,459] DEBUG [LocalLogManager 0] Node 0: running log > check. (org.apache.kafka.metalog.LocalLogManager:536) > [2023-10-19 13:42:09,459] DEBUG [QuorumController id=0] Executing > handleCommit[baseOffset=1]. (org.apache.kafka.controller.QuorumController:577) > [2023-10-19 13:42:09,459] DEBUG [QuorumController id=0] Completing purgatory > items up to offset 1 and epoch 1. > (org.apache.kafka.controller.QuorumController:1065) > [2023-10-19 13:42:09,459] DEBUG [QuorumController id=0] Deleting in-memory > snapshot -1 (org.apache.kafka.timeline.SnapshotRegistry:247) > [2023-10-19 13:42:09,459] DEBUG [QuorumController id=0] completeUpTo(1): > successfully completing completeActivation[1](482477678) > (org.apache.kafka.deferred.DeferredEventQueue:61) > [2023-10-19 13:42:09,459] DEBUG [QuorumController id=0] Processed > completeActivation[1](482477678) in 681 us > (org.apache.kafka.controller.QuorumController:510) > [2023-10-19 13:42:09,459] DEBUG [QuorumController id=0] Processed > handleCommit[baseOffset=1] in 243 us > (org.apache.kafka.controller.QuorumController:510) > [2023-10-19 13:42:09,468] DEBUG [QuorumController id=0] Processed read > migration state(419270958) in 22 us > (org.apache.kafka.controller.QuorumController:510) > [2023-10-19 13:42:09,472] INFO [QuorumController id=0] > QuorumController#beginShutdown: shutting down event queue. > (org.apache.kafka.queue.KafkaEventQueue:492) > [2023-10-19 13:42:09,472] DEBUG [QuorumController id=0] > KafkaEventQueue#close: Event queue is already shutting down. > (org.apache.kafka.queue.KafkaEventQueue:489) > [2023-10-19 13:42:09,475] INFO [QuorumController id=0] closed event queue. > (org.apache.kafka.queue.KafkaEventQueue:514) > [2023-10-19 13:42:09,475] INFO [LocalLogManager 0] beginShutdown: shutting > down event queue. (org.apache.kafka.queue.KafkaEventQueue:492) > [2023-10-19 13:42:09,476] DEBUG [LocalLogManager 0] Node 0: closing. > (org.apache.kafka.metalog.LocalLogManager:653) > [2023-10-19 13:42:09,476] DEBUG [LocalLogManager 0] beginShutdown: Event > queue is already shutting down. (org.apache.kafka.queue.KafkaEventQueue:489) > [2023-10-19 13:42:09,476] DEBUG [LocalLogManager 0] KafkaEventQueue#close: > Event queue is already shutting down. > (org.apache.kafka.queue.KafkaEventQueue:489) > [2023-10-19 13:42:09,486] DEBUG [LocalLogManager 0] Node 0: beginning > shutdown. (org.apache.kafka.metalog.LocalLogManager:637) > [2023-10-19 13:42:09,486] DEBUG > append(batch=LeaderChangeBatch(newLeader=LeaderAndEpoch(leaderId=OptionalInt.empty, > epoch=2)), nextEndOffset=2) > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:276) > [2023-10-19 13:42:09,486] INFO Elected new leader: > LeaderAndEpoch(leaderId=OptionalInt[0], epoch=3). > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:300) > [2023-10-19 13:42:09,486] DEBUG > append(batch=LeaderChangeBatch(newLeader=LeaderAndEpoch(leaderId=OptionalInt[0], > epoch=3)), nextEndOffset=3) > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:276) > [2023-10-19 13:42:09,486] DEBUG [QuorumController id=0] > MetaLogManager.Listener: Event queue is already shutting down. > (org.apache.kafka.queue.KafkaEventQueue:489) > [2023-10-19 13:42:09,491] INFO [LocalLogManager 0] closed event queue. > (org.apache.kafka.queue.KafkaEventQueue:514) > [2023-10-19 13:42:09,494] INFO Elected new leader: > LeaderAndEpoch(leaderId=OptionalInt[0], epoch=1). > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:300) > [2023-10-19 13:42:09,494] DEBUG > append(batch=LeaderChangeBatch(newLeader=LeaderAndEpoch(leaderId=OptionalInt[0], > epoch=1)), nextEndOffset=0) > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:276) > [2023-10-19 13:42:09,495] DEBUG [LocalLogManager 0] Node 0: running log > check. (org.apache.kafka.metalog.LocalLogManager:536) > [2023-10-19 13:42:09,495] DEBUG [LocalLogManager 0] initialized local log > manager for node 0 (org.apache.kafka.metalog.LocalLogManager:685) > [2023-10-19 13:42:09,505] DEBUG [QuorumController id=0] Creating in-memory > snapshot -1 (org.apache.kafka.timeline.SnapshotRegistry:203) > [2023-10-19 13:42:09,505] INFO [QuorumController id=0] Creating new > QuorumController with clusterId P32sDt5AQj-foG2jofGzjQ. ZK migration mode is > enabled. (org.apache.kafka.controller.QuorumController:1912) > [2023-10-19 13:42:09,507] INFO [LocalLogManager 0] Node 0: registered > MetaLogListener 1935252719 (org.apache.kafka.metalog.LocalLogManager:703) > [2023-10-19 13:42:09,507] DEBUG [LocalLogManager 0] Node 0: running log > check. (org.apache.kafka.metalog.LocalLogManager:536) > [2023-10-19 13:42:09,507] DEBUG [LocalLogManager 0] Node 0: Executing > handleLeaderChange LeaderAndEpoch(leaderId=OptionalInt[0], epoch=1) > (org.apache.kafka.metalog.LocalLogManager:578) > [2023-10-19 13:42:09,507] DEBUG [QuorumController id=0] Executing > handleLeaderChange[1]. (org.apache.kafka.controller.QuorumController:577) > [2023-10-19 13:42:09,507] INFO [QuorumController id=0] In the new epoch 1, > the leader is (none). (org.apache.kafka.controller.QuorumController:1179) > [2023-10-19 13:42:09,507] DEBUG [QuorumController id=0] Processed > handleLeaderChange[1] in 25 us > (org.apache.kafka.controller.QuorumController:510) > [2023-10-19 13:42:09,507] DEBUG [QuorumController id=0] Executing > handleLeaderChange[1]. (org.apache.kafka.controller.QuorumController:577) > [2023-10-19 13:42:09,507] INFO [QuorumController id=0] Becoming the active > controller at epoch 1, next write offset 1. > (org.apache.kafka.controller.QuorumController:1175) > [2023-10-19 13:42:09,507] DEBUG [QuorumController id=0] Processed > handleLeaderChange[1] in 37 us > (org.apache.kafka.controller.QuorumController:510) > [2023-10-19 13:42:09,507] ERROR Encountered fatalFaultHandler fault: > exception while completing controller activation > (org.apache.kafka.server.fault.MockFaultHandler:44) > java.lang.RuntimeException: The bootstrap metadata.version 3.3-IV0 does not > support ZK migrations. Cannot continue with ZK migrations enabled. > at > org.apache.kafka.controller.ActivationRecordsGenerator.recordsForEmptyLog(ActivationRecordsGenerator.java:103) > at > org.apache.kafka.controller.ActivationRecordsGenerator.generate(ActivationRecordsGenerator.java:226) > at > org.apache.kafka.controller.QuorumController$CompleteActivationEvent.generateRecordsAndResult(QuorumController.java:1237) > at > org.apache.kafka.controller.QuorumController$ControllerWriteEvent.run(QuorumController.java:784) > at > org.apache.kafka.queue.KafkaEventQueue$EventContext.run(KafkaEventQueue.java:127) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.handleEvents(KafkaEventQueue.java:210) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.run(KafkaEventQueue.java:181) > at java.base/java.lang.Thread.run(Thread.java:833) > [2023-10-19 13:42:09,507] DEBUG [QuorumController id=0] Got exception while > running completeActivation[1](330313376). Invoking handleException. > (org.apache.kafka.queue.KafkaEventQueue:132) > org.apache.kafka.server.fault.FaultHandlerException: fatalFaultHandler: > exception while completing controller activation: The bootstrap > metadata.version 3.3-IV0 does not support ZK migrations. Cannot continue with > ZK migrations enabled. > at > org.apache.kafka.controller.ActivationRecordsGenerator.recordsForEmptyLog(ActivationRecordsGenerator.java:103) > at > org.apache.kafka.controller.ActivationRecordsGenerator.generate(ActivationRecordsGenerator.java:226) > at > org.apache.kafka.controller.QuorumController$CompleteActivationEvent.generateRecordsAndResult(QuorumController.java:1237) > at > org.apache.kafka.controller.QuorumController$ControllerWriteEvent.run(QuorumController.java:784) > at > org.apache.kafka.queue.KafkaEventQueue$EventContext.run(KafkaEventQueue.java:127) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.handleEvents(KafkaEventQueue.java:210) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.run(KafkaEventQueue.java:181) > at java.base/java.lang.Thread.run(Thread.java:833) > Caused by: java.lang.RuntimeException: The bootstrap metadata.version 3.3-IV0 > does not support ZK migrations. Cannot continue with ZK migrations enabled. > ... 8 more > [2023-10-19 13:42:09,507] ERROR Encountered nonFatalFaultHandler fault: > completeActivation[1]: event failed with FaultHandlerException (treated as > UnknownServerException) at epoch 1 in 105 microseconds. Renouncing leadership > and reverting to the last committed offset -1. > (org.apache.kafka.server.fault.MockFaultHandler:44) > org.apache.kafka.server.fault.FaultHandlerException: fatalFaultHandler: > exception while completing controller activation: The bootstrap > metadata.version 3.3-IV0 does not support ZK migrations. Cannot continue with > ZK migrations enabled. > at > org.apache.kafka.controller.ActivationRecordsGenerator.recordsForEmptyLog(ActivationRecordsGenerator.java:103) > at > org.apache.kafka.controller.ActivationRecordsGenerator.generate(ActivationRecordsGenerator.java:226) > at > org.apache.kafka.controller.QuorumController$CompleteActivationEvent.generateRecordsAndResult(QuorumController.java:1237) > at > org.apache.kafka.controller.QuorumController$ControllerWriteEvent.run(QuorumController.java:784) > at > org.apache.kafka.queue.KafkaEventQueue$EventContext.run(KafkaEventQueue.java:127) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.handleEvents(KafkaEventQueue.java:210) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.run(KafkaEventQueue.java:181) > at java.base/java.lang.Thread.run(Thread.java:833) > Caused by: java.lang.RuntimeException: The bootstrap metadata.version 3.3-IV0 > does not support ZK migrations. Cannot continue with ZK migrations enabled. > ... 8 more > [2023-10-19 13:42:09,507] DEBUG > append(batch=LeaderChangeBatch(newLeader=LeaderAndEpoch(leaderId=OptionalInt.empty, > epoch=2)), nextEndOffset=1) > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:276) > [2023-10-19 13:42:09,507] INFO Elected new leader: > LeaderAndEpoch(leaderId=OptionalInt[0], epoch=3). > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:300) > [2023-10-19 13:42:09,507] DEBUG > append(batch=LeaderChangeBatch(newLeader=LeaderAndEpoch(leaderId=OptionalInt[0], > epoch=3)), nextEndOffset=2) > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:276) > [2023-10-19 13:42:09,507] DEBUG [LocalLogManager 0] Node 0: running log > check. (org.apache.kafka.metalog.LocalLogManager:536) > [2023-10-19 13:42:09,507] DEBUG [LocalLogManager 0] Node 0: Ignoring > LeaderAndEpoch(leaderId=OptionalInt.empty, epoch=2) since it doesn't match > the latest known leader LeaderAndEpoch(leaderId=OptionalInt[0], epoch=3) > (org.apache.kafka.metalog.LocalLogManager:585) > [2023-10-19 13:42:09,507] DEBUG [LocalLogManager 0] Node 0: Executing > handleLeaderChange LeaderAndEpoch(leaderId=OptionalInt[0], epoch=3) > (org.apache.kafka.metalog.LocalLogManager:578) > [2023-10-19 13:42:09,507] DEBUG [LocalLogManager 0] Node 0: running log > check. (org.apache.kafka.metalog.LocalLogManager:536) > [2023-10-19 13:42:09,507] DEBUG [QuorumController id=0] Reverting to > in-memory snapshot -1 (org.apache.kafka.timeline.SnapshotRegistry:213) > [2023-10-19 13:42:09,508] DEBUG [QuorumController id=0] Executing > handleLeaderChange[3]. (org.apache.kafka.controller.QuorumController:577) > [2023-10-19 13:42:09,508] INFO [QuorumController id=0] In the new epoch 3, > the leader is (none). (org.apache.kafka.controller.QuorumController:1179) > [2023-10-19 13:42:09,508] DEBUG [QuorumController id=0] Processed > handleLeaderChange[3] in 29 us > (org.apache.kafka.controller.QuorumController:510) > [2023-10-19 13:42:09,508] DEBUG [QuorumController id=0] Executing > handleLeaderChange[3]. (org.apache.kafka.controller.QuorumController:577) > [2023-10-19 13:42:09,508] INFO [QuorumController id=0] Becoming the active > controller at epoch 3, next write offset 3. > (org.apache.kafka.controller.QuorumController:1175) > [2023-10-19 13:42:09,508] DEBUG [QuorumController id=0] Processed > handleLeaderChange[3] in 118 us > (org.apache.kafka.controller.QuorumController:510) > [2023-10-19 13:42:09,508] ERROR Encountered fatalFaultHandler fault: > exception while completing controller activation > (org.apache.kafka.server.fault.MockFaultHandler:44) > java.lang.RuntimeException: The bootstrap metadata.version 3.3-IV0 does not > support ZK migrations. Cannot continue with ZK migrations enabled. > at > org.apache.kafka.controller.ActivationRecordsGenerator.recordsForEmptyLog(ActivationRecordsGenerator.java:103) > at > org.apache.kafka.controller.ActivationRecordsGenerator.generate(ActivationRecordsGenerator.java:226) > at > org.apache.kafka.controller.QuorumController$CompleteActivationEvent.generateRecordsAndResult(QuorumController.java:1237) > at > org.apache.kafka.controller.QuorumController$ControllerWriteEvent.run(QuorumController.java:784) > at > org.apache.kafka.queue.KafkaEventQueue$EventContext.run(KafkaEventQueue.java:127) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.handleEvents(KafkaEventQueue.java:210) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.run(KafkaEventQueue.java:181) > at java.base/java.lang.Thread.run(Thread.java:833) > [2023-10-19 13:42:09,508] DEBUG [QuorumController id=0] Got exception while > running completeActivation[3](1908568455). Invoking handleException. > (org.apache.kafka.queue.KafkaEventQueue:132) > org.apache.kafka.server.fault.FaultHandlerException: fatalFaultHandler: > exception while completing controller activation: The bootstrap > metadata.version 3.3-IV0 does not support ZK migrations. Cannot continue with > ZK migrations enabled. > at > org.apache.kafka.controller.ActivationRecordsGenerator.recordsForEmptyLog(ActivationRecordsGenerator.java:103) > at > org.apache.kafka.controller.ActivationRecordsGenerator.generate(ActivationRecordsGenerator.java:226) > at > org.apache.kafka.controller.QuorumController$CompleteActivationEvent.generateRecordsAndResult(QuorumController.java:1237) > at > org.apache.kafka.controller.QuorumController$ControllerWriteEvent.run(QuorumController.java:784) > at > org.apache.kafka.queue.KafkaEventQueue$EventContext.run(KafkaEventQueue.java:127) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.handleEvents(KafkaEventQueue.java:210) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.run(KafkaEventQueue.java:181) > at java.base/java.lang.Thread.run(Thread.java:833) > Caused by: java.lang.RuntimeException: The bootstrap metadata.version 3.3-IV0 > does not support ZK migrations. Cannot continue with ZK migrations enabled. > ... 8 more > [2023-10-19 13:42:09,508] ERROR Encountered nonFatalFaultHandler fault: > completeActivation[3]: event failed with FaultHandlerException (treated as > UnknownServerException) at epoch 3 in 127 microseconds. Renouncing leadership > and reverting to the last committed offset -1. > (org.apache.kafka.server.fault.MockFaultHandler:44) > org.apache.kafka.server.fault.FaultHandlerException: fatalFaultHandler: > exception while completing controller activation: The bootstrap > metadata.version 3.3-IV0 does not support ZK migrations. Cannot continue with > ZK migrations enabled. > at > org.apache.kafka.controller.ActivationRecordsGenerator.recordsForEmptyLog(ActivationRecordsGenerator.java:103) > at > org.apache.kafka.controller.ActivationRecordsGenerator.generate(ActivationRecordsGenerator.java:226) > at > org.apache.kafka.controller.QuorumController$CompleteActivationEvent.generateRecordsAndResult(QuorumController.java:1237) > at > org.apache.kafka.controller.QuorumController$ControllerWriteEvent.run(QuorumController.java:784) > at > org.apache.kafka.queue.KafkaEventQueue$EventContext.run(KafkaEventQueue.java:127) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.handleEvents(KafkaEventQueue.java:210) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.run(KafkaEventQueue.java:181) > at java.base/java.lang.Thread.run(Thread.java:833) > Caused by: java.lang.RuntimeException: The bootstrap metadata.version 3.3-IV0 > does not support ZK migrations. Cannot continue with ZK migrations enabled. > ... 8 more > [2023-10-19 13:42:09,508] DEBUG > append(batch=LeaderChangeBatch(newLeader=LeaderAndEpoch(leaderId=OptionalInt.empty, > epoch=4)), nextEndOffset=3) > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:276) > [2023-10-19 13:42:09,508] INFO Elected new leader: > LeaderAndEpoch(leaderId=OptionalInt[0], epoch=5). > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:300) > [2023-10-19 13:42:09,508] DEBUG > append(batch=LeaderChangeBatch(newLeader=LeaderAndEpoch(leaderId=OptionalInt[0], > epoch=5)), nextEndOffset=4) > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:276) > [2023-10-19 13:42:09,508] DEBUG [QuorumController id=0] Reverting to > in-memory snapshot -1 (org.apache.kafka.timeline.SnapshotRegistry:213) > [2023-10-19 13:42:09,511] DEBUG [LocalLogManager 0] Node 0: running log > check. (org.apache.kafka.metalog.LocalLogManager:536) > [2023-10-19 13:42:09,512] DEBUG [LocalLogManager 0] Node 0: Ignoring > LeaderAndEpoch(leaderId=OptionalInt.empty, epoch=4) since it doesn't match > the latest known leader LeaderAndEpoch(leaderId=OptionalInt[0], epoch=5) > (org.apache.kafka.metalog.LocalLogManager:585) > [2023-10-19 13:42:09,512] DEBUG [LocalLogManager 0] Node 0: Executing > handleLeaderChange LeaderAndEpoch(leaderId=OptionalInt[0], epoch=5) > (org.apache.kafka.metalog.LocalLogManager:578) > [2023-10-19 13:42:09,512] DEBUG [LocalLogManager 0] Node 0: running log > check. (org.apache.kafka.metalog.LocalLogManager:536) > [2023-10-19 13:42:09,512] DEBUG [QuorumController id=0] Executing > handleLeaderChange[5]. (org.apache.kafka.controller.QuorumController:577) > [2023-10-19 13:42:09,512] INFO [QuorumController id=0] In the new epoch 5, > the leader is (none). (org.apache.kafka.controller.QuorumController:1179) > [2023-10-19 13:42:09,512] DEBUG [QuorumController id=0] Processed > handleLeaderChange[5] in 23 us > (org.apache.kafka.controller.QuorumController:510) > [2023-10-19 13:42:09,512] DEBUG [QuorumController id=0] Executing > handleLeaderChange[5]. (org.apache.kafka.controller.QuorumController:577) > [2023-10-19 13:42:09,512] INFO [QuorumController id=0] Becoming the active > controller at epoch 5, next write offset 5. > (org.apache.kafka.controller.QuorumController:1175) > [2023-10-19 13:42:09,512] DEBUG [QuorumController id=0] Processed > handleLeaderChange[5] in 43 us > (org.apache.kafka.controller.QuorumController:510) > [2023-10-19 13:42:09,512] ERROR Encountered fatalFaultHandler fault: > exception while completing controller activation > (org.apache.kafka.server.fault.MockFaultHandler:44) > java.lang.RuntimeException: The bootstrap metadata.version 3.3-IV0 does not > support ZK migrations. Cannot continue with ZK migrations enabled. > at > org.apache.kafka.controller.ActivationRecordsGenerator.recordsForEmptyLog(ActivationRecordsGenerator.java:103) > at > org.apache.kafka.controller.ActivationRecordsGenerator.generate(ActivationRecordsGenerator.java:226) > at > org.apache.kafka.controller.QuorumController$CompleteActivationEvent.generateRecordsAndResult(QuorumController.java:1237) > at > org.apache.kafka.controller.QuorumController$ControllerWriteEvent.run(QuorumController.java:784) > at > org.apache.kafka.queue.KafkaEventQueue$EventContext.run(KafkaEventQueue.java:127) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.handleEvents(KafkaEventQueue.java:210) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.run(KafkaEventQueue.java:181) > at java.base/java.lang.Thread.run(Thread.java:833) > [2023-10-19 13:42:09,512] DEBUG [QuorumController id=0] Got exception while > running completeActivation[5](154181525). Invoking handleException. > (org.apache.kafka.queue.KafkaEventQueue:132) > org.apache.kafka.server.fault.FaultHandlerException: fatalFaultHandler: > exception while completing controller activation: The bootstrap > metadata.version 3.3-IV0 does not support ZK migrations. Cannot continue with > ZK migrations enabled. > at > org.apache.kafka.controller.ActivationRecordsGenerator.recordsForEmptyLog(ActivationRecordsGenerator.java:103) > at > org.apache.kafka.controller.ActivationRecordsGenerator.generate(ActivationRecordsGenerator.java:226) > at > org.apache.kafka.controller.QuorumController$CompleteActivationEvent.generateRecordsAndResult(QuorumController.java:1237) > at > org.apache.kafka.controller.QuorumController$ControllerWriteEvent.run(QuorumController.java:784) > at > org.apache.kafka.queue.KafkaEventQueue$EventContext.run(KafkaEventQueue.java:127) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.handleEvents(KafkaEventQueue.java:210) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.run(KafkaEventQueue.java:181) > at java.base/java.lang.Thread.run(Thread.java:833) > Caused by: java.lang.RuntimeException: The bootstrap metadata.version 3.3-IV0 > does not support ZK migrations. Cannot continue with ZK migrations enabled. > ... 8 more > [2023-10-19 13:42:09,512] ERROR Encountered nonFatalFaultHandler fault: > completeActivation[5]: event failed with FaultHandlerException (treated as > UnknownServerException) at epoch 5 in 127 microseconds. Renouncing leadership > and reverting to the last committed offset -1. > (org.apache.kafka.server.fault.MockFaultHandler:44) > org.apache.kafka.server.fault.FaultHandlerException: fatalFaultHandler: > exception while completing controller activation: The bootstrap > metadata.version 3.3-IV0 does not support ZK migrations. Cannot continue with > ZK migrations enabled. > at > org.apache.kafka.controller.ActivationRecordsGenerator.recordsForEmptyLog(ActivationRecordsGenerator.java:103) > at > org.apache.kafka.controller.ActivationRecordsGenerator.generate(ActivationRecordsGenerator.java:226) > at > org.apache.kafka.controller.QuorumController$CompleteActivationEvent.generateRecordsAndResult(QuorumController.java:1237) > at > org.apache.kafka.controller.QuorumController$ControllerWriteEvent.run(QuorumController.java:784) > at > org.apache.kafka.queue.KafkaEventQueue$EventContext.run(KafkaEventQueue.java:127) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.handleEvents(KafkaEventQueue.java:210) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.run(KafkaEventQueue.java:181) > at java.base/java.lang.Thread.run(Thread.java:833) > Caused by: java.lang.RuntimeException: The bootstrap metadata.version 3.3-IV0 > does not support ZK migrations. Cannot continue with ZK migrations enabled. > ... 8 more > [2023-10-19 13:42:09,512] DEBUG > append(batch=LeaderChangeBatch(newLeader=LeaderAndEpoch(leaderId=OptionalInt.empty, > epoch=6)), nextEndOffset=5) > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:276) > [2023-10-19 13:42:09,512] INFO Elected new leader: > LeaderAndEpoch(leaderId=OptionalInt[0], epoch=7). > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:300) > [2023-10-19 13:42:09,512] DEBUG > append(batch=LeaderChangeBatch(newLeader=LeaderAndEpoch(leaderId=OptionalInt[0], > epoch=7)), nextEndOffset=6) > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:276) > [2023-10-19 13:42:09,512] DEBUG [QuorumController id=0] Reverting to > in-memory snapshot -1 (org.apache.kafka.timeline.SnapshotRegistry:213) > [2023-10-19 13:42:09,512] DEBUG [LocalLogManager 0] Node 0: running log > check. (org.apache.kafka.metalog.LocalLogManager:536) > [2023-10-19 13:42:09,512] DEBUG [LocalLogManager 0] Node 0: Ignoring > LeaderAndEpoch(leaderId=OptionalInt.empty, epoch=6) since it doesn't match > the latest known leader LeaderAndEpoch(leaderId=OptionalInt[0], epoch=7) > (org.apache.kafka.metalog.LocalLogManager:585) > [2023-10-19 13:42:09,512] DEBUG [LocalLogManager 0] Node 0: Executing > handleLeaderChange LeaderAndEpoch(leaderId=OptionalInt[0], epoch=7) > (org.apache.kafka.metalog.LocalLogManager:578) > [2023-10-19 13:42:09,512] DEBUG [LocalLogManager 0] Node 0: running log > check. (org.apache.kafka.metalog.LocalLogManager:536) > [2023-10-19 13:42:09,512] DEBUG [QuorumController id=0] Executing > handleLeaderChange[7]. (org.apache.kafka.controller.QuorumController:577) > [2023-10-19 13:42:09,512] INFO [QuorumController id=0] In the new epoch 7, > the leader is (none). (org.apache.kafka.controller.QuorumController:1179) > [2023-10-19 13:42:09,512] DEBUG [QuorumController id=0] Processed > handleLeaderChange[7] in 32 us > (org.apache.kafka.controller.QuorumController:510) > [2023-10-19 13:42:09,512] DEBUG [QuorumController id=0] Executing > handleLeaderChange[7]. (org.apache.kafka.controller.QuorumController:577) > [2023-10-19 13:42:09,512] INFO [QuorumController id=0] Becoming the active > controller at epoch 7, next write offset 7. > (org.apache.kafka.controller.QuorumController:1175) > [2023-10-19 13:42:09,512] DEBUG [QuorumController id=0] Processed > handleLeaderChange[7] in 25 us > (org.apache.kafka.controller.QuorumController:510) > [2023-10-19 13:42:09,512] ERROR Encountered fatalFaultHandler fault: > exception while completing controller activation > (org.apache.kafka.server.fault.MockFaultHandler:44) > java.lang.RuntimeException: The bootstrap metadata.version 3.3-IV0 does not > support ZK migrations. Cannot continue with ZK migrations enabled. > at > org.apache.kafka.controller.ActivationRecordsGenerator.recordsForEmptyLog(ActivationRecordsGenerator.java:103) > at > org.apache.kafka.controller.ActivationRecordsGenerator.generate(ActivationRecordsGenerator.java:226) > at > org.apache.kafka.controller.QuorumController$CompleteActivationEvent.generateRecordsAndResult(QuorumController.java:1237) > at > org.apache.kafka.controller.QuorumController$ControllerWriteEvent.run(QuorumController.java:784) > at > org.apache.kafka.queue.KafkaEventQueue$EventContext.run(KafkaEventQueue.java:127) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.handleEvents(KafkaEventQueue.java:210) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.run(KafkaEventQueue.java:181) > at java.base/java.lang.Thread.run(Thread.java:833) > [2023-10-19 13:42:09,512] DEBUG [QuorumController id=0] Got exception while > running completeActivation[7](1351535182). Invoking handleException. > (org.apache.kafka.queue.KafkaEventQueue:132) > org.apache.kafka.server.fault.FaultHandlerException: fatalFaultHandler: > exception while completing controller activation: The bootstrap > metadata.version 3.3-IV0 does not support ZK migrations. Cannot continue with > ZK migrations enabled. > at > org.apache.kafka.controller.ActivationRecordsGenerator.recordsForEmptyLog(ActivationRecordsGenerator.java:103) > at > org.apache.kafka.controller.ActivationRecordsGenerator.generate(ActivationRecordsGenerator.java:226) > at > org.apache.kafka.controller.QuorumController$CompleteActivationEvent.generateRecordsAndResult(QuorumController.java:1237) > at > org.apache.kafka.controller.QuorumController$ControllerWriteEvent.run(QuorumController.java:784) > at > org.apache.kafka.queue.KafkaEventQueue$EventContext.run(KafkaEventQueue.java:127) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.handleEvents(KafkaEventQueue.java:210) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.run(KafkaEventQueue.java:181) > at java.base/java.lang.Thread.run(Thread.java:833) > Caused by: java.lang.RuntimeException: The bootstrap metadata.version 3.3-IV0 > does not support ZK migrations. Cannot continue with ZK migrations enabled. > ... 8 more > [2023-10-19 13:42:09,512] ERROR Encountered nonFatalFaultHandler fault: > completeActivation[7]: event failed with FaultHandlerException (treated as > UnknownServerException) at epoch 7 in 76 microseconds. Renouncing leadership > and reverting to the last committed offset -1. > (org.apache.kafka.server.fault.MockFaultHandler:44) > org.apache.kafka.server.fault.FaultHandlerException: fatalFaultHandler: > exception while completing controller activation: The bootstrap > metadata.version 3.3-IV0 does not support ZK migrations. Cannot continue with > ZK migrations enabled. > at > org.apache.kafka.controller.ActivationRecordsGenerator.recordsForEmptyLog(ActivationRecordsGenerator.java:103) > at > org.apache.kafka.controller.ActivationRecordsGenerator.generate(ActivationRecordsGenerator.java:226) > at > org.apache.kafka.controller.QuorumController$CompleteActivationEvent.generateRecordsAndResult(QuorumController.java:1237) > at > org.apache.kafka.controller.QuorumController$ControllerWriteEvent.run(QuorumController.java:784) > at > org.apache.kafka.queue.KafkaEventQueue$EventContext.run(KafkaEventQueue.java:127) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.handleEvents(KafkaEventQueue.java:210) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.run(KafkaEventQueue.java:181) > at java.base/java.lang.Thread.run(Thread.java:833) > Caused by: java.lang.RuntimeException: The bootstrap metadata.version 3.3-IV0 > does not support ZK migrations. Cannot continue with ZK migrations enabled. > ... 8 more > [2023-10-19 13:42:09,512] DEBUG > append(batch=LeaderChangeBatch(newLeader=LeaderAndEpoch(leaderId=OptionalInt.empty, > epoch=8)), nextEndOffset=7) > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:276) > [2023-10-19 13:42:09,513] INFO Elected new leader: > LeaderAndEpoch(leaderId=OptionalInt[0], epoch=9). > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:300) > [2023-10-19 13:42:09,513] DEBUG [LocalLogManager 0] Node 0: running log > check. (org.apache.kafka.metalog.LocalLogManager:536) > [2023-10-19 13:42:09,513] DEBUG > append(batch=LeaderChangeBatch(newLeader=LeaderAndEpoch(leaderId=OptionalInt[0], > epoch=9)), nextEndOffset=8) > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:276) > [2023-10-19 13:42:09,513] DEBUG [QuorumController id=0] Reverting to > in-memory snapshot -1 (org.apache.kafka.timeline.SnapshotRegistry:213) > [2023-10-19 13:42:09,513] DEBUG [LocalLogManager 0] Node 0: Ignoring > LeaderAndEpoch(leaderId=OptionalInt.empty, epoch=8) since it doesn't match > the latest known leader LeaderAndEpoch(leaderId=OptionalInt[0], epoch=9) > (org.apache.kafka.metalog.LocalLogManager:585) > [2023-10-19 13:42:09,513] DEBUG [LocalLogManager 0] Node 0: Executing > handleLeaderChange LeaderAndEpoch(leaderId=OptionalInt[0], epoch=9) > (org.apache.kafka.metalog.LocalLogManager:578) > [2023-10-19 13:42:09,513] DEBUG [LocalLogManager 0] Node 0: running log > check. (org.apache.kafka.metalog.LocalLogManager:536) > [2023-10-19 13:42:09,513] DEBUG [QuorumController id=0] Executing > handleLeaderChange[9]. (org.apache.kafka.controller.QuorumController:577) > [2023-10-19 13:42:09,513] INFO [QuorumController id=0] In the new epoch 9, > the leader is (none). (org.apache.kafka.controller.QuorumController:1179) > [2023-10-19 13:42:09,513] DEBUG [QuorumController id=0] Processed > handleLeaderChange[9] in 72 us > (org.apache.kafka.controller.QuorumController:510) > [2023-10-19 13:42:09,513] DEBUG [QuorumController id=0] Executing > handleLeaderChange[9]. (org.apache.kafka.controller.QuorumController:577) > [2023-10-19 13:42:09,513] INFO [QuorumController id=0] Becoming the active > controller at epoch 9, next write offset 9. > (org.apache.kafka.controller.QuorumController:1175) > [2023-10-19 13:42:09,513] DEBUG [QuorumController id=0] Processed > handleLeaderChange[9] in 109 us > (org.apache.kafka.controller.QuorumController:510) > [2023-10-19 13:42:09,513] ERROR Encountered fatalFaultHandler fault: > exception while completing controller activation > (org.apache.kafka.server.fault.MockFaultHandler:44) > java.lang.RuntimeException: The bootstrap metadata.version 3.3-IV0 does not > support ZK migrations. Cannot continue with ZK migrations enabled. > at > org.apache.kafka.controller.ActivationRecordsGenerator.recordsForEmptyLog(ActivationRecordsGenerator.java:103) > at > org.apache.kafka.controller.ActivationRecordsGenerator.generate(ActivationRecordsGenerator.java:226) > at > org.apache.kafka.controller.QuorumController$CompleteActivationEvent.generateRecordsAndResult(QuorumController.java:1237) > at > org.apache.kafka.controller.QuorumController$ControllerWriteEvent.run(QuorumController.java:784) > at > org.apache.kafka.queue.KafkaEventQueue$EventContext.run(KafkaEventQueue.java:127) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.handleEvents(KafkaEventQueue.java:210) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.run(KafkaEventQueue.java:181) > at java.base/java.lang.Thread.run(Thread.java:833) > [2023-10-19 13:42:09,513] DEBUG [QuorumController id=0] Got exception while > running completeActivation[9](305401902). Invoking handleException. > (org.apache.kafka.queue.KafkaEventQueue:132) > org.apache.kafka.server.fault.FaultHandlerException: fatalFaultHandler: > exception while completing controller activation: The bootstrap > metadata.version 3.3-IV0 does not support ZK migrations. Cannot continue with > ZK migrations enabled. > at > org.apache.kafka.controller.ActivationRecordsGenerator.recordsForEmptyLog(ActivationRecordsGenerator.java:103) > at > org.apache.kafka.controller.ActivationRecordsGenerator.generate(ActivationRecordsGenerator.java:226) > at > org.apache.kafka.controller.QuorumController$CompleteActivationEvent.generateRecordsAndResult(QuorumController.java:1237) > at > org.apache.kafka.controller.QuorumController$ControllerWriteEvent.run(QuorumController.java:784) > at > org.apache.kafka.queue.KafkaEventQueue$EventContext.run(KafkaEventQueue.java:127) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.handleEvents(KafkaEventQueue.java:210) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.run(KafkaEventQueue.java:181) > at java.base/java.lang.Thread.run(Thread.java:833) > Caused by: java.lang.RuntimeException: The bootstrap metadata.version 3.3-IV0 > does not support ZK migrations. Cannot continue with ZK migrations enabled. > ... 8 more > [2023-10-19 13:42:09,513] ERROR Encountered nonFatalFaultHandler fault: > completeActivation[9]: event failed with FaultHandlerException (treated as > UnknownServerException) at epoch 9 in 263 microseconds. Renouncing leadership > and reverting to the last committed offset -1. > (org.apache.kafka.server.fault.MockFaultHandler:44) > org.apache.kafka.server.fault.FaultHandlerException: fatalFaultHandler: > exception while completing controller activation: The bootstrap > metadata.version 3.3-IV0 does not support ZK migrations. Cannot continue with > ZK migrations enabled. > at > org.apache.kafka.controller.ActivationRecordsGenerator.recordsForEmptyLog(ActivationRecordsGenerator.java:103) > at > org.apache.kafka.controller.ActivationRecordsGenerator.generate(ActivationRecordsGenerator.java:226) > at > org.apache.kafka.controller.QuorumController$CompleteActivationEvent.generateRecordsAndResult(QuorumController.java:1237) > at > org.apache.kafka.controller.QuorumController$ControllerWriteEvent.run(QuorumController.java:784) > at > org.apache.kafka.queue.KafkaEventQueue$EventContext.run(KafkaEventQueue.java:127) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.handleEvents(KafkaEventQueue.java:210) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.run(KafkaEventQueue.java:181) > at java.base/java.lang.Thread.run(Thread.java:833) > Caused by: java.lang.RuntimeException: The bootstrap metadata.version 3.3-IV0 > does not support ZK migrations. Cannot continue with ZK migrations enabled. > ... 8 more > [2023-10-19 13:42:09,514] DEBUG > append(batch=LeaderChangeBatch(newLeader=LeaderAndEpoch(leaderId=OptionalInt.empty, > epoch=10)), nextEndOffset=9) > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:276) > [2023-10-19 13:42:09,514] INFO Elected new leader: > LeaderAndEpoch(leaderId=OptionalInt[0], epoch=11). > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:300) > [2023-10-19 13:42:09,514] DEBUG > append(batch=LeaderChangeBatch(newLeader=LeaderAndEpoch(leaderId=OptionalInt[0], > epoch=11)), nextEndOffset=10) > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:276) > [2023-10-19 13:42:09,514] DEBUG [QuorumController id=0] Reverting to > in-memory snapshot -1 (org.apache.kafka.timeline.SnapshotRegistry:213) > [2023-10-19 13:42:09,520] DEBUG [LocalLogManager 0] Node 0: running log > check. (org.apache.kafka.metalog.LocalLogManager:536) > [2023-10-19 13:42:09,520] DEBUG [LocalLogManager 0] Node 0: Ignoring > LeaderAndEpoch(leaderId=OptionalInt.empty, epoch=10) since it doesn't match > the latest known leader LeaderAndEpoch(leaderId=OptionalInt[0], epoch=11) > (org.apache.kafka.metalog.LocalLogManager:585) > [2023-10-19 13:42:09,520] DEBUG [LocalLogManager 0] Node 0: Executing > handleLeaderChange LeaderAndEpoch(leaderId=OptionalInt[0], epoch=11) > (org.apache.kafka.metalog.LocalLogManager:578) > [2023-10-19 13:42:09,520] DEBUG [LocalLogManager 0] Node 0: running log > check. (org.apache.kafka.metalog.LocalLogManager:536) > [2023-10-19 13:42:09,521] DEBUG [QuorumController id=0] Executing > handleLeaderChange[11]. (org.apache.kafka.controller.QuorumController:577) > [2023-10-19 13:42:09,522] INFO [QuorumController id=0] In the new epoch 11, > the leader is (none). (org.apache.kafka.controller.QuorumController:1179) > [2023-10-19 13:42:09,522] DEBUG [QuorumController id=0] Processed > handleLeaderChange[11] in 385 us > (org.apache.kafka.controller.QuorumController:510) > [2023-10-19 13:42:09,522] DEBUG [QuorumController id=0] Executing > handleLeaderChange[11]. (org.apache.kafka.controller.QuorumController:577) > [2023-10-19 13:42:09,522] INFO [QuorumController id=0] Becoming the active > controller at epoch 11, next write offset 11. > (org.apache.kafka.controller.QuorumController:1175) > [2023-10-19 13:42:09,522] DEBUG [QuorumController id=0] Processed > handleLeaderChange[11] in 115 us > (org.apache.kafka.controller.QuorumController:510) > [2023-10-19 13:42:09,522] ERROR Encountered fatalFaultHandler fault: > exception while completing controller activation > (org.apache.kafka.server.fault.MockFaultHandler:44) > java.lang.RuntimeException: The bootstrap metadata.version 3.3-IV0 does not > support ZK migrations. Cannot continue with ZK migrations enabled. > at > org.apache.kafka.controller.ActivationRecordsGenerator.recordsForEmptyLog(ActivationRecordsGenerator.java:103) > at > org.apache.kafka.controller.ActivationRecordsGenerator.generate(ActivationRecordsGenerator.java:226) > at > org.apache.kafka.controller.QuorumController$CompleteActivationEvent.generateRecordsAndResult(QuorumController.java:1237) > at > org.apache.kafka.controller.QuorumController$ControllerWriteEvent.run(QuorumController.java:784) > at > org.apache.kafka.queue.KafkaEventQueue$EventContext.run(KafkaEventQueue.java:127) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.handleEvents(KafkaEventQueue.java:210) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.run(KafkaEventQueue.java:181) > at java.base/java.lang.Thread.run(Thread.java:833) > [2023-10-19 13:42:09,522] DEBUG [QuorumController id=0] Got exception while > running completeActivation[11](278291950). Invoking handleException. > (org.apache.kafka.queue.KafkaEventQueue:132) > org.apache.kafka.server.fault.FaultHandlerException: fatalFaultHandler: > exception while completing controller activation: The bootstrap > metadata.version 3.3-IV0 does not support ZK migrations. Cannot continue with > ZK migrations enabled. > at > org.apache.kafka.controller.ActivationRecordsGenerator.recordsForEmptyLog(ActivationRecordsGenerator.java:103) > at > org.apache.kafka.controller.ActivationRecordsGenerator.generate(ActivationRecordsGenerator.java:226) > at > org.apache.kafka.controller.QuorumController$CompleteActivationEvent.generateRecordsAndResult(QuorumController.java:1237) > at > org.apache.kafka.controller.QuorumController$ControllerWriteEvent.run(QuorumController.java:784) > at > org.apache.kafka.queue.KafkaEventQueue$EventContext.run(KafkaEventQueue.java:127) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.handleEvents(KafkaEventQueue.java:210) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.run(KafkaEventQueue.java:181) > at java.base/java.lang.Thread.run(Thread.java:833) > Caused by: java.lang.RuntimeException: The bootstrap metadata.version 3.3-IV0 > does not support ZK migrations. Cannot continue with ZK migrations enabled. > ... 8 more > [2023-10-19 13:42:09,522] ERROR Encountered nonFatalFaultHandler fault: > completeActivation[11]: event failed with FaultHandlerException (treated as > UnknownServerException) at epoch 11 in 274 microseconds. Renouncing > leadership and reverting to the last committed offset -1. > (org.apache.kafka.server.fault.MockFaultHandler:44) > org.apache.kafka.server.fault.FaultHandlerException: fatalFaultHandler: > exception while completing controller activation: The bootstrap > metadata.version 3.3-IV0 does not support ZK migrations. Cannot continue with > ZK migrations enabled. > at > org.apache.kafka.controller.ActivationRecordsGenerator.recordsForEmptyLog(ActivationRecordsGenerator.java:103) > at > org.apache.kafka.controller.ActivationRecordsGenerator.generate(ActivationRecordsGenerator.java:226) > at > org.apache.kafka.controller.QuorumController$CompleteActivationEvent.generateRecordsAndResult(QuorumController.java:1237) > at > org.apache.kafka.controller.QuorumController$ControllerWriteEvent.run(QuorumController.java:784) > at > org.apache.kafka.queue.KafkaEventQueue$EventContext.run(KafkaEventQueue.java:127) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.handleEvents(KafkaEventQueue.java:210) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.run(KafkaEventQueue.java:181) > at java.base/java.lang.Thread.run(Thread.java:833) > Caused by: java.lang.RuntimeException: The bootstrap metadata.version 3.3-IV0 > does not support ZK migrations. Cannot continue with ZK migrations enabled. > ... 8 more > [2023-10-19 13:42:09,522] DEBUG > append(batch=LeaderChangeBatch(newLeader=LeaderAndEpoch(leaderId=OptionalInt.empty, > epoch=12)), nextEndOffset=11) > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:276) > [2023-10-19 13:42:09,523] INFO Elected new leader: > LeaderAndEpoch(leaderId=OptionalInt[0], epoch=13). > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:300) > [2023-10-19 13:42:09,523] DEBUG > append(batch=LeaderChangeBatch(newLeader=LeaderAndEpoch(leaderId=OptionalInt[0], > epoch=13)), nextEndOffset=12) > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:276) > [2023-10-19 13:42:09,523] DEBUG [QuorumController id=0] Reverting to > in-memory snapshot -1 (org.apache.kafka.timeline.SnapshotRegistry:213) > [2023-10-19 13:42:09,527] DEBUG [LocalLogManager 0] Node 0: running log > check. (org.apache.kafka.metalog.LocalLogManager:536) > [2023-10-19 13:42:09,527] DEBUG [LocalLogManager 0] Node 0: Ignoring > LeaderAndEpoch(leaderId=OptionalInt.empty, epoch=12) since it doesn't match > the latest known leader LeaderAndEpoch(leaderId=OptionalInt[0], epoch=13) > (org.apache.kafka.metalog.LocalLogManager:585) > [2023-10-19 13:42:09,527] DEBUG [LocalLogManager 0] Node 0: Executing > handleLeaderChange LeaderAndEpoch(leaderId=OptionalInt[0], epoch=13) > (org.apache.kafka.metalog.LocalLogManager:578) > [2023-10-19 13:42:09,527] DEBUG [LocalLogManager 0] Node 0: running log > check. (org.apache.kafka.metalog.LocalLogManager:536) > [2023-10-19 13:42:09,527] DEBUG [QuorumController id=0] Executing > handleLeaderChange[13]. (org.apache.kafka.controller.QuorumController:577) > [2023-10-19 13:42:09,527] INFO [QuorumController id=0] In the new epoch 13, > the leader is (none). (org.apache.kafka.controller.QuorumController:1179) > [2023-10-19 13:42:09,527] DEBUG [QuorumController id=0] Processed > handleLeaderChange[13] in 412 us > (org.apache.kafka.controller.QuorumController:510) > [2023-10-19 13:42:09,527] DEBUG [QuorumController id=0] Executing > handleLeaderChange[13]. (org.apache.kafka.controller.QuorumController:577) > [2023-10-19 13:42:09,527] INFO [QuorumController id=0] Becoming the active > controller at epoch 13, next write offset 13. > (org.apache.kafka.controller.QuorumController:1175) > [2023-10-19 13:42:09,527] DEBUG [QuorumController id=0] Processed > handleLeaderChange[13] in 59 us > (org.apache.kafka.controller.QuorumController:510) > [2023-10-19 13:42:09,527] ERROR Encountered fatalFaultHandler fault: > exception while completing controller activation > (org.apache.kafka.server.fault.MockFaultHandler:44) > java.lang.RuntimeException: The bootstrap metadata.version 3.3-IV0 does not > support ZK migrations. Cannot continue with ZK migrations enabled. > at > org.apache.kafka.controller.ActivationRecordsGenerator.recordsForEmptyLog(ActivationRecordsGenerator.java:103) > at > org.apache.kafka.controller.ActivationRecordsGenerator.generate(ActivationRecordsGenerator.java:226) > at > org.apache.kafka.controller.QuorumController$CompleteActivationEvent.generateRecordsAndResult(QuorumController.java:1237) > at > org.apache.kafka.controller.QuorumController$ControllerWriteEvent.run(QuorumController.java:784) > at > org.apache.kafka.queue.KafkaEventQueue$EventContext.run(KafkaEventQueue.java:127) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.handleEvents(KafkaEventQueue.java:210) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.run(KafkaEventQueue.java:181) > at java.base/java.lang.Thread.run(Thread.java:833) > [2023-10-19 13:42:09,527] DEBUG [QuorumController id=0] Got exception while > running completeActivation[13](303556794). Invoking handleException. > (org.apache.kafka.queue.KafkaEventQueue:132) > org.apache.kafka.server.fault.FaultHandlerException: fatalFaultHandler: > exception while completing controller activation: The bootstrap > metadata.version 3.3-IV0 does not support ZK migrations. Cannot continue with > ZK migrations enabled. > at > org.apache.kafka.controller.ActivationRecordsGenerator.recordsForEmptyLog(ActivationRecordsGenerator.java:103) > at > org.apache.kafka.controller.ActivationRecordsGenerator.generate(ActivationRecordsGenerator.java:226) > at > org.apache.kafka.controller.QuorumController$CompleteActivationEvent.generateRecordsAndResult(QuorumController.java:1237) > at > org.apache.kafka.controller.QuorumController$ControllerWriteEvent.run(QuorumController.java:784) > at > org.apache.kafka.queue.KafkaEventQueue$EventContext.run(KafkaEventQueue.java:127) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.handleEvents(KafkaEventQueue.java:210) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.run(KafkaEventQueue.java:181) > at java.base/java.lang.Thread.run(Thread.java:833) > Caused by: java.lang.RuntimeException: The bootstrap metadata.version 3.3-IV0 > does not support ZK migrations. Cannot continue with ZK migrations enabled. > ... 8 more > [2023-10-19 13:42:09,527] ERROR Encountered nonFatalFaultHandler fault: > completeActivation[13]: event failed with FaultHandlerException (treated as > UnknownServerException) at epoch 13 in 113 microseconds. Renouncing > leadership and reverting to the last committed offset -1. > (org.apache.kafka.server.fault.MockFaultHandler:44) > org.apache.kafka.server.fault.FaultHandlerException: fatalFaultHandler: > exception while completing controller activation: The bootstrap > metadata.version 3.3-IV0 does not support ZK migrations. Cannot continue with > ZK migrations enabled. > at > org.apache.kafka.controller.ActivationRecordsGenerator.recordsForEmptyLog(ActivationRecordsGenerator.java:103) > at > org.apache.kafka.controller.ActivationRecordsGenerator.generate(ActivationRecordsGenerator.java:226) > at > org.apache.kafka.controller.QuorumController$CompleteActivationEvent.generateRecordsAndResult(QuorumController.java:1237) > at > org.apache.kafka.controller.QuorumController$ControllerWriteEvent.run(QuorumController.java:784) > at > org.apache.kafka.queue.KafkaEventQueue$EventContext.run(KafkaEventQueue.java:127) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.handleEvents(KafkaEventQueue.java:210) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.run(KafkaEventQueue.java:181) > at java.base/java.lang.Thread.run(Thread.java:833) > Caused by: java.lang.RuntimeException: The bootstrap metadata.version 3.3-IV0 > does not support ZK migrations. Cannot continue with ZK migrations enabled. > ... 8 more > [2023-10-19 13:42:09,528] DEBUG > append(batch=LeaderChangeBatch(newLeader=LeaderAndEpoch(leaderId=OptionalInt.empty, > epoch=14)), nextEndOffset=13) > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:276) > [2023-10-19 13:42:09,528] INFO Elected new leader: > LeaderAndEpoch(leaderId=OptionalInt[0], epoch=15). > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:300) > [2023-10-19 13:42:09,528] DEBUG > append(batch=LeaderChangeBatch(newLeader=LeaderAndEpoch(leaderId=OptionalInt[0], > epoch=15)), nextEndOffset=14) > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:276) > [2023-10-19 13:42:09,528] DEBUG [QuorumController id=0] Reverting to > in-memory snapshot -1 (org.apache.kafka.timeline.SnapshotRegistry:213) > [2023-10-19 13:42:09,535] DEBUG [LocalLogManager 0] Node 0: running log > check. (org.apache.kafka.metalog.LocalLogManager:536) > [2023-10-19 13:42:09,536] DEBUG [LocalLogManager 0] Node 0: Ignoring > LeaderAndEpoch(leaderId=OptionalInt.empty, epoch=14) since it doesn't match > the latest known leader LeaderAndEpoch(leaderId=OptionalInt[0], epoch=15) > (org.apache.kafka.metalog.LocalLogManager:585) > [2023-10-19 13:42:09,536] DEBUG [LocalLogManager 0] Node 0: Executing > handleLeaderChange LeaderAndEpoch(leaderId=OptionalInt[0], epoch=15) > (org.apache.kafka.metalog.LocalLogManager:578) > [2023-10-19 13:42:09,536] DEBUG [LocalLogManager 0] Node 0: running log > check. (org.apache.kafka.metalog.LocalLogManager:536) > [2023-10-19 13:42:09,537] DEBUG [QuorumController id=0] Executing > handleLeaderChange[15]. (org.apache.kafka.controller.QuorumController:577) > [2023-10-19 13:42:09,537] INFO [QuorumController id=0] In the new epoch 15, > the leader is (none). (org.apache.kafka.controller.QuorumController:1179) > [2023-10-19 13:42:09,537] DEBUG [QuorumController id=0] Processed > handleLeaderChange[15] in 80 us > (org.apache.kafka.controller.QuorumController:510) > [2023-10-19 13:42:09,537] DEBUG [QuorumController id=0] Executing > handleLeaderChange[15]. (org.apache.kafka.controller.QuorumController:577) > [2023-10-19 13:42:09,537] INFO [QuorumController id=0] Becoming the active > controller at epoch 15, next write offset 15. > (org.apache.kafka.controller.QuorumController:1175) > [2023-10-19 13:42:09,537] DEBUG [QuorumController id=0] Processed > handleLeaderChange[15] in 47 us > (org.apache.kafka.controller.QuorumController:510) > [2023-10-19 13:42:09,537] ERROR Encountered fatalFaultHandler fault: > exception while completing controller activation > (org.apache.kafka.server.fault.MockFaultHandler:44) > java.lang.RuntimeException: The bootstrap metadata.version 3.3-IV0 does not > support ZK migrations. Cannot continue with ZK migrations enabled. > at > org.apache.kafka.controller.ActivationRecordsGenerator.recordsForEmptyLog(ActivationRecordsGenerator.java:103) > at > org.apache.kafka.controller.ActivationRecordsGenerator.generate(ActivationRecordsGenerator.java:226) > at > org.apache.kafka.controller.QuorumController$CompleteActivationEvent.generateRecordsAndResult(QuorumController.java:1237) > at > org.apache.kafka.controller.QuorumController$ControllerWriteEvent.run(QuorumController.java:784) > at > org.apache.kafka.queue.KafkaEventQueue$EventContext.run(KafkaEventQueue.java:127) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.handleEvents(KafkaEventQueue.java:210) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.run(KafkaEventQueue.java:181) > at java.base/java.lang.Thread.run(Thread.java:833) > [2023-10-19 13:42:09,538] DEBUG [QuorumController id=0] Got exception while > running completeActivation[15](1729737065). Invoking handleException. > (org.apache.kafka.queue.KafkaEventQueue:132) > org.apache.kafka.server.fault.FaultHandlerException: fatalFaultHandler: > exception while completing controller activation: The bootstrap > metadata.version 3.3-IV0 does not support ZK migrations. Cannot continue with > ZK migrations enabled. > at > org.apache.kafka.controller.ActivationRecordsGenerator.recordsForEmptyLog(ActivationRecordsGenerator.java:103) > at > org.apache.kafka.controller.ActivationRecordsGenerator.generate(ActivationRecordsGenerator.java:226) > at > org.apache.kafka.controller.QuorumController$CompleteActivationEvent.generateRecordsAndResult(QuorumController.java:1237) > at > org.apache.kafka.controller.QuorumController$ControllerWriteEvent.run(QuorumController.java:784) > at > org.apache.kafka.queue.KafkaEventQueue$EventContext.run(KafkaEventQueue.java:127) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.handleEvents(KafkaEventQueue.java:210) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.run(KafkaEventQueue.java:181) > at java.base/java.lang.Thread.run(Thread.java:833) > Caused by: java.lang.RuntimeException: The bootstrap metadata.version 3.3-IV0 > does not support ZK migrations. Cannot continue with ZK migrations enabled. > ... 8 more > [2023-10-19 13:42:09,538] ERROR Encountered nonFatalFaultHandler fault: > completeActivation[15]: event failed with FaultHandlerException (treated as > UnknownServerException) at epoch 15 in 121 microseconds. Renouncing > leadership and reverting to the last committed offset -1. > (org.apache.kafka.server.fault.MockFaultHandler:44) > org.apache.kafka.server.fault.FaultHandlerException: fatalFaultHandler: > exception while completing controller activation: The bootstrap > metadata.version 3.3-IV0 does not support ZK migrations. Cannot continue with > ZK migrations enabled. > at > org.apache.kafka.controller.ActivationRecordsGenerator.recordsForEmptyLog(ActivationRecordsGenerator.java:103) > at > org.apache.kafka.controller.ActivationRecordsGenerator.generate(ActivationRecordsGenerator.java:226) > at > org.apache.kafka.controller.QuorumController$CompleteActivationEvent.generateRecordsAndResult(QuorumController.java:1237) > at > org.apache.kafka.controller.QuorumController$ControllerWriteEvent.run(QuorumController.java:784) > at > org.apache.kafka.queue.KafkaEventQueue$EventContext.run(KafkaEventQueue.java:127) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.handleEvents(KafkaEventQueue.java:210) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.run(KafkaEventQueue.java:181) > at java.base/java.lang.Thread.run(Thread.java:833) > Caused by: java.lang.RuntimeException: The bootstrap metadata.version 3.3-IV0 > does not support ZK migrations. Cannot continue with ZK migrations enabled. > ... 8 more > [2023-10-19 13:42:09,538] DEBUG > append(batch=LeaderChangeBatch(newLeader=LeaderAndEpoch(leaderId=OptionalInt.empty, > epoch=16)), nextEndOffset=15) > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:276) > [2023-10-19 13:42:09,538] INFO Elected new leader: > LeaderAndEpoch(leaderId=OptionalInt[0], epoch=17). > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:300) > [2023-10-19 13:42:09,538] DEBUG > append(batch=LeaderChangeBatch(newLeader=LeaderAndEpoch(leaderId=OptionalInt[0], > epoch=17)), nextEndOffset=16) > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:276) > [2023-10-19 13:42:09,538] DEBUG [QuorumController id=0] Reverting to > in-memory snapshot -1 (org.apache.kafka.timeline.SnapshotRegistry:213) > [2023-10-19 13:42:09,540] DEBUG [LocalLogManager 0] Node 0: running log > check. (org.apache.kafka.metalog.LocalLogManager:536) > [2023-10-19 13:42:09,540] DEBUG [LocalLogManager 0] Node 0: Ignoring > LeaderAndEpoch(leaderId=OptionalInt.empty, epoch=16) since it doesn't match > the latest known leader LeaderAndEpoch(leaderId=OptionalInt[0], epoch=17) > (org.apache.kafka.metalog.LocalLogManager:585) > [2023-10-19 13:42:09,540] DEBUG [LocalLogManager 0] Node 0: Executing > handleLeaderChange LeaderAndEpoch(leaderId=OptionalInt[0], epoch=17) > (org.apache.kafka.metalog.LocalLogManager:578) > [2023-10-19 13:42:09,540] DEBUG [LocalLogManager 0] Node 0: running log > check. (org.apache.kafka.metalog.LocalLogManager:536) > [2023-10-19 13:42:09,542] DEBUG [QuorumController id=0] Executing > handleLeaderChange[17]. (org.apache.kafka.controller.QuorumController:577) > [2023-10-19 13:42:09,543] INFO [QuorumController id=0] In the new epoch 17, > the leader is (none). (org.apache.kafka.controller.QuorumController:1179) > [2023-10-19 13:42:09,543] DEBUG [QuorumController id=0] Processed > handleLeaderChange[17] in 488 us > (org.apache.kafka.controller.QuorumController:510) > [2023-10-19 13:42:09,543] DEBUG [QuorumController id=0] Executing > handleLeaderChange[17]. (org.apache.kafka.controller.QuorumController:577) > [2023-10-19 13:42:09,543] INFO [QuorumController id=0] Becoming the active > controller at epoch 17, next write offset 17. > (org.apache.kafka.controller.QuorumController:1175) > [2023-10-19 13:42:09,543] DEBUG [QuorumController id=0] Processed > handleLeaderChange[17] in 112 us > (org.apache.kafka.controller.QuorumController:510) > [2023-10-19 13:42:09,543] ERROR Encountered fatalFaultHandler fault: > exception while completing controller activation > (org.apache.kafka.server.fault.MockFaultHandler:44) > java.lang.RuntimeException: The bootstrap metadata.version 3.3-IV0 does not > support ZK migrations. Cannot continue with ZK migrations enabled. > at > org.apache.kafka.controller.ActivationRecordsGenerator.recordsForEmptyLog(ActivationRecordsGenerator.java:103) > at > org.apache.kafka.controller.ActivationRecordsGenerator.generate(ActivationRecordsGenerator.java:226) > at > org.apache.kafka.controller.QuorumController$CompleteActivationEvent.generateRecordsAndResult(QuorumController.java:1237) > at > org.apache.kafka.controller.QuorumController$ControllerWriteEvent.run(QuorumController.java:784) > at > org.apache.kafka.queue.KafkaEventQueue$EventContext.run(KafkaEventQueue.java:127) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.handleEvents(KafkaEventQueue.java:210) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.run(KafkaEventQueue.java:181) > at java.base/java.lang.Thread.run(Thread.java:833) > [2023-10-19 13:42:09,543] DEBUG [QuorumController id=0] Got exception while > running completeActivation[17](1805130027). Invoking handleException. > (org.apache.kafka.queue.KafkaEventQueue:132) > org.apache.kafka.server.fault.FaultHandlerException: fatalFaultHandler: > exception while completing controller activation: The bootstrap > metadata.version 3.3-IV0 does not support ZK migrations. Cannot continue with > ZK migrations enabled. > at > org.apache.kafka.controller.ActivationRecordsGenerator.recordsForEmptyLog(ActivationRecordsGenerator.java:103) > at > org.apache.kafka.controller.ActivationRecordsGenerator.generate(ActivationRecordsGenerator.java:226) > at > org.apache.kafka.controller.QuorumController$CompleteActivationEvent.generateRecordsAndResult(QuorumController.java:1237) > at > org.apache.kafka.controller.QuorumController$ControllerWriteEvent.run(QuorumController.java:784) > at > org.apache.kafka.queue.KafkaEventQueue$EventContext.run(KafkaEventQueue.java:127) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.handleEvents(KafkaEventQueue.java:210) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.run(KafkaEventQueue.java:181) > at java.base/java.lang.Thread.run(Thread.java:833) > Caused by: java.lang.RuntimeException: The bootstrap metadata.version 3.3-IV0 > does not support ZK migrations. Cannot continue with ZK migrations enabled. > ... 8 more > [2023-10-19 13:42:09,543] ERROR Encountered nonFatalFaultHandler fault: > completeActivation[17]: event failed with FaultHandlerException (treated as > UnknownServerException) at epoch 17 in 328 microseconds. Renouncing > leadership and reverting to the last committed offset -1. > (org.apache.kafka.server.fault.MockFaultHandler:44) > org.apache.kafka.server.fault.FaultHandlerException: fatalFaultHandler: > exception while completing controller activation: The bootstrap > metadata.version 3.3-IV0 does not support ZK migrations. Cannot continue with > ZK migrations enabled. > at > org.apache.kafka.controller.ActivationRecordsGenerator.recordsForEmptyLog(ActivationRecordsGenerator.java:103) > at > org.apache.kafka.controller.ActivationRecordsGenerator.generate(ActivationRecordsGenerator.java:226) > at > org.apache.kafka.controller.QuorumController$CompleteActivationEvent.generateRecordsAndResult(QuorumController.java:1237) > at > org.apache.kafka.controller.QuorumController$ControllerWriteEvent.run(QuorumController.java:784) > at > org.apache.kafka.queue.KafkaEventQueue$EventContext.run(KafkaEventQueue.java:127) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.handleEvents(KafkaEventQueue.java:210) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.run(KafkaEventQueue.java:181) > at java.base/java.lang.Thread.run(Thread.java:833) > Caused by: java.lang.RuntimeException: The bootstrap metadata.version 3.3-IV0 > does not support ZK migrations. Cannot continue with ZK migrations enabled. > ... 8 more > [2023-10-19 13:42:09,543] DEBUG > append(batch=LeaderChangeBatch(newLeader=LeaderAndEpoch(leaderId=OptionalInt.empty, > epoch=18)), nextEndOffset=17) > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:276) > [2023-10-19 13:42:09,544] INFO Elected new leader: > LeaderAndEpoch(leaderId=OptionalInt[0], epoch=19). > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:300) > [2023-10-19 13:42:09,544] DEBUG > append(batch=LeaderChangeBatch(newLeader=LeaderAndEpoch(leaderId=OptionalInt[0], > epoch=19)), nextEndOffset=18) > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:276) > [2023-10-19 13:42:09,544] DEBUG [QuorumController id=0] Reverting to > in-memory snapshot -1 (org.apache.kafka.timeline.SnapshotRegistry:213) > [2023-10-19 13:42:09,545] DEBUG [LocalLogManager 0] Node 0: running log > check. (org.apache.kafka.metalog.LocalLogManager:536) > [2023-10-19 13:42:09,546] DEBUG [LocalLogManager 0] Node 0: Ignoring > LeaderAndEpoch(leaderId=OptionalInt.empty, epoch=18) since it doesn't match > the latest known leader LeaderAndEpoch(leaderId=OptionalInt[0], epoch=19) > (org.apache.kafka.metalog.LocalLogManager:585) > [2023-10-19 13:42:09,546] DEBUG [LocalLogManager 0] Node 0: Executing > handleLeaderChange LeaderAndEpoch(leaderId=OptionalInt[0], epoch=19) > (org.apache.kafka.metalog.LocalLogManager:578) > [2023-10-19 13:42:09,546] DEBUG [LocalLogManager 0] Node 0: running log > check. (org.apache.kafka.metalog.LocalLogManager:536) > [2023-10-19 13:42:09,548] DEBUG [QuorumController id=0] Executing > handleLeaderChange[19]. (org.apache.kafka.controller.QuorumController:577) > [2023-10-19 13:42:09,548] INFO [QuorumController id=0] In the new epoch 19, > the leader is (none). (org.apache.kafka.controller.QuorumController:1179) > [2023-10-19 13:42:09,548] DEBUG [QuorumController id=0] Processed > handleLeaderChange[19] in 114 us > (org.apache.kafka.controller.QuorumController:510) > [2023-10-19 13:42:09,548] DEBUG [QuorumController id=0] Executing > handleLeaderChange[19]. (org.apache.kafka.controller.QuorumController:577) > [2023-10-19 13:42:09,548] INFO [QuorumController id=0] Becoming the active > controller at epoch 19, next write offset 19. > (org.apache.kafka.controller.QuorumController:1175) > [2023-10-19 13:42:09,548] DEBUG [QuorumController id=0] Processed > handleLeaderChange[19] in 98 us > (org.apache.kafka.controller.QuorumController:510) > [2023-10-19 13:42:09,548] ERROR Encountered fatalFaultHandler fault: > exception while completing controller activation > (org.apache.kafka.server.fault.MockFaultHandler:44) > java.lang.RuntimeException: The bootstrap metadata.version 3.3-IV0 does not > support ZK migrations. Cannot continue with ZK migrations enabled. > at > org.apache.kafka.controller.ActivationRecordsGenerator.recordsForEmptyLog(ActivationRecordsGenerator.java:103) > at > org.apache.kafka.controller.ActivationRecordsGenerator.generate(ActivationRecordsGenerator.java:226) > at > org.apache.kafka.controller.QuorumController$CompleteActivationEvent.generateRecordsAndResult(QuorumController.java:1237) > at > org.apache.kafka.controller.QuorumController$ControllerWriteEvent.run(QuorumController.java:784) > at > org.apache.kafka.queue.KafkaEventQueue$EventContext.run(KafkaEventQueue.java:127) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.handleEvents(KafkaEventQueue.java:210) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.run(KafkaEventQueue.java:181) > at java.base/java.lang.Thread.run(Thread.java:833) > [2023-10-19 13:42:09,548] DEBUG [QuorumController id=0] Got exception while > running completeActivation[19](492295970). Invoking handleException. > (org.apache.kafka.queue.KafkaEventQueue:132) > org.apache.kafka.server.fault.FaultHandlerException: fatalFaultHandler: > exception while completing controller activation: The bootstrap > metadata.version 3.3-IV0 does not support ZK migrations. Cannot continue with > ZK migrations enabled. > at > org.apache.kafka.controller.ActivationRecordsGenerator.recordsForEmptyLog(ActivationRecordsGenerator.java:103) > at > org.apache.kafka.controller.ActivationRecordsGenerator.generate(ActivationRecordsGenerator.java:226) > at > org.apache.kafka.controller.QuorumController$CompleteActivationEvent.generateRecordsAndResult(QuorumController.java:1237) > at > org.apache.kafka.controller.QuorumController$ControllerWriteEvent.run(QuorumController.java:784) > at > org.apache.kafka.queue.KafkaEventQueue$EventContext.run(KafkaEventQueue.java:127) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.handleEvents(KafkaEventQueue.java:210) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.run(KafkaEventQueue.java:181) > at java.base/java.lang.Thread.run(Thread.java:833) > Caused by: java.lang.RuntimeException: The bootstrap metadata.version 3.3-IV0 > does not support ZK migrations. Cannot continue with ZK migrations enabled. > ... 8 more > [2023-10-19 13:42:09,548] ERROR Encountered nonFatalFaultHandler fault: > completeActivation[19]: event failed with FaultHandlerException (treated as > UnknownServerException) at epoch 19 in 280 microseconds. Renouncing > leadership and reverting to the last committed offset -1. > (org.apache.kafka.server.fault.MockFaultHandler:44) > org.apache.kafka.server.fault.FaultHandlerException: fatalFaultHandler: > exception while completing controller activation: The bootstrap > metadata.version 3.3-IV0 does not support ZK migrations. Cannot continue with > ZK migrations enabled. > at > org.apache.kafka.controller.ActivationRecordsGenerator.recordsForEmptyLog(ActivationRecordsGenerator.java:103) > at > org.apache.kafka.controller.ActivationRecordsGenerator.generate(ActivationRecordsGenerator.java:226) > at > org.apache.kafka.controller.QuorumController$CompleteActivationEvent.generateRecordsAndResult(QuorumController.java:1237) > at > org.apache.kafka.controller.QuorumController$ControllerWriteEvent.run(QuorumController.java:784) > at > org.apache.kafka.queue.KafkaEventQueue$EventContext.run(KafkaEventQueue.java:127) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.handleEvents(KafkaEventQueue.java:210) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.run(KafkaEventQueue.java:181) > at java.base/java.lang.Thread.run(Thread.java:833) > Caused by: java.lang.RuntimeException: The bootstrap metadata.version 3.3-IV0 > does not support ZK migrations. Cannot continue with ZK migrations enabled. > ... 8 more > [2023-10-19 13:42:09,548] DEBUG > append(batch=LeaderChangeBatch(newLeader=LeaderAndEpoch(leaderId=OptionalInt.empty, > epoch=20)), nextEndOffset=19) > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:276) > [2023-10-19 13:42:09,549] INFO Elected new leader: > LeaderAndEpoch(leaderId=OptionalInt[0], epoch=21). > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:300) > [2023-10-19 13:42:09,549] DEBUG > append(batch=LeaderChangeBatch(newLeader=LeaderAndEpoch(leaderId=OptionalInt[0], > epoch=21)), nextEndOffset=20) > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:276) > [2023-10-19 13:42:09,549] DEBUG [QuorumController id=0] Reverting to > in-memory snapshot -1 (org.apache.kafka.timeline.SnapshotRegistry:213) > [2023-10-19 13:42:09,551] DEBUG [LocalLogManager 0] Node 0: running log > check. (org.apache.kafka.metalog.LocalLogManager:536) > [2023-10-19 13:42:09,551] DEBUG [LocalLogManager 0] Node 0: Ignoring > LeaderAndEpoch(leaderId=OptionalInt.empty, epoch=20) since it doesn't match > the latest known leader LeaderAndEpoch(leaderId=OptionalInt[0], epoch=21) > (org.apache.kafka.metalog.LocalLogManager:585) > [2023-10-19 13:42:09,551] DEBUG [LocalLogManager 0] Node 0: Executing > handleLeaderChange LeaderAndEpoch(leaderId=OptionalInt[0], epoch=21) > (org.apache.kafka.metalog.LocalLogManager:578) > [2023-10-19 13:42:09,551] DEBUG [LocalLogManager 0] Node 0: running log > check. (org.apache.kafka.metalog.LocalLogManager:536) > [2023-10-19 13:42:09,557] DEBUG [QuorumController id=0] Executing > handleLeaderChange[21]. (org.apache.kafka.controller.QuorumController:577) > [2023-10-19 13:42:09,557] INFO [QuorumController id=0] In the new epoch 21, > the leader is (none). (org.apache.kafka.controller.QuorumController:1179) > [2023-10-19 13:42:09,557] DEBUG [QuorumController id=0] Processed > handleLeaderChange[21] in 175 us > (org.apache.kafka.controller.QuorumController:510) > [2023-10-19 13:42:09,557] DEBUG [QuorumController id=0] Executing > handleLeaderChange[21]. (org.apache.kafka.controller.QuorumController:577) > [2023-10-19 13:42:09,557] INFO [QuorumController id=0] Becoming the active > controller at epoch 21, next write offset 21. > (org.apache.kafka.controller.QuorumController:1175) > [2023-10-19 13:42:09,557] DEBUG [QuorumController id=0] Processed > handleLeaderChange[21] in 112 us > (org.apache.kafka.controller.QuorumController:510) > [2023-10-19 13:42:09,557] ERROR Encountered fatalFaultHandler fault: > exception while completing controller activation > (org.apache.kafka.server.fault.MockFaultHandler:44) > java.lang.RuntimeException: The bootstrap metadata.version 3.3-IV0 does not > support ZK migrations. Cannot continue with ZK migrations enabled. > at > org.apache.kafka.controller.ActivationRecordsGenerator.recordsForEmptyLog(ActivationRecordsGenerator.java:103) > at > org.apache.kafka.controller.ActivationRecordsGenerator.generate(ActivationRecordsGenerator.java:226) > at > org.apache.kafka.controller.QuorumController$CompleteActivationEvent.generateRecordsAndResult(QuorumController.java:1237) > at > org.apache.kafka.controller.QuorumController$ControllerWriteEvent.run(QuorumController.java:784) > at > org.apache.kafka.queue.KafkaEventQueue$EventContext.run(KafkaEventQueue.java:127) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.handleEvents(KafkaEventQueue.java:210) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.run(KafkaEventQueue.java:181) > at java.base/java.lang.Thread.run(Thread.java:833) > [2023-10-19 13:42:09,558] DEBUG [QuorumController id=0] Got exception while > running completeActivation[21](1265411926). Invoking handleException. > (org.apache.kafka.queue.KafkaEventQueue:132) > org.apache.kafka.server.fault.FaultHandlerException: fatalFaultHandler: > exception while completing controller activation: The bootstrap > metadata.version 3.3-IV0 does not support ZK migrations. Cannot continue with > ZK migrations enabled. > at > org.apache.kafka.controller.ActivationRecordsGenerator.recordsForEmptyLog(ActivationRecordsGenerator.java:103) > at > org.apache.kafka.controller.ActivationRecordsGenerator.generate(ActivationRecordsGenerator.java:226) > at > org.apache.kafka.controller.QuorumController$CompleteActivationEvent.generateRecordsAndResult(QuorumController.java:1237) > at > org.apache.kafka.controller.QuorumController$ControllerWriteEvent.run(QuorumController.java:784) > at > org.apache.kafka.queue.KafkaEventQueue$EventContext.run(KafkaEventQueue.java:127) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.handleEvents(KafkaEventQueue.java:210) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.run(KafkaEventQueue.java:181) > at java.base/java.lang.Thread.run(Thread.java:833) > Caused by: java.lang.RuntimeException: The bootstrap metadata.version 3.3-IV0 > does not support ZK migrations. Cannot continue with ZK migrations enabled. > ... 8 more > [2023-10-19 13:42:09,559] ERROR Encountered nonFatalFaultHandler fault: > completeActivation[21]: event failed with FaultHandlerException (treated as > UnknownServerException) at epoch 21 in 1233 microseconds. Renouncing > leadership and reverting to the last committed offset -1. > (org.apache.kafka.server.fault.MockFaultHandler:44) > org.apache.kafka.server.fault.FaultHandlerException: fatalFaultHandler: > exception while completing controller activation: The bootstrap > metadata.version 3.3-IV0 does not support ZK migrations. Cannot continue with > ZK migrations enabled. > at > org.apache.kafka.controller.ActivationRecordsGenerator.recordsForEmptyLog(ActivationRecordsGenerator.java:103) > at > org.apache.kafka.controller.ActivationRecordsGenerator.generate(ActivationRecordsGenerator.java:226) > at > org.apache.kafka.controller.QuorumController$CompleteActivationEvent.generateRecordsAndResult(QuorumController.java:1237) > at > org.apache.kafka.controller.QuorumController$ControllerWriteEvent.run(QuorumController.java:784) > at > org.apache.kafka.queue.KafkaEventQueue$EventContext.run(KafkaEventQueue.java:127) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.handleEvents(KafkaEventQueue.java:210) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.run(KafkaEventQueue.java:181) > at java.base/java.lang.Thread.run(Thread.java:833) > Caused by: java.lang.RuntimeException: The bootstrap metadata.version 3.3-IV0 > does not support ZK migrations. Cannot continue with ZK migrations enabled. > ... 8 more > [2023-10-19 13:42:09,559] DEBUG > append(batch=LeaderChangeBatch(newLeader=LeaderAndEpoch(leaderId=OptionalInt.empty, > epoch=22)), nextEndOffset=21) > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:276) > [2023-10-19 13:42:09,559] INFO Elected new leader: > LeaderAndEpoch(leaderId=OptionalInt[0], epoch=23). > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:300) > [2023-10-19 13:42:09,559] DEBUG > append(batch=LeaderChangeBatch(newLeader=LeaderAndEpoch(leaderId=OptionalInt[0], > epoch=23)), nextEndOffset=22) > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:276) > [2023-10-19 13:42:09,559] DEBUG [QuorumController id=0] Reverting to > in-memory snapshot -1 (org.apache.kafka.timeline.SnapshotRegistry:213) > [2023-10-19 13:42:09,559] DEBUG [QuorumController id=0] Processed read > migration state(18563510) in 6 us > (org.apache.kafka.controller.QuorumController:510) > [2023-10-19 13:42:09,560] DEBUG [LocalLogManager 0] Node 0: running log > check. (org.apache.kafka.metalog.LocalLogManager:536) > [2023-10-19 13:42:09,560] DEBUG [LocalLogManager 0] Node 0: Ignoring > LeaderAndEpoch(leaderId=OptionalInt.empty, epoch=22) since it doesn't match > the latest known leader LeaderAndEpoch(leaderId=OptionalInt[0], epoch=23) > (org.apache.kafka.metalog.LocalLogManager:585) > [2023-10-19 13:42:09,560] DEBUG [LocalLogManager 0] Node 0: Executing > handleLeaderChange LeaderAndEpoch(leaderId=OptionalInt[0], epoch=23) > (org.apache.kafka.metalog.LocalLogManager:578) > [2023-10-19 13:42:09,560] DEBUG [LocalLogManager 0] Node 0: running log > check. (org.apache.kafka.metalog.LocalLogManager:536) > [2023-10-19 13:42:09,562] DEBUG [QuorumController id=0] Executing > handleLeaderChange[23]. (org.apache.kafka.controller.QuorumController:577) > [2023-10-19 13:42:09,562] INFO [QuorumController id=0] In the new epoch 23, > the leader is (none). (org.apache.kafka.controller.QuorumController:1179) > [2023-10-19 13:42:09,562] DEBUG [QuorumController id=0] Processed > handleLeaderChange[23] in 74 us > (org.apache.kafka.controller.QuorumController:510) > [2023-10-19 13:42:09,562] INFO [QuorumController id=0] > QuorumController#beginShutdown: shutting down event queue. > (org.apache.kafka.queue.KafkaEventQueue:492) > [2023-10-19 13:42:09,568] DEBUG [QuorumController id=0] > KafkaEventQueue#close: Event queue is already shutting down. > (org.apache.kafka.queue.KafkaEventQueue:489) > [2023-10-19 13:42:09,571] DEBUG [QuorumController id=0] Executing > handleLeaderChange[23]. (org.apache.kafka.controller.QuorumController:577) > [2023-10-19 13:42:09,571] INFO [QuorumController id=0] Becoming the active > controller at epoch 23, next write offset 23. > (org.apache.kafka.controller.QuorumController:1175) > [2023-10-19 13:42:09,571] INFO [QuorumController id=0] > completeActivation[23]: event unable to start processing because of > RejectedExecutionException (treated as TimeoutException). > (org.apache.kafka.controller.QuorumController:542) > [2023-10-19 13:42:09,571] DEBUG [QuorumController id=0] Processed > handleLeaderChange[23] in 144 us > (org.apache.kafka.controller.QuorumController:510) > [2023-10-19 13:42:09,574] INFO [QuorumController id=0] closed event queue. > (org.apache.kafka.queue.KafkaEventQueue:514) > [2023-10-19 13:42:09,574] INFO [LocalLogManager 0] beginShutdown: shutting > down event queue. (org.apache.kafka.queue.KafkaEventQueue:492) > [2023-10-19 13:42:09,576] DEBUG [LocalLogManager 0] Node 0: closing. > (org.apache.kafka.metalog.LocalLogManager:653) > [2023-10-19 13:42:09,576] DEBUG [LocalLogManager 0] beginShutdown: Event > queue is already shutting down. (org.apache.kafka.queue.KafkaEventQueue:489) > [2023-10-19 13:42:09,576] DEBUG [LocalLogManager 0] KafkaEventQueue#close: > Event queue is already shutting down. > (org.apache.kafka.queue.KafkaEventQueue:489) > [2023-10-19 13:42:09,576] DEBUG [LocalLogManager 0] Node 0: beginning > shutdown. (org.apache.kafka.metalog.LocalLogManager:637) > [2023-10-19 13:42:09,577] DEBUG > append(batch=LeaderChangeBatch(newLeader=LeaderAndEpoch(leaderId=OptionalInt.empty, > epoch=24)), nextEndOffset=23) > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:276) > [2023-10-19 13:42:09,577] INFO Elected new leader: > LeaderAndEpoch(leaderId=OptionalInt[0], epoch=25). > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:300) > [2023-10-19 13:42:09,577] DEBUG > append(batch=LeaderChangeBatch(newLeader=LeaderAndEpoch(leaderId=OptionalInt[0], > epoch=25)), nextEndOffset=24) > (org.apache.kafka.metalog.LocalLogManager$SharedLogData:276) > [2023-10-19 13:42:09,577] DEBUG [QuorumController id=0] > MetaLogManager.Listener: Event queue is already shutting down. > (org.apache.kafka.queue.KafkaEventQueue:489) > [2023-10-19 13:42:09,578] INFO [LocalLogManager 0] closed event queue. > (org.apache.kafka.queue.KafkaEventQueue:514) > {code} -- This message was sent by Atlassian Jira (v8.20.10#820010)