[
https://issues.apache.org/jira/browse/KAFKA-6078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16993754#comment-16993754
]
John Roesler commented on KAFKA-6078:
-------------------------------------
This had just failed for me on
https://builds.apache.org/job/kafka-pr-jdk8-scala2.11/27074/testReport/junit/kafka.admin/ReassignPartitionsClusterTest/shouldExpandCluster/
{noformat}
Error Message
org.scalatest.exceptions.TestFailedException: Partition should have been moved
to the expected log directory on broker 100
Stacktrace
org.scalatest.exceptions.TestFailedException: Partition should have been moved
to the expected log directory on broker 100
at
org.scalatest.Assertions$class.newAssertionFailedException(Assertions.scala:530)
at
org.scalatest.Assertions$.newAssertionFailedException(Assertions.scala:1389)
at org.scalatest.Assertions$class.fail(Assertions.scala:1091)
at org.scalatest.Assertions$.fail(Assertions.scala:1389)
at kafka.utils.TestUtils$.waitUntilTrue(TestUtils.scala:842)
at
kafka.admin.ReassignPartitionsClusterTest.shouldExpandCluster(ReassignPartitionsClusterTest.scala:218)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:305)
at
org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:365)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
at org.junit.runners.ParentRunner$4.run(ParentRunner.java:330)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:78)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:328)
at org.junit.runners.ParentRunner.access$100(ParentRunner.java:65)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:292)
at
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:305)
at org.junit.runners.ParentRunner.run(ParentRunner.java:412)
at
org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.runTestClass(JUnitTestClassExecutor.java:110)
at
org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.execute(JUnitTestClassExecutor.java:58)
at
org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.execute(JUnitTestClassExecutor.java:38)
at
org.gradle.api.internal.tasks.testing.junit.AbstractJUnitTestClassProcessor.processTestClass(AbstractJUnitTestClassProcessor.java:62)
at
org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:51)
at sun.reflect.GeneratedMethodAccessor20.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:36)
at
org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at
org.gradle.internal.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:33)
at
org.gradle.internal.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:94)
at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
at
org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:118)
at sun.reflect.GeneratedMethodAccessor19.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:36)
at
org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at
org.gradle.internal.remote.internal.hub.MessageHubBackedObjectConnection$DispatchWrapper.dispatch(MessageHubBackedObjectConnection.java:182)
at
org.gradle.internal.remote.internal.hub.MessageHubBackedObjectConnection$DispatchWrapper.dispatch(MessageHubBackedObjectConnection.java:164)
at
org.gradle.internal.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:412)
at
org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:64)
at
org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:48)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at
org.gradle.internal.concurrent.ThreadFactoryImpl$ManagedThreadRunnable.run(ThreadFactoryImpl.java:56)
at java.lang.Thread.run(Thread.java:748)
Standard Output
[2019-12-11 01:24:26,961] INFO [ControllerEventThread controllerId=100]
Starting (kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:24:26,966] INFO [Controller id=100] 100 successfully elected as
the controller. Epoch incremented to 1 and epoch zk version is now 1
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:26,966] INFO [Controller id=100] Registering handlers
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:26,968] INFO [Controller id=100] Deleting log dir event
notifications (kafka.controller.KafkaController:66)
[2019-12-11 01:24:26,968] INFO [Controller id=100] Deleting isr change
notifications (kafka.controller.KafkaController:66)
[2019-12-11 01:24:26,969] INFO [Controller id=100] Initializing controller
context (kafka.controller.KafkaController:66)
[2019-12-11 01:24:26,972] INFO [Controller id=100] Initialized broker epochs
cache: Map(100 -> 25) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:26,976] INFO [Controller id=100] Currently active brokers in
the cluster: Set(100) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:26,976] INFO [Controller id=100] Currently shutting brokers
in the cluster: Set() (kafka.controller.KafkaController:66)
[2019-12-11 01:24:26,976] INFO [Controller id=100] Current list of topics in
the cluster: Set() (kafka.controller.KafkaController:66)
[2019-12-11 01:24:26,976] INFO [Controller id=100] Fetching topic deletions in
progress (kafka.controller.KafkaController:66)
[2019-12-11 01:24:26,977] INFO [Controller id=100] List of topics to be
deleted: (kafka.controller.KafkaController:66)
[2019-12-11 01:24:26,977] INFO [Controller id=100] List of topics ineligible
for deletion: (kafka.controller.KafkaController:66)
[2019-12-11 01:24:26,977] INFO [Controller id=100] Initializing topic deletion
manager (kafka.controller.KafkaController:66)
[2019-12-11 01:24:26,977] INFO [Controller id=100] Sending update metadata
request (kafka.controller.KafkaController:66)
[2019-12-11 01:24:26,978] INFO [Controller id=100] Ready to serve as the new
controller with epoch 1 (kafka.controller.KafkaController:66)
[2019-12-11 01:24:26,979] INFO [Controller id=100] Partitions undergoing
preferred replica election: (kafka.controller.KafkaController:66)
[2019-12-11 01:24:26,979] INFO [Controller id=100] Partitions that completed
preferred replica election: (kafka.controller.KafkaController:66)
[2019-12-11 01:24:26,979] INFO [Controller id=100] Skipping preferred replica
election for partitions due to topic deletion:
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:26,979] INFO [Controller id=100] Resuming preferred replica
election for partitions: (kafka.controller.KafkaController:66)
[2019-12-11 01:24:26,979] INFO [Controller id=100] Starting replica leader
election (PREFERRED) for partitions triggered by ZkTriggered
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:26,980] INFO [Controller id=100] Starting the controller
scheduler (kafka.controller.KafkaController:66)
[2019-12-11 01:24:27,018] INFO [Controller id=100] Newly added brokers: 101,
deleted brokers: , bounced brokers: , all live brokers: 100,101
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:27,019] INFO [Controller id=100] New broker startup callback
for 101 (kafka.controller.KafkaController:66)
[2019-12-11 01:24:27,020] INFO [Controller id=100] Updated broker epochs cache:
Map(100 -> 25, 101 -> 44) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:27,221] INFO [ControllerEventThread controllerId=101]
Starting (kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:24:27,240] INFO [Controller id=100] New topics: [Set(my-topic)],
deleted topics: [Set()], new partition replica assignment [Map(my-topic-1 ->
ReplicaAssignment(replicas=101, addingReplicas=, removingReplicas=), my-topic-0
-> ReplicaAssignment(replicas=100, addingReplicas=, removingReplicas=))]
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:27,240] INFO [Controller id=100] New partition creation
callback for my-topic-1,my-topic-0 (kafka.controller.KafkaController:66)
[2019-12-11 01:24:27,644] INFO [Controller id=100] New topics: [Set(topic2)],
deleted topics: [Set()], new partition replica assignment [Map(topic2-0 ->
ReplicaAssignment(replicas=100, addingReplicas=, removingReplicas=))]
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:27,644] INFO [Controller id=100] New partition creation
callback for topic2-0 (kafka.controller.KafkaController:66)
[2019-12-11 01:24:28,209] INFO [Controller id=100] Successfully updated
assignment of partition my-topic-0 to ReplicaAssignment(replicas=101,100,
addingReplicas=101, removingReplicas=100) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:28,211] INFO [Controller id=100] Updated leader epoch for
partition my-topic-0 to 1 (kafka.controller.KafkaController:66)
[2019-12-11 01:24:28,213] INFO [Controller id=100] Successfully updated
assignment of partition topic2-0 to ReplicaAssignment(replicas=101,100,
addingReplicas=101, removingReplicas=100) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:28,215] INFO [Controller id=100] Updated leader epoch for
partition topic2-0 to 1 (kafka.controller.KafkaController:66)
[2019-12-11 01:24:28,399] INFO [Controller id=100] Target replicas
ArrayBuffer(101) have all caught up with the leader for reassigning partition
topic2-0 (kafka.controller.KafkaController:66)
[2019-12-11 01:24:28,400] INFO [Controller id=100] Leader 100 for partition
topic2-0 being reassigned, is not in the new list of replicas 101. Re-electing
leader (kafka.controller.KafkaController:66)
[2019-12-11 01:24:28,406] INFO [Controller id=100] Successfully updated
assignment of partition topic2-0 to ReplicaAssignment(replicas=101,
addingReplicas=, removingReplicas=) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:28,424] INFO [Controller id=100] Target replicas
ArrayBuffer(101) have all caught up with the leader for reassigning partition
my-topic-0 (kafka.controller.KafkaController:66)
[2019-12-11 01:24:28,425] INFO [Controller id=100] Leader 100 for partition
my-topic-0 being reassigned, is not in the new list of replicas 101.
Re-electing leader (kafka.controller.KafkaController:66)
[2019-12-11 01:24:28,428] INFO [Controller id=100] Successfully updated
assignment of partition my-topic-0 to ReplicaAssignment(replicas=101,
addingReplicas=, removingReplicas=) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:29,370] INFO [ControllerEventThread controllerId=100]
Shutting down (kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:24:29,371] INFO [ControllerEventThread controllerId=100] Stopped
(kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:24:29,371] INFO [ControllerEventThread controllerId=100]
Shutdown completed
(kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:24:29,372] INFO [Controller id=100] Resigned
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:29,376] INFO [Controller id=101] 101 successfully elected as
the controller. Epoch incremented to 2 and epoch zk version is now 2
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:29,377] INFO [Controller id=101] Registering handlers
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:29,378] INFO [Controller id=101] Deleting log dir event
notifications (kafka.controller.KafkaController:66)
[2019-12-11 01:24:29,378] INFO [Controller id=101] Deleting isr change
notifications (kafka.controller.KafkaController:66)
[2019-12-11 01:24:29,378] INFO [Controller id=101] Initializing controller
context (kafka.controller.KafkaController:66)
[2019-12-11 01:24:29,380] INFO [Controller id=101] Initialized broker epochs
cache: Map(101 -> 44) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:29,383] INFO [Controller id=101] Currently active brokers in
the cluster: Set(101) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:29,383] INFO [Controller id=101] Currently shutting brokers
in the cluster: Set() (kafka.controller.KafkaController:66)
[2019-12-11 01:24:29,384] INFO [Controller id=101] Current list of topics in
the cluster: Set(topic2, my-topic) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:29,384] INFO [Controller id=101] Fetching topic deletions in
progress (kafka.controller.KafkaController:66)
[2019-12-11 01:24:29,384] INFO [Controller id=101] List of topics to be
deleted: (kafka.controller.KafkaController:66)
[2019-12-11 01:24:29,385] INFO [Controller id=101] List of topics ineligible
for deletion: (kafka.controller.KafkaController:66)
[2019-12-11 01:24:29,385] INFO [Controller id=101] Initializing topic deletion
manager (kafka.controller.KafkaController:66)
[2019-12-11 01:24:29,385] INFO [Controller id=101] Sending update metadata
request (kafka.controller.KafkaController:66)
[2019-12-11 01:24:29,385] INFO [Controller id=101] Ready to serve as the new
controller with epoch 2 (kafka.controller.KafkaController:66)
[2019-12-11 01:24:29,386] INFO [Controller id=101] Partitions undergoing
preferred replica election: (kafka.controller.KafkaController:66)
[2019-12-11 01:24:29,386] INFO [Controller id=101] Partitions that completed
preferred replica election: (kafka.controller.KafkaController:66)
[2019-12-11 01:24:29,386] INFO [Controller id=101] Skipping preferred replica
election for partitions due to topic deletion:
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:29,386] INFO [Controller id=101] Resuming preferred replica
election for partitions: (kafka.controller.KafkaController:66)
[2019-12-11 01:24:29,386] INFO [Controller id=101] Starting replica leader
election (PREFERRED) for partitions triggered by ZkTriggered
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:29,387] INFO [Controller id=101] Starting the controller
scheduler (kafka.controller.KafkaController:66)
[2019-12-11 01:24:30,618] INFO [ControllerEventThread controllerId=101]
Shutting down (kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:24:30,619] INFO [ControllerEventThread controllerId=101] Stopped
(kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:24:30,619] INFO [ControllerEventThread controllerId=101]
Shutdown completed
(kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:24:30,620] INFO [Controller id=101] Resigned
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:31,382] INFO [ControllerEventThread controllerId=100]
Starting (kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:24:31,385] INFO [Controller id=100] 100 successfully elected as
the controller. Epoch incremented to 1 and epoch zk version is now 1
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:31,385] INFO [Controller id=100] Registering handlers
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:31,386] INFO [Controller id=100] Deleting log dir event
notifications (kafka.controller.KafkaController:66)
[2019-12-11 01:24:31,387] INFO [Controller id=100] Deleting isr change
notifications (kafka.controller.KafkaController:66)
[2019-12-11 01:24:31,387] INFO [Controller id=100] Initializing controller
context (kafka.controller.KafkaController:66)
[2019-12-11 01:24:31,388] INFO [Controller id=100] Initialized broker epochs
cache: Map(100 -> 25) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:31,393] INFO [Controller id=100] Currently active brokers in
the cluster: Set(100) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:31,393] INFO [Controller id=100] Currently shutting brokers
in the cluster: Set() (kafka.controller.KafkaController:66)
[2019-12-11 01:24:31,393] INFO [Controller id=100] Current list of topics in
the cluster: Set() (kafka.controller.KafkaController:66)
[2019-12-11 01:24:31,393] INFO [Controller id=100] Fetching topic deletions in
progress (kafka.controller.KafkaController:66)
[2019-12-11 01:24:31,393] INFO [Controller id=100] List of topics to be
deleted: (kafka.controller.KafkaController:66)
[2019-12-11 01:24:31,393] INFO [Controller id=100] List of topics ineligible
for deletion: (kafka.controller.KafkaController:66)
[2019-12-11 01:24:31,393] INFO [Controller id=100] Initializing topic deletion
manager (kafka.controller.KafkaController:66)
[2019-12-11 01:24:31,393] INFO [Controller id=100] Sending update metadata
request (kafka.controller.KafkaController:66)
[2019-12-11 01:24:31,394] INFO [Controller id=100] Ready to serve as the new
controller with epoch 1 (kafka.controller.KafkaController:66)
[2019-12-11 01:24:31,395] INFO [Controller id=100] Partitions undergoing
preferred replica election: (kafka.controller.KafkaController:66)
[2019-12-11 01:24:31,395] INFO [Controller id=100] Partitions that completed
preferred replica election: (kafka.controller.KafkaController:66)
[2019-12-11 01:24:31,395] INFO [Controller id=100] Skipping preferred replica
election for partitions due to topic deletion:
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:31,395] INFO [Controller id=100] Resuming preferred replica
election for partitions: (kafka.controller.KafkaController:66)
[2019-12-11 01:24:31,395] INFO [Controller id=100] Starting replica leader
election (PREFERRED) for partitions triggered by ZkTriggered
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:31,396] INFO [Controller id=100] Starting the controller
scheduler (kafka.controller.KafkaController:66)
[2019-12-11 01:24:31,437] INFO [Controller id=100] Newly added brokers: 101,
deleted brokers: , bounced brokers: , all live brokers: 100,101
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:31,440] INFO [Controller id=100] New broker startup callback
for 101 (kafka.controller.KafkaController:66)
[2019-12-11 01:24:31,440] INFO [Controller id=100] Updated broker epochs cache:
Map(100 -> 25, 101 -> 44) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:31,643] INFO [ControllerEventThread controllerId=101]
Starting (kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:24:31,711] INFO [Controller id=100] Newly added brokers: 102,
deleted brokers: , bounced brokers: , all live brokers: 100,101,102
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:31,713] INFO [Controller id=100] New broker startup callback
for 102 (kafka.controller.KafkaController:66)
[2019-12-11 01:24:31,714] INFO [Controller id=100] Updated broker epochs cache:
Map(100 -> 25, 101 -> 44, 102 -> 60) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:31,908] INFO [ControllerEventThread controllerId=102]
Starting (kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:24:31,929] INFO [Controller id=100] New topics: [Set(my-topic)],
deleted topics: [Set()], new partition replica assignment [Map(my-topic-0 ->
ReplicaAssignment(replicas=100,101, addingReplicas=, removingReplicas=))]
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:31,930] INFO [Controller id=100] New partition creation
callback for my-topic-0 (kafka.controller.KafkaController:66)
[2019-12-11 01:24:31,940] ERROR [ReplicaFetcher replicaId=101, leaderId=100,
fetcherId=0] Error for partition my-topic-0 at offset 0
(kafka.server.ReplicaFetcherThread:76)
org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server
does not host this topic-partition.
Current partition replica assignment
{"version":1,"partitions":[{"topic":"my-topic","partition":0,"replicas":[100,101],"log_dirs":["any","any"]}]}
Save this to use as the --reassignment-json-file option during rollback
Warning: You must run Verify periodically, until the reassignment completes, to
ensure the throttle is removed. You can also alter the throttle by rerunning
the Execute command passing a new value.
The inter-broker throttle limit was set to 10000000 B/s
Successfully started reassignment of partitions.
[2019-12-11 01:24:33,908] INFO [Controller id=100] Successfully updated
assignment of partition my-topic-0 to ReplicaAssignment(replicas=101,102,100,
addingReplicas=102, removingReplicas=100) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:33,909] INFO [Controller id=100] Updated leader epoch for
partition my-topic-0 to 1 (kafka.controller.KafkaController:66)
[2019-12-11 01:24:36,396] INFO [Controller id=100] Processing automatic
preferred replica leader election (kafka.controller.KafkaController:66)
[2019-12-11 01:24:36,397] INFO [Controller id=100] Starting replica leader
election (PREFERRED) for partitions triggered by AutoTriggered
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:39,110] INFO [Controller id=100] Target replicas
ArrayBuffer(101, 102) have all caught up with the leader for reassigning
partition my-topic-0 (kafka.controller.KafkaController:66)
[2019-12-11 01:24:39,111] INFO [Controller id=100] Leader 100 for partition
my-topic-0 being reassigned, is not in the new list of replicas 101,102.
Re-electing leader (kafka.controller.KafkaController:66)
[2019-12-11 01:24:39,116] INFO [Controller id=100] Successfully updated
assignment of partition my-topic-0 to ReplicaAssignment(replicas=101,102,
addingReplicas=, removingReplicas=) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:39,118] INFO [Controller id=100] Removing partitions
Map(my-topic-0 -> Buffer(101, 102)) from the list of reassigned partitions in
zookeeper (kafka.controller.KafkaController:66)
[2019-12-11 01:24:39,118] INFO [Controller id=100] No more partitions need to
be reassigned. Deleting zk path /admin/reassign_partitions
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:39,988] INFO [ControllerEventThread controllerId=100]
Shutting down (kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:24:39,988] INFO [ControllerEventThread controllerId=100]
Shutdown completed
(kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:24:39,988] INFO [ControllerEventThread controllerId=100] Stopped
(kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:24:39,991] INFO [Controller id=100] Resigned
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:39,993] INFO [Controller id=101] 101 successfully elected as
the controller. Epoch incremented to 2 and epoch zk version is now 2
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:39,993] INFO [Controller id=101] Registering handlers
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:39,994] INFO [Controller id=101] Deleting log dir event
notifications (kafka.controller.KafkaController:66)
[2019-12-11 01:24:39,995] INFO [Controller id=101] Deleting isr change
notifications (kafka.controller.KafkaController:66)
[2019-12-11 01:24:39,995] INFO [Controller id=101] Initializing controller
context (kafka.controller.KafkaController:66)
[2019-12-11 01:24:39,996] INFO [Controller id=101] Initialized broker epochs
cache: Map(101 -> 44, 102 -> 60) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:40,000] INFO [Controller id=101] Currently active brokers in
the cluster: Set(101, 102) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:40,000] INFO [Controller id=101] Currently shutting brokers
in the cluster: Set() (kafka.controller.KafkaController:66)
[2019-12-11 01:24:40,000] INFO [Controller id=101] Current list of topics in
the cluster: Set(my-topic) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:40,000] INFO [Controller id=101] Fetching topic deletions in
progress (kafka.controller.KafkaController:66)
[2019-12-11 01:24:40,001] INFO [Controller id=101] List of topics to be
deleted: (kafka.controller.KafkaController:66)
[2019-12-11 01:24:40,001] INFO [Controller id=101] List of topics ineligible
for deletion: (kafka.controller.KafkaController:66)
[2019-12-11 01:24:40,001] INFO [Controller id=101] Initializing topic deletion
manager (kafka.controller.KafkaController:66)
[2019-12-11 01:24:40,001] INFO [Controller id=101] Sending update metadata
request (kafka.controller.KafkaController:66)
[2019-12-11 01:24:40,001] INFO [Controller id=101] Ready to serve as the new
controller with epoch 2 (kafka.controller.KafkaController:66)
[2019-12-11 01:24:40,002] INFO [Controller id=101] Partitions undergoing
preferred replica election: (kafka.controller.KafkaController:66)
[2019-12-11 01:24:40,002] INFO [Controller id=101] Partitions that completed
preferred replica election: (kafka.controller.KafkaController:66)
[2019-12-11 01:24:40,002] INFO [Controller id=101] Skipping preferred replica
election for partitions due to topic deletion:
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:40,002] INFO [Controller id=101] Resuming preferred replica
election for partitions: (kafka.controller.KafkaController:66)
[2019-12-11 01:24:40,002] INFO [Controller id=101] Starting replica leader
election (PREFERRED) for partitions triggered by ZkTriggered
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:40,003] INFO [Controller id=101] Starting the controller
scheduler (kafka.controller.KafkaController:66)
[2019-12-11 01:24:41,689] INFO [ControllerEventThread controllerId=101]
Shutting down (kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:24:41,689] INFO [ControllerEventThread controllerId=101] Stopped
(kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:24:41,689] INFO [ControllerEventThread controllerId=101]
Shutdown completed
(kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:24:41,691] INFO [Controller id=101] Resigned
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:41,693] INFO [Controller id=102] 102 successfully elected as
the controller. Epoch incremented to 3 and epoch zk version is now 3
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:41,693] INFO [Controller id=102] Registering handlers
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:41,694] INFO [Controller id=102] Deleting log dir event
notifications (kafka.controller.KafkaController:66)
[2019-12-11 01:24:41,695] INFO [Controller id=102] Deleting isr change
notifications (kafka.controller.KafkaController:66)
[2019-12-11 01:24:41,695] INFO [Controller id=102] Initializing controller
context (kafka.controller.KafkaController:66)
[2019-12-11 01:24:41,696] INFO [Controller id=102] Initialized broker epochs
cache: Map(102 -> 60) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:41,700] INFO [Controller id=102] Currently active brokers in
the cluster: Set(102) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:41,700] INFO [Controller id=102] Currently shutting brokers
in the cluster: Set() (kafka.controller.KafkaController:66)
[2019-12-11 01:24:41,701] INFO [Controller id=102] Current list of topics in
the cluster: Set(my-topic) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:41,701] INFO [Controller id=102] Fetching topic deletions in
progress (kafka.controller.KafkaController:66)
[2019-12-11 01:24:41,701] INFO [Controller id=102] List of topics to be
deleted: (kafka.controller.KafkaController:66)
[2019-12-11 01:24:41,702] INFO [Controller id=102] List of topics ineligible
for deletion: my-topic (kafka.controller.KafkaController:66)
[2019-12-11 01:24:41,702] INFO [Controller id=102] Initializing topic deletion
manager (kafka.controller.KafkaController:66)
[2019-12-11 01:24:41,702] INFO [Controller id=102] Sending update metadata
request (kafka.controller.KafkaController:66)
[2019-12-11 01:24:41,705] INFO [Controller id=102] Ready to serve as the new
controller with epoch 3 (kafka.controller.KafkaController:66)
[2019-12-11 01:24:41,706] INFO [Controller id=102] Partitions undergoing
preferred replica election: (kafka.controller.KafkaController:66)
[2019-12-11 01:24:41,706] INFO [Controller id=102] Partitions that completed
preferred replica election: (kafka.controller.KafkaController:66)
[2019-12-11 01:24:41,706] INFO [Controller id=102] Skipping preferred replica
election for partitions due to topic deletion:
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:41,706] INFO [Controller id=102] Resuming preferred replica
election for partitions: (kafka.controller.KafkaController:66)
[2019-12-11 01:24:41,706] INFO [Controller id=102] Starting replica leader
election (PREFERRED) for partitions triggered by ZkTriggered
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:41,706] INFO [Controller id=102] Starting the controller
scheduler (kafka.controller.KafkaController:66)
[2019-12-11 01:24:41,804] INFO [ControllerEventThread controllerId=102]
Shutting down (kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:24:41,805] INFO [ControllerEventThread controllerId=102] Stopped
(kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:24:41,805] INFO [ControllerEventThread controllerId=102]
Shutdown completed
(kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:24:41,806] INFO [Controller id=102] Resigned
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:43,099] INFO [ControllerEventThread controllerId=100]
Starting (kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:24:43,103] INFO [Controller id=100] 100 successfully elected as
the controller. Epoch incremented to 1 and epoch zk version is now 1
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:43,103] INFO [Controller id=100] Registering handlers
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:43,104] INFO [Controller id=100] Deleting log dir event
notifications (kafka.controller.KafkaController:66)
[2019-12-11 01:24:43,104] INFO [Controller id=100] Deleting isr change
notifications (kafka.controller.KafkaController:66)
[2019-12-11 01:24:43,104] INFO [Controller id=100] Initializing controller
context (kafka.controller.KafkaController:66)
[2019-12-11 01:24:43,106] INFO [Controller id=100] Initialized broker epochs
cache: Map(100 -> 25) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:43,110] INFO [Controller id=100] Currently active brokers in
the cluster: Set(100) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:43,110] INFO [Controller id=100] Currently shutting brokers
in the cluster: Set() (kafka.controller.KafkaController:66)
[2019-12-11 01:24:43,110] INFO [Controller id=100] Current list of topics in
the cluster: Set() (kafka.controller.KafkaController:66)
[2019-12-11 01:24:43,110] INFO [Controller id=100] Fetching topic deletions in
progress (kafka.controller.KafkaController:66)
[2019-12-11 01:24:43,111] INFO [Controller id=100] List of topics to be
deleted: (kafka.controller.KafkaController:66)
[2019-12-11 01:24:43,111] INFO [Controller id=100] List of topics ineligible
for deletion: (kafka.controller.KafkaController:66)
[2019-12-11 01:24:43,111] INFO [Controller id=100] Initializing topic deletion
manager (kafka.controller.KafkaController:66)
[2019-12-11 01:24:43,111] INFO [Controller id=100] Sending update metadata
request (kafka.controller.KafkaController:66)
[2019-12-11 01:24:43,112] INFO [Controller id=100] Ready to serve as the new
controller with epoch 1 (kafka.controller.KafkaController:66)
[2019-12-11 01:24:43,112] INFO [Controller id=100] Partitions undergoing
preferred replica election: (kafka.controller.KafkaController:66)
[2019-12-11 01:24:43,112] INFO [Controller id=100] Partitions that completed
preferred replica election: (kafka.controller.KafkaController:66)
[2019-12-11 01:24:43,113] INFO [Controller id=100] Skipping preferred replica
election for partitions due to topic deletion:
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:43,113] INFO [Controller id=100] Resuming preferred replica
election for partitions: (kafka.controller.KafkaController:66)
[2019-12-11 01:24:43,113] INFO [Controller id=100] Starting replica leader
election (PREFERRED) for partitions triggered by ZkTriggered
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:43,113] INFO [Controller id=100] Starting the controller
scheduler (kafka.controller.KafkaController:66)
[2019-12-11 01:24:43,156] INFO [Controller id=100] Newly added brokers: 101,
deleted brokers: , bounced brokers: , all live brokers: 100,101
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:43,157] INFO [Controller id=100] New broker startup callback
for 101 (kafka.controller.KafkaController:66)
[2019-12-11 01:24:43,158] INFO [Controller id=100] Updated broker epochs cache:
Map(100 -> 25, 101 -> 44) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:43,408] INFO [ControllerEventThread controllerId=101]
Starting (kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:24:43,425] INFO [Controller id=100] New topics: [Set(my-topic)],
deleted topics: [Set()], new partition replica assignment [Map(my-topic-0 ->
ReplicaAssignment(replicas=100, addingReplicas=, removingReplicas=))]
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:43,425] INFO [Controller id=100] New partition creation
callback for my-topic-0 (kafka.controller.KafkaController:66)
[2019-12-11 01:24:44,187] INFO [Controller id=100] Successfully updated
assignment of partition my-topic-0 to ReplicaAssignment(replicas=100,101,
addingReplicas=101, removingReplicas=) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:44,189] INFO [Controller id=100] Updated leader epoch for
partition my-topic-0 to 1 (kafka.controller.KafkaController:66)
[2019-12-11 01:24:44,297] INFO [Controller id=100] New topics:
[Set(__consumer_offsets)], deleted topics: [Set()], new partition replica
assignment [Map(__consumer_offsets-4 -> ReplicaAssignment(replicas=101,
addingReplicas=, removingReplicas=), __consumer_offsets-3 ->
ReplicaAssignment(replicas=100, addingReplicas=, removingReplicas=),
__consumer_offsets-2 -> ReplicaAssignment(replicas=101, addingReplicas=,
removingReplicas=), __consumer_offsets-0 -> ReplicaAssignment(replicas=101,
addingReplicas=, removingReplicas=), __consumer_offsets-1 ->
ReplicaAssignment(replicas=100, addingReplicas=, removingReplicas=))]
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:44,297] INFO [Controller id=100] New partition creation
callback for
__consumer_offsets-4,__consumer_offsets-3,__consumer_offsets-2,__consumer_offsets-0,__consumer_offsets-1
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:45,299] INFO [Controller id=100] Target replicas
ArrayBuffer(100, 101) have all caught up with the leader for reassigning
partition my-topic-0 (kafka.controller.KafkaController:66)
[2019-12-11 01:24:45,300] INFO [Controller id=100] Leader 100 for partition
my-topic-0 being reassigned, is already in the new list of replicas 100,101 and
is alive (kafka.controller.KafkaController:66)
[2019-12-11 01:24:45,302] INFO [Controller id=100] Updated leader epoch for
partition my-topic-0 to 2 (kafka.controller.KafkaController:66)
[2019-12-11 01:24:45,303] INFO [Controller id=100] Successfully updated
assignment of partition my-topic-0 to ReplicaAssignment(replicas=100,101,
addingReplicas=, removingReplicas=) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:47,918] INFO [ControllerEventThread controllerId=100]
Shutting down (kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:24:47,920] INFO [ControllerEventThread controllerId=100]
Shutdown completed
(kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:24:47,920] INFO [ControllerEventThread controllerId=100] Stopped
(kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:24:47,922] INFO [Controller id=100] Resigned
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:47,927] INFO [Controller id=101] 101 successfully elected as
the controller. Epoch incremented to 2 and epoch zk version is now 2
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:47,927] INFO [Controller id=101] Registering handlers
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:47,928] INFO [Controller id=101] Deleting log dir event
notifications (kafka.controller.KafkaController:66)
[2019-12-11 01:24:47,928] INFO [Controller id=101] Deleting isr change
notifications (kafka.controller.KafkaController:66)
[2019-12-11 01:24:47,929] INFO [Controller id=101] Initializing controller
context (kafka.controller.KafkaController:66)
[2019-12-11 01:24:47,930] INFO [Controller id=101] Initialized broker epochs
cache: Map(101 -> 44) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:47,934] INFO [Controller id=101] Currently active brokers in
the cluster: Set(101) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:47,934] INFO [Controller id=101] Currently shutting brokers
in the cluster: Set() (kafka.controller.KafkaController:66)
[2019-12-11 01:24:47,934] INFO [Controller id=101] Current list of topics in
the cluster: Set(my-topic, __consumer_offsets)
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:47,934] INFO [Controller id=101] Fetching topic deletions in
progress (kafka.controller.KafkaController:66)
[2019-12-11 01:24:47,935] INFO [Controller id=101] List of topics to be
deleted: (kafka.controller.KafkaController:66)
[2019-12-11 01:24:47,935] INFO [Controller id=101] List of topics ineligible
for deletion: my-topic,__consumer_offsets (kafka.controller.KafkaController:66)
[2019-12-11 01:24:47,935] INFO [Controller id=101] Initializing topic deletion
manager (kafka.controller.KafkaController:66)
[2019-12-11 01:24:47,935] INFO [Controller id=101] Sending update metadata
request (kafka.controller.KafkaController:66)
[2019-12-11 01:24:47,940] INFO [Controller id=101] Ready to serve as the new
controller with epoch 2 (kafka.controller.KafkaController:66)
[2019-12-11 01:24:47,942] INFO [Controller id=101] Partitions undergoing
preferred replica election: (kafka.controller.KafkaController:66)
[2019-12-11 01:24:47,942] INFO [Controller id=101] Partitions that completed
preferred replica election: (kafka.controller.KafkaController:66)
[2019-12-11 01:24:47,942] INFO [Controller id=101] Skipping preferred replica
election for partitions due to topic deletion:
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:47,942] INFO [Controller id=101] Resuming preferred replica
election for partitions: (kafka.controller.KafkaController:66)
[2019-12-11 01:24:47,942] INFO [Controller id=101] Starting replica leader
election (PREFERRED) for partitions triggered by ZkTriggered
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:47,943] INFO [Controller id=101] Starting the controller
scheduler (kafka.controller.KafkaController:66)
[2019-12-11 01:24:48,409] INFO [ControllerEventThread controllerId=101]
Shutting down (kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:24:48,410] INFO [ControllerEventThread controllerId=101]
Shutdown completed
(kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:24:48,410] INFO [ControllerEventThread controllerId=101] Stopped
(kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:24:48,411] INFO [Controller id=101] Resigned
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:51,226] INFO [ControllerEventThread controllerId=100]
Starting (kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:24:51,230] INFO [Controller id=100] 100 successfully elected as
the controller. Epoch incremented to 1 and epoch zk version is now 1
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:51,230] INFO [Controller id=100] Registering handlers
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:51,231] INFO [Controller id=100] Deleting log dir event
notifications (kafka.controller.KafkaController:66)
[2019-12-11 01:24:51,231] INFO [Controller id=100] Deleting isr change
notifications (kafka.controller.KafkaController:66)
[2019-12-11 01:24:51,232] INFO [Controller id=100] Initializing controller
context (kafka.controller.KafkaController:66)
[2019-12-11 01:24:51,234] INFO [Controller id=100] Initialized broker epochs
cache: Map(100 -> 25) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:51,237] INFO [Controller id=100] Currently active brokers in
the cluster: Set(100) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:51,237] INFO [Controller id=100] Currently shutting brokers
in the cluster: Set() (kafka.controller.KafkaController:66)
[2019-12-11 01:24:51,237] INFO [Controller id=100] Current list of topics in
the cluster: Set() (kafka.controller.KafkaController:66)
[2019-12-11 01:24:51,237] INFO [Controller id=100] Fetching topic deletions in
progress (kafka.controller.KafkaController:66)
[2019-12-11 01:24:51,238] INFO [Controller id=100] List of topics to be
deleted: (kafka.controller.KafkaController:66)
[2019-12-11 01:24:51,238] INFO [Controller id=100] List of topics ineligible
for deletion: (kafka.controller.KafkaController:66)
[2019-12-11 01:24:51,238] INFO [Controller id=100] Initializing topic deletion
manager (kafka.controller.KafkaController:66)
[2019-12-11 01:24:51,238] INFO [Controller id=100] Sending update metadata
request (kafka.controller.KafkaController:66)
[2019-12-11 01:24:51,238] INFO [Controller id=100] Ready to serve as the new
controller with epoch 1 (kafka.controller.KafkaController:66)
[2019-12-11 01:24:51,239] INFO [Controller id=100] Partitions undergoing
preferred replica election: (kafka.controller.KafkaController:66)
[2019-12-11 01:24:51,239] INFO [Controller id=100] Partitions that completed
preferred replica election: (kafka.controller.KafkaController:66)
[2019-12-11 01:24:51,239] INFO [Controller id=100] Skipping preferred replica
election for partitions due to topic deletion:
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:51,239] INFO [Controller id=100] Resuming preferred replica
election for partitions: (kafka.controller.KafkaController:66)
[2019-12-11 01:24:51,239] INFO [Controller id=100] Starting replica leader
election (PREFERRED) for partitions triggered by ZkTriggered
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:51,240] INFO [Controller id=100] Starting the controller
scheduler (kafka.controller.KafkaController:66)
[2019-12-11 01:24:51,275] INFO [Controller id=100] Newly added brokers: 101,
deleted brokers: , bounced brokers: , all live brokers: 100,101
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:51,277] INFO [Controller id=100] New broker startup callback
for 101 (kafka.controller.KafkaController:66)
[2019-12-11 01:24:51,278] INFO [Controller id=100] Updated broker epochs cache:
Map(100 -> 25, 101 -> 44) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:51,448] INFO [ControllerEventThread controllerId=101]
Starting (kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:24:51,506] INFO [Controller id=100] Newly added brokers: 102,
deleted brokers: , bounced brokers: , all live brokers: 100,101,102
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:51,508] INFO [Controller id=100] New broker startup callback
for 102 (kafka.controller.KafkaController:66)
[2019-12-11 01:24:51,509] INFO [Controller id=100] Updated broker epochs cache:
Map(100 -> 25, 101 -> 44, 102 -> 60) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:51,669] INFO [ControllerEventThread controllerId=102]
Starting (kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:24:51,684] INFO [Controller id=100] New topics: [Set(my-topic)],
deleted topics: [Set()], new partition replica assignment [Map(my-topic-1 ->
ReplicaAssignment(replicas=100,101, addingReplicas=, removingReplicas=),
my-topic-0 -> ReplicaAssignment(replicas=100,101, addingReplicas=,
removingReplicas=))] (kafka.controller.KafkaController:66)
[2019-12-11 01:24:51,684] INFO [Controller id=100] New partition creation
callback for my-topic-1,my-topic-0 (kafka.controller.KafkaController:66)
[2019-12-11 01:24:51,698] ERROR [ReplicaFetcher replicaId=101, leaderId=100,
fetcherId=0] Error for partition my-topic-1 at offset 0
(kafka.server.ReplicaFetcherThread:76)
org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server
does not host this topic-partition.
[2019-12-11 01:24:51,698] ERROR [ReplicaFetcher replicaId=101, leaderId=100,
fetcherId=0] Error for partition my-topic-0 at offset 0
(kafka.server.ReplicaFetcherThread:76)
org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server
does not host this topic-partition.
[2019-12-11 01:24:51,801] ERROR [ReplicaFetcher replicaId=101, leaderId=100,
fetcherId=0] Error for partition my-topic-0 at offset 0
(kafka.server.ReplicaFetcherThread:76)
org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server
does not host this topic-partition.
[2019-12-11 01:24:51,801] ERROR [ReplicaFetcher replicaId=101, leaderId=100,
fetcherId=0] Error for partition my-topic-1 at offset 0
(kafka.server.ReplicaFetcherThread:76)
org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server
does not host this topic-partition.
[2019-12-11 01:24:52,281] INFO [Controller id=100] Successfully updated
assignment of partition my-topic-1 to ReplicaAssignment(replicas=100,101,102,
addingReplicas=102, removingReplicas=) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:52,282] INFO [Controller id=100] Updated leader epoch for
partition my-topic-1 to 1 (kafka.controller.KafkaController:66)
[2019-12-11 01:24:52,285] INFO [Controller id=100] Successfully updated
assignment of partition my-topic-0 to ReplicaAssignment(replicas=100,101,102,
addingReplicas=102, removingReplicas=) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:52,286] INFO [Controller id=100] Updated leader epoch for
partition my-topic-0 to 1 (kafka.controller.KafkaController:66)
[2019-12-11 01:24:52,291] INFO [Controller id=100] Successfully updated
assignment of partition my-topic-1 to ReplicaAssignment(replicas=102,101,100,
addingReplicas=102, removingReplicas=) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:52,293] INFO [Controller id=100] Updated leader epoch for
partition my-topic-1 to 2 (kafka.controller.KafkaController:66)
[2019-12-11 01:24:52,293] INFO [Controller id=100] Successfully updated
assignment of partition my-topic-0 to ReplicaAssignment(replicas=102,101,100,
addingReplicas=102, removingReplicas=) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:52,295] INFO [Controller id=100] Updated leader epoch for
partition my-topic-0 to 2 (kafka.controller.KafkaController:66)
[2019-12-11 01:24:52,621] INFO [Controller id=100] Target replicas
ArrayBuffer(102, 101, 100) have all caught up with the leader for reassigning
partition my-topic-1 (kafka.controller.KafkaController:66)
[2019-12-11 01:24:52,622] INFO [Controller id=100] Leader 100 for partition
my-topic-1 being reassigned, is already in the new list of replicas 102,101,100
and is alive (kafka.controller.KafkaController:66)
[2019-12-11 01:24:52,623] INFO [Controller id=100] Updated leader epoch for
partition my-topic-1 to 3 (kafka.controller.KafkaController:66)
[2019-12-11 01:24:52,624] INFO [Controller id=100] Successfully updated
assignment of partition my-topic-1 to ReplicaAssignment(replicas=102,101,100,
addingReplicas=, removingReplicas=) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:52,625] INFO [Controller id=100] Target replicas
ArrayBuffer(102, 101, 100) have all caught up with the leader for reassigning
partition my-topic-0 (kafka.controller.KafkaController:66)
[2019-12-11 01:24:52,626] INFO [Controller id=100] Leader 100 for partition
my-topic-0 being reassigned, is already in the new list of replicas 102,101,100
and is alive (kafka.controller.KafkaController:66)
[2019-12-11 01:24:52,626] INFO [Controller id=100] Updated leader epoch for
partition my-topic-0 to 3 (kafka.controller.KafkaController:66)
[2019-12-11 01:24:52,627] INFO [Controller id=100] Successfully updated
assignment of partition my-topic-0 to ReplicaAssignment(replicas=102,101,100,
addingReplicas=, removingReplicas=) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:54,624] INFO [ControllerEventThread controllerId=100]
Shutting down (kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:24:54,624] INFO [ControllerEventThread controllerId=100] Stopped
(kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:24:54,624] INFO [ControllerEventThread controllerId=100]
Shutdown completed
(kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:24:54,626] INFO [Controller id=100] Resigned
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:54,630] INFO [Controller id=102] 102 successfully elected as
the controller. Epoch incremented to 2 and epoch zk version is now 2
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:54,630] INFO [Controller id=102] Registering handlers
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:54,631] INFO [Controller id=102] Deleting log dir event
notifications (kafka.controller.KafkaController:66)
[2019-12-11 01:24:54,632] INFO [Controller id=102] Deleting isr change
notifications (kafka.controller.KafkaController:66)
[2019-12-11 01:24:54,632] INFO [Controller id=102] Initializing controller
context (kafka.controller.KafkaController:66)
[2019-12-11 01:24:54,634] INFO [Controller id=102] Initialized broker epochs
cache: Map(101 -> 44, 102 -> 60) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:54,638] INFO [Controller id=102] Currently active brokers in
the cluster: Set(101, 102) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:54,638] INFO [Controller id=102] Currently shutting brokers
in the cluster: Set() (kafka.controller.KafkaController:66)
[2019-12-11 01:24:54,638] INFO [Controller id=102] Current list of topics in
the cluster: Set(my-topic) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:54,638] INFO [Controller id=102] Fetching topic deletions in
progress (kafka.controller.KafkaController:66)
[2019-12-11 01:24:54,639] INFO [Controller id=102] List of topics to be
deleted: (kafka.controller.KafkaController:66)
[2019-12-11 01:24:54,639] INFO [Controller id=102] List of topics ineligible
for deletion: my-topic (kafka.controller.KafkaController:66)
[2019-12-11 01:24:54,639] INFO [Controller id=102] Initializing topic deletion
manager (kafka.controller.KafkaController:66)
[2019-12-11 01:24:54,639] INFO [Controller id=102] Sending update metadata
request (kafka.controller.KafkaController:66)
[2019-12-11 01:24:54,642] INFO [Controller id=102] Ready to serve as the new
controller with epoch 2 (kafka.controller.KafkaController:66)
[2019-12-11 01:24:54,643] INFO [Controller id=102] Partitions undergoing
preferred replica election: (kafka.controller.KafkaController:66)
[2019-12-11 01:24:54,643] INFO [Controller id=102] Partitions that completed
preferred replica election: (kafka.controller.KafkaController:66)
[2019-12-11 01:24:54,643] INFO [Controller id=102] Skipping preferred replica
election for partitions due to topic deletion:
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:54,643] INFO [Controller id=102] Resuming preferred replica
election for partitions: (kafka.controller.KafkaController:66)
[2019-12-11 01:24:54,643] INFO [Controller id=102] Starting replica leader
election (PREFERRED) for partitions triggered by ZkTriggered
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:54,644] INFO [Controller id=102] Starting the controller
scheduler (kafka.controller.KafkaController:66)
[2019-12-11 01:24:54,656] INFO [ControllerEventThread controllerId=101]
Shutting down (kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:24:54,656] INFO [ControllerEventThread controllerId=101] Stopped
(kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:24:54,656] INFO [ControllerEventThread controllerId=101]
Shutdown completed
(kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:24:54,664] INFO [Controller id=101] Resigned
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:54,665] INFO [Controller id=102] Newly added brokers: ,
deleted brokers: 101, bounced brokers: , all live brokers: 102
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:54,666] INFO [Controller id=102] Broker failure callback for
101 (kafka.controller.KafkaController:66)
[2019-12-11 01:24:54,667] INFO [Controller id=102] Updated broker epochs cache:
Map(102 -> 60) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:54,748] INFO [ControllerEventThread controllerId=102]
Shutting down (kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:24:54,748] INFO [ControllerEventThread controllerId=102] Stopped
(kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:24:54,748] INFO [ControllerEventThread controllerId=102]
Shutdown completed
(kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:24:54,749] INFO [Controller id=102] Resigned
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:55,782] INFO [ControllerEventThread controllerId=100]
Starting (kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:24:55,784] INFO [Controller id=100] 100 successfully elected as
the controller. Epoch incremented to 1 and epoch zk version is now 1
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:55,784] INFO [Controller id=100] Registering handlers
(kafka.controller.KafkaController:66)
[2019-12-11 01:24:55,785] INFO [Controller id=100] Deleting log dir event
notifications (kafka.controller.KafkaController:66)
[2019-12-11 01:24:55,786] INFO [Controller id=100] Deleting isr change
notifications (kafka.controller.KafkaController:66)
[2019-12-11 01:24:55,786] INFO [Controller id=100] Initializing controller
context (kafka.controller.KafkaController:66)
[2019-12-11 01:24:55,787] INFO [Controller id=100] Initialized broker epochs
cache: Map(100 -> 25) (kafka.controller.KafkaController:66)
[2019-12-11 01:24:55,790] INFO [Controller id=100] Currently active brokers in
the cluster: Set(100) (kafka.controller.KafkaController:66)
[
...[truncated 307672 chars]...
opic deletion: (kafka.controller.KafkaController:66)
[2019-12-11 01:26:52,148] INFO [Controller id=100] Resuming preferred replica
election for partitions: (kafka.controller.KafkaController:66)
[2019-12-11 01:26:52,148] INFO [Controller id=100] Starting replica leader
election (PREFERRED) for partitions triggered by ZkTriggered
(kafka.controller.KafkaController:66)
[2019-12-11 01:26:52,149] INFO [Controller id=100] Starting the controller
scheduler (kafka.controller.KafkaController:66)
[2019-12-11 01:26:52,181] INFO [Controller id=100] Newly added brokers: 101,
deleted brokers: , bounced brokers: , all live brokers: 100,101
(kafka.controller.KafkaController:66)
[2019-12-11 01:26:52,182] INFO [Controller id=100] New broker startup callback
for 101 (kafka.controller.KafkaController:66)
[2019-12-11 01:26:52,183] INFO [Controller id=100] Updated broker epochs cache:
Map(100 -> 25, 101 -> 44) (kafka.controller.KafkaController:66)
[2019-12-11 01:26:52,281] INFO [ControllerEventThread controllerId=101]
Starting (kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:26:52,292] INFO [Controller id=100] New topics: [Set(my-topic)],
deleted topics: [Set()], new partition replica assignment [Map(my-topic-1 ->
ReplicaAssignment(replicas=100, addingReplicas=, removingReplicas=), my-topic-0
-> ReplicaAssignment(replicas=100, addingReplicas=, removingReplicas=))]
(kafka.controller.KafkaController:66)
[2019-12-11 01:26:52,292] INFO [Controller id=100] New partition creation
callback for my-topic-1,my-topic-0 (kafka.controller.KafkaController:66)
[2019-12-11 01:26:52,596] INFO [Controller id=100] New topics: [Set(anyTopic)],
deleted topics: [Set()], new partition replica assignment [Map(anyTopic-1 ->
ReplicaAssignment(replicas=100, addingReplicas=, removingReplicas=), anyTopic-0
-> ReplicaAssignment(replicas=100, addingReplicas=, removingReplicas=))]
(kafka.controller.KafkaController:66)
[2019-12-11 01:26:52,596] INFO [Controller id=100] New partition creation
callback for anyTopic-1,anyTopic-0 (kafka.controller.KafkaController:66)
[2019-12-11 01:26:53,037] INFO [Controller id=100] Successfully updated
assignment of partition my-topic-1 to ReplicaAssignment(replicas=101,100,
addingReplicas=101, removingReplicas=100) (kafka.controller.KafkaController:66)
[2019-12-11 01:26:53,039] INFO [Controller id=100] Updated leader epoch for
partition my-topic-1 to 1 (kafka.controller.KafkaController:66)
[2019-12-11 01:26:53,042] INFO [Controller id=100] Successfully updated
assignment of partition my-topic-0 to ReplicaAssignment(replicas=101,100,
addingReplicas=101, removingReplicas=100) (kafka.controller.KafkaController:66)
[2019-12-11 01:26:53,043] INFO [Controller id=100] Updated leader epoch for
partition my-topic-0 to 1 (kafka.controller.KafkaController:66)
[2019-12-11 01:26:53,106] INFO [Controller id=100] New partitions to be added
Map(anyTopic-2 -> Vector(100), anyTopic-3 -> Vector(101))
(kafka.controller.KafkaController:66)
[2019-12-11 01:26:53,107] INFO [Controller id=100] New partition creation
callback for anyTopic-2,anyTopic-3 (kafka.controller.KafkaController:66)
[2019-12-11 01:26:53,450] INFO [Controller id=100] Target replicas
ArrayBuffer(101) have all caught up with the leader for reassigning partition
my-topic-1 (kafka.controller.KafkaController:66)
[2019-12-11 01:26:53,451] INFO [Controller id=100] Leader 100 for partition
my-topic-1 being reassigned, is not in the new list of replicas 101.
Re-electing leader (kafka.controller.KafkaController:66)
[2019-12-11 01:26:53,453] INFO [Controller id=100] Successfully updated
assignment of partition my-topic-1 to ReplicaAssignment(replicas=101,
addingReplicas=, removingReplicas=) (kafka.controller.KafkaController:66)
[2019-12-11 01:26:53,455] INFO [Controller id=100] Target replicas
ArrayBuffer(101) have all caught up with the leader for reassigning partition
my-topic-0 (kafka.controller.KafkaController:66)
[2019-12-11 01:26:53,455] INFO [Controller id=100] Leader 100 for partition
my-topic-0 being reassigned, is not in the new list of replicas 101.
Re-electing leader (kafka.controller.KafkaController:66)
[2019-12-11 01:26:53,458] INFO [Controller id=100] Successfully updated
assignment of partition my-topic-0 to ReplicaAssignment(replicas=101,
addingReplicas=, removingReplicas=) (kafka.controller.KafkaController:66)
[2019-12-11 01:26:53,521] INFO [Controller id=100] New partitions to be added
Map(my-topic-2 -> Vector(101), my-topic-3 -> Vector(100))
(kafka.controller.KafkaController:66)
[2019-12-11 01:26:53,521] INFO [Controller id=100] New partition creation
callback for my-topic-2,my-topic-3 (kafka.controller.KafkaController:66)
[2019-12-11 01:26:55,847] INFO [ControllerEventThread controllerId=100]
Shutting down (kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:26:55,847] INFO [ControllerEventThread controllerId=100] Stopped
(kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:26:55,847] INFO [ControllerEventThread controllerId=100]
Shutdown completed
(kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:26:55,849] INFO [Controller id=100] Resigned
(kafka.controller.KafkaController:66)
[2019-12-11 01:26:55,852] INFO [Controller id=101] 101 successfully elected as
the controller. Epoch incremented to 2 and epoch zk version is now 2
(kafka.controller.KafkaController:66)
[2019-12-11 01:26:55,852] INFO [Controller id=101] Registering handlers
(kafka.controller.KafkaController:66)
[2019-12-11 01:26:55,852] INFO [Controller id=101] Deleting log dir event
notifications (kafka.controller.KafkaController:66)
[2019-12-11 01:26:55,853] INFO [Controller id=101] Deleting isr change
notifications (kafka.controller.KafkaController:66)
[2019-12-11 01:26:55,853] INFO [Controller id=101] Initializing controller
context (kafka.controller.KafkaController:66)
[2019-12-11 01:26:55,854] INFO [Controller id=101] Initialized broker epochs
cache: Map(101 -> 44) (kafka.controller.KafkaController:66)
[2019-12-11 01:26:55,857] INFO [Controller id=101] Currently active brokers in
the cluster: Set(101) (kafka.controller.KafkaController:66)
[2019-12-11 01:26:55,857] INFO [Controller id=101] Currently shutting brokers
in the cluster: Set() (kafka.controller.KafkaController:66)
[2019-12-11 01:26:55,858] INFO [Controller id=101] Current list of topics in
the cluster: Set(my-topic, anyTopic) (kafka.controller.KafkaController:66)
[2019-12-11 01:26:55,858] INFO [Controller id=101] Fetching topic deletions in
progress (kafka.controller.KafkaController:66)
[2019-12-11 01:26:55,859] INFO [Controller id=101] List of topics to be
deleted: (kafka.controller.KafkaController:66)
[2019-12-11 01:26:55,859] INFO [Controller id=101] List of topics ineligible
for deletion: my-topic,anyTopic (kafka.controller.KafkaController:66)
[2019-12-11 01:26:55,859] INFO [Controller id=101] Initializing topic deletion
manager (kafka.controller.KafkaController:66)
[2019-12-11 01:26:55,859] INFO [Controller id=101] Sending update metadata
request (kafka.controller.KafkaController:66)
[2019-12-11 01:26:55,863] INFO [Controller id=101] Ready to serve as the new
controller with epoch 2 (kafka.controller.KafkaController:66)
[2019-12-11 01:26:55,864] INFO [Controller id=101] Partitions undergoing
preferred replica election: (kafka.controller.KafkaController:66)
[2019-12-11 01:26:55,864] INFO [Controller id=101] Partitions that completed
preferred replica election: (kafka.controller.KafkaController:66)
[2019-12-11 01:26:55,864] INFO [Controller id=101] Skipping preferred replica
election for partitions due to topic deletion:
(kafka.controller.KafkaController:66)
[2019-12-11 01:26:55,865] INFO [Controller id=101] Resuming preferred replica
election for partitions: (kafka.controller.KafkaController:66)
[2019-12-11 01:26:55,865] INFO [Controller id=101] Starting replica leader
election (PREFERRED) for partitions triggered by ZkTriggered
(kafka.controller.KafkaController:66)
[2019-12-11 01:26:55,865] INFO [Controller id=101] Starting the controller
scheduler (kafka.controller.KafkaController:66)
[2019-12-11 01:26:55,880] INFO [ControllerEventThread controllerId=101]
Shutting down (kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:26:55,880] INFO [ControllerEventThread controllerId=101]
Shutdown completed
(kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:26:55,880] INFO [ControllerEventThread controllerId=101] Stopped
(kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:26:55,881] INFO [Controller id=101] Resigned
(kafka.controller.KafkaController:66)
[2019-12-11 01:26:57,346] INFO [ControllerEventThread controllerId=100]
Starting (kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:26:57,349] INFO [Controller id=100] 100 successfully elected as
the controller. Epoch incremented to 1 and epoch zk version is now 1
(kafka.controller.KafkaController:66)
[2019-12-11 01:26:57,349] INFO [Controller id=100] Registering handlers
(kafka.controller.KafkaController:66)
[2019-12-11 01:26:57,350] INFO [Controller id=100] Deleting log dir event
notifications (kafka.controller.KafkaController:66)
[2019-12-11 01:26:57,351] INFO [Controller id=100] Deleting isr change
notifications (kafka.controller.KafkaController:66)
[2019-12-11 01:26:57,352] INFO [Controller id=100] Initializing controller
context (kafka.controller.KafkaController:66)
[2019-12-11 01:26:57,353] INFO [Controller id=100] Initialized broker epochs
cache: Map(100 -> 25) (kafka.controller.KafkaController:66)
[2019-12-11 01:26:57,355] INFO [Controller id=100] Currently active brokers in
the cluster: Set(100) (kafka.controller.KafkaController:66)
[2019-12-11 01:26:57,355] INFO [Controller id=100] Currently shutting brokers
in the cluster: Set() (kafka.controller.KafkaController:66)
[2019-12-11 01:26:57,355] INFO [Controller id=100] Current list of topics in
the cluster: Set() (kafka.controller.KafkaController:66)
[2019-12-11 01:26:57,355] INFO [Controller id=100] Fetching topic deletions in
progress (kafka.controller.KafkaController:66)
[2019-12-11 01:26:57,355] INFO [Controller id=100] List of topics to be
deleted: (kafka.controller.KafkaController:66)
[2019-12-11 01:26:57,356] INFO [Controller id=100] List of topics ineligible
for deletion: (kafka.controller.KafkaController:66)
[2019-12-11 01:26:57,356] INFO [Controller id=100] Initializing topic deletion
manager (kafka.controller.KafkaController:66)
[2019-12-11 01:26:57,356] INFO [Controller id=100] Sending update metadata
request (kafka.controller.KafkaController:66)
[2019-12-11 01:26:57,356] INFO [Controller id=100] Ready to serve as the new
controller with epoch 1 (kafka.controller.KafkaController:66)
[2019-12-11 01:26:57,357] INFO [Controller id=100] Partitions undergoing
preferred replica election: (kafka.controller.KafkaController:66)
[2019-12-11 01:26:57,357] INFO [Controller id=100] Partitions that completed
preferred replica election: (kafka.controller.KafkaController:66)
[2019-12-11 01:26:57,357] INFO [Controller id=100] Skipping preferred replica
election for partitions due to topic deletion:
(kafka.controller.KafkaController:66)
[2019-12-11 01:26:57,357] INFO [Controller id=100] Resuming preferred replica
election for partitions: (kafka.controller.KafkaController:66)
[2019-12-11 01:26:57,357] INFO [Controller id=100] Starting replica leader
election (PREFERRED) for partitions triggered by ZkTriggered
(kafka.controller.KafkaController:66)
[2019-12-11 01:26:57,358] INFO [Controller id=100] Starting the controller
scheduler (kafka.controller.KafkaController:66)
[2019-12-11 01:26:57,392] INFO [Controller id=100] Newly added brokers: 101,
deleted brokers: , bounced brokers: , all live brokers: 100,101
(kafka.controller.KafkaController:66)
[2019-12-11 01:26:57,393] INFO [Controller id=100] New broker startup callback
for 101 (kafka.controller.KafkaController:66)
[2019-12-11 01:26:57,394] INFO [Controller id=100] Updated broker epochs cache:
Map(100 -> 25, 101 -> 44) (kafka.controller.KafkaController:66)
[2019-12-11 01:26:57,539] INFO [ControllerEventThread controllerId=101]
Starting (kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:26:57,584] INFO [Controller id=100] Newly added brokers: 102,
deleted brokers: , bounced brokers: , all live brokers: 100,101,102
(kafka.controller.KafkaController:66)
[2019-12-11 01:26:57,585] INFO [Controller id=100] New broker startup callback
for 102 (kafka.controller.KafkaController:66)
[2019-12-11 01:26:57,586] INFO [Controller id=100] Updated broker epochs cache:
Map(100 -> 25, 101 -> 44, 102 -> 60) (kafka.controller.KafkaController:66)
[2019-12-11 01:26:57,801] INFO [ControllerEventThread controllerId=102]
Starting (kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:26:57,814] INFO [Controller id=100] New topics: [Set(my-topic)],
deleted topics: [Set()], new partition replica assignment [Map(my-topic-2 ->
ReplicaAssignment(replicas=100, addingReplicas=, removingReplicas=), my-topic-1
-> ReplicaAssignment(replicas=100, addingReplicas=, removingReplicas=),
my-topic-0 -> ReplicaAssignment(replicas=100, addingReplicas=,
removingReplicas=), my-topic-3 -> ReplicaAssignment(replicas=100,
addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController:66)
[2019-12-11 01:26:57,814] INFO [Controller id=100] New partition creation
callback for my-topic-2,my-topic-1,my-topic-0,my-topic-3
(kafka.controller.KafkaController:66)
[2019-12-11 01:26:58,747] INFO [Controller id=100] Successfully updated
assignment of partition my-topic-1 to ReplicaAssignment(replicas=101,100,
addingReplicas=101, removingReplicas=100) (kafka.controller.KafkaController:66)
[2019-12-11 01:26:58,749] INFO [Controller id=100] Updated leader epoch for
partition my-topic-1 to 1 (kafka.controller.KafkaController:66)
[2019-12-11 01:26:58,750] INFO [Controller id=100] Successfully updated
assignment of partition my-topic-0 to ReplicaAssignment(replicas=101,100,
addingReplicas=101, removingReplicas=100) (kafka.controller.KafkaController:66)
[2019-12-11 01:26:58,751] INFO [Controller id=100] Updated leader epoch for
partition my-topic-0 to 1 (kafka.controller.KafkaController:66)
[2019-12-11 01:26:58,774] INFO [Controller id=100] Successfully updated
assignment of partition my-topic-2 to ReplicaAssignment(replicas=101,100,
addingReplicas=101, removingReplicas=100) (kafka.controller.KafkaController:66)
[2019-12-11 01:26:58,775] INFO [Controller id=100] Updated leader epoch for
partition my-topic-2 to 1 (kafka.controller.KafkaController:66)
[2019-12-11 01:26:58,776] INFO [Controller id=100] Successfully updated
assignment of partition my-topic-1 to ReplicaAssignment(replicas=102,100,
addingReplicas=102, removingReplicas=100) (kafka.controller.KafkaController:66)
[2019-12-11 01:26:58,778] INFO [Controller id=100] Updated leader epoch for
partition my-topic-1 to 2 (kafka.controller.KafkaController:66)
[2019-12-11 01:26:58,779] INFO [Controller id=100] Successfully updated
assignment of partition my-topic-0 to ReplicaAssignment(replicas=100,
addingReplicas=, removingReplicas=) (kafka.controller.KafkaController:66)
[2019-12-11 01:26:58,780] INFO [Controller id=100] Leader 100 for partition
my-topic-0 being reassigned, is already in the new list of replicas 100 and is
alive (kafka.controller.KafkaController:66)
[2019-12-11 01:26:58,781] INFO [Controller id=100] Updated leader epoch for
partition my-topic-0 to 2 (kafka.controller.KafkaController:66)
[2019-12-11 01:26:58,782] INFO [Controller id=100] Successfully updated
assignment of partition my-topic-0 to ReplicaAssignment(replicas=100,
addingReplicas=, removingReplicas=) (kafka.controller.KafkaController:66)
[2019-12-11 01:26:59,084] INFO [Controller id=100] Target replicas
ArrayBuffer(101) have all caught up with the leader for reassigning partition
my-topic-2 (kafka.controller.KafkaController:66)
[2019-12-11 01:26:59,085] INFO [Controller id=100] Leader 100 for partition
my-topic-2 being reassigned, is not in the new list of replicas 101.
Re-electing leader (kafka.controller.KafkaController:66)
[2019-12-11 01:26:59,088] INFO [Controller id=100] Successfully updated
assignment of partition my-topic-2 to ReplicaAssignment(replicas=101,
addingReplicas=, removingReplicas=) (kafka.controller.KafkaController:66)
[2019-12-11 01:26:59,441] INFO [Controller id=100] Target replicas
ArrayBuffer(102) have all caught up with the leader for reassigning partition
my-topic-1 (kafka.controller.KafkaController:66)
[2019-12-11 01:26:59,442] INFO [Controller id=100] Leader 100 for partition
my-topic-1 being reassigned, is not in the new list of replicas 102.
Re-electing leader (kafka.controller.KafkaController:66)
[2019-12-11 01:26:59,446] INFO [Controller id=100] Successfully updated
assignment of partition my-topic-1 to ReplicaAssignment(replicas=102,
addingReplicas=, removingReplicas=) (kafka.controller.KafkaController:66)
[2019-12-11 01:27:01,332] INFO [ControllerEventThread controllerId=101]
Shutting down (kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:27:01,332] INFO [ControllerEventThread controllerId=101]
Shutdown completed
(kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:27:01,333] INFO [Controller id=101] Resigned
(kafka.controller.KafkaController:66)
[2019-12-11 01:27:01,333] INFO [ControllerEventThread controllerId=101] Stopped
(kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:27:01,334] INFO [Controller id=100] Newly added brokers: ,
deleted brokers: 101, bounced brokers: , all live brokers: 100,102
(kafka.controller.KafkaController:66)
[2019-12-11 01:27:01,335] INFO [Controller id=100] Broker failure callback for
101 (kafka.controller.KafkaController:66)
[2019-12-11 01:27:01,339] INFO [Controller id=100] Updated broker epochs cache:
Map(100 -> 25, 102 -> 60) (kafka.controller.KafkaController:66)
[2019-12-11 01:27:01,543] INFO [ControllerEventThread controllerId=100]
Shutting down (kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:27:01,543] INFO [ControllerEventThread controllerId=100] Stopped
(kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:27:01,543] INFO [ControllerEventThread controllerId=100]
Shutdown completed
(kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:27:01,545] INFO [Controller id=100] Resigned
(kafka.controller.KafkaController:66)
[2019-12-11 01:27:01,549] INFO [Controller id=102] 102 successfully elected as
the controller. Epoch incremented to 2 and epoch zk version is now 2
(kafka.controller.KafkaController:66)
[2019-12-11 01:27:01,549] INFO [Controller id=102] Registering handlers
(kafka.controller.KafkaController:66)
[2019-12-11 01:27:01,550] INFO [Controller id=102] Deleting log dir event
notifications (kafka.controller.KafkaController:66)
[2019-12-11 01:27:01,550] INFO [Controller id=102] Deleting isr change
notifications (kafka.controller.KafkaController:66)
[2019-12-11 01:27:01,551] INFO [Controller id=102] Initializing controller
context (kafka.controller.KafkaController:66)
[2019-12-11 01:27:01,552] INFO [Controller id=102] Initialized broker epochs
cache: Map(102 -> 60) (kafka.controller.KafkaController:66)
[2019-12-11 01:27:01,555] INFO [Controller id=102] Currently active brokers in
the cluster: Set(102) (kafka.controller.KafkaController:66)
[2019-12-11 01:27:01,555] INFO [Controller id=102] Currently shutting brokers
in the cluster: Set() (kafka.controller.KafkaController:66)
[2019-12-11 01:27:01,555] INFO [Controller id=102] Current list of topics in
the cluster: Set(my-topic) (kafka.controller.KafkaController:66)
[2019-12-11 01:27:01,555] INFO [Controller id=102] Fetching topic deletions in
progress (kafka.controller.KafkaController:66)
[2019-12-11 01:27:01,556] INFO [Controller id=102] List of topics to be
deleted: (kafka.controller.KafkaController:66)
[2019-12-11 01:27:01,556] INFO [Controller id=102] List of topics ineligible
for deletion: my-topic (kafka.controller.KafkaController:66)
[2019-12-11 01:27:01,556] INFO [Controller id=102] Initializing topic deletion
manager (kafka.controller.KafkaController:66)
[2019-12-11 01:27:01,556] INFO [Controller id=102] Sending update metadata
request (kafka.controller.KafkaController:66)
[2019-12-11 01:27:01,560] INFO [ControllerEventThread controllerId=102]
Shutting down (kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:27:01,560] INFO [Controller id=102] Ready to serve as the new
controller with epoch 2 (kafka.controller.KafkaController:66)
[2019-12-11 01:27:01,561] INFO [Controller id=102] Partitions undergoing
preferred replica election: (kafka.controller.KafkaController:66)
[2019-12-11 01:27:01,561] INFO [Controller id=102] Partitions that completed
preferred replica election: (kafka.controller.KafkaController:66)
[2019-12-11 01:27:01,561] INFO [Controller id=102] Skipping preferred replica
election for partitions due to topic deletion:
(kafka.controller.KafkaController:66)
[2019-12-11 01:27:01,561] INFO [Controller id=102] Resuming preferred replica
election for partitions: (kafka.controller.KafkaController:66)
[2019-12-11 01:27:01,561] INFO [Controller id=102] Starting replica leader
election (PREFERRED) for partitions triggered by ZkTriggered
(kafka.controller.KafkaController:66)
[2019-12-11 01:27:01,562] INFO [Controller id=102] Starting the controller
scheduler (kafka.controller.KafkaController:66)
[2019-12-11 01:27:01,562] INFO [ControllerEventThread controllerId=102] Stopped
(kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:27:01,562] INFO [ControllerEventThread controllerId=102]
Shutdown completed
(kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:27:01,563] INFO [Controller id=102] Resigned
(kafka.controller.KafkaController:66)
[2019-12-11 01:27:03,974] INFO [ControllerEventThread controllerId=100]
Starting (kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:27:03,977] INFO [Controller id=100] 100 successfully elected as
the controller. Epoch incremented to 1 and epoch zk version is now 1
(kafka.controller.KafkaController:66)
[2019-12-11 01:27:03,977] INFO [Controller id=100] Registering handlers
(kafka.controller.KafkaController:66)
[2019-12-11 01:27:03,977] INFO [Controller id=100] Deleting log dir event
notifications (kafka.controller.KafkaController:66)
[2019-12-11 01:27:03,978] INFO [Controller id=100] Deleting isr change
notifications (kafka.controller.KafkaController:66)
[2019-12-11 01:27:03,979] INFO [Controller id=100] Initializing controller
context (kafka.controller.KafkaController:66)
[2019-12-11 01:27:03,980] INFO [Controller id=100] Initialized broker epochs
cache: Map(100 -> 25) (kafka.controller.KafkaController:66)
[2019-12-11 01:27:03,982] INFO [Controller id=100] Currently active brokers in
the cluster: Set(100) (kafka.controller.KafkaController:66)
[2019-12-11 01:27:03,982] INFO [Controller id=100] Currently shutting brokers
in the cluster: Set() (kafka.controller.KafkaController:66)
[2019-12-11 01:27:03,982] INFO [Controller id=100] Current list of topics in
the cluster: Set() (kafka.controller.KafkaController:66)
[2019-12-11 01:27:03,982] INFO [Controller id=100] Fetching topic deletions in
progress (kafka.controller.KafkaController:66)
[2019-12-11 01:27:03,982] INFO [Controller id=100] List of topics to be
deleted: (kafka.controller.KafkaController:66)
[2019-12-11 01:27:03,982] INFO [Controller id=100] List of topics ineligible
for deletion: (kafka.controller.KafkaController:66)
[2019-12-11 01:27:03,982] INFO [Controller id=100] Initializing topic deletion
manager (kafka.controller.KafkaController:66)
[2019-12-11 01:27:03,983] INFO [Controller id=100] Sending update metadata
request (kafka.controller.KafkaController:66)
[2019-12-11 01:27:03,983] INFO [Controller id=100] Ready to serve as the new
controller with epoch 1 (kafka.controller.KafkaController:66)
[2019-12-11 01:27:03,984] INFO [Controller id=100] Partitions undergoing
preferred replica election: (kafka.controller.KafkaController:66)
[2019-12-11 01:27:03,984] INFO [Controller id=100] Partitions that completed
preferred replica election: (kafka.controller.KafkaController:66)
[2019-12-11 01:27:03,984] INFO [Controller id=100] Skipping preferred replica
election for partitions due to topic deletion:
(kafka.controller.KafkaController:66)
[2019-12-11 01:27:03,984] INFO [Controller id=100] Resuming preferred replica
election for partitions: (kafka.controller.KafkaController:66)
[2019-12-11 01:27:03,984] INFO [Controller id=100] Starting replica leader
election (PREFERRED) for partitions triggered by ZkTriggered
(kafka.controller.KafkaController:66)
[2019-12-11 01:27:03,985] INFO [Controller id=100] Starting the controller
scheduler (kafka.controller.KafkaController:66)
[2019-12-11 01:27:04,011] INFO [Controller id=100] Newly added brokers: 101,
deleted brokers: , bounced brokers: , all live brokers: 100,101
(kafka.controller.KafkaController:66)
[2019-12-11 01:27:04,012] INFO [Controller id=100] New broker startup callback
for 101 (kafka.controller.KafkaController:66)
[2019-12-11 01:27:04,013] INFO [Controller id=100] Updated broker epochs cache:
Map(100 -> 25, 101 -> 44) (kafka.controller.KafkaController:66)
[2019-12-11 01:27:04,214] INFO [ControllerEventThread controllerId=101]
Starting (kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:27:04,250] INFO [Controller id=100] Newly added brokers: 102,
deleted brokers: , bounced brokers: , all live brokers: 100,101,102
(kafka.controller.KafkaController:66)
[2019-12-11 01:27:04,251] INFO [Controller id=100] New broker startup callback
for 102 (kafka.controller.KafkaController:66)
[2019-12-11 01:27:04,252] INFO [Controller id=100] Updated broker epochs cache:
Map(100 -> 25, 101 -> 44, 102 -> 60) (kafka.controller.KafkaController:66)
[2019-12-11 01:27:04,439] INFO [ControllerEventThread controllerId=102]
Starting (kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:27:04,452] INFO [Controller id=100] New topics: [Set(my-topic)],
deleted topics: [Set()], new partition replica assignment [Map(my-topic-0 ->
ReplicaAssignment(replicas=100,101, addingReplicas=, removingReplicas=))]
(kafka.controller.KafkaController:66)
[2019-12-11 01:27:04,452] INFO [Controller id=100] New partition creation
callback for my-topic-0 (kafka.controller.KafkaController:66)
[2019-12-11 01:27:04,460] ERROR [ReplicaFetcher replicaId=101, leaderId=100,
fetcherId=0] Error for partition my-topic-0 at offset 0
(kafka.server.ReplicaFetcherThread:76)
org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server
does not host this topic-partition.
Current partition replica assignment
{"version":1,"partitions":[{"topic":"my-topic","partition":0,"replicas":[100,101],"log_dirs":["any","any"]}]}
Save this to use as the --reassignment-json-file option during rollback
Warning: You must run Verify periodically, until the reassignment completes, to
ensure the throttle is removed. You can also alter the throttle by rerunning
the Execute command passing a new value.
The inter-broker throttle limit was set to 1000000 B/s
Successfully started reassignment of partitions.
Status of partition reassignment:
[2019-12-11 01:27:04,785] INFO [Controller id=100] Successfully updated
assignment of partition my-topic-0 to ReplicaAssignment(replicas=101,102,100,
addingReplicas=102, removingReplicas=100) (kafka.controller.KafkaController:66)
[2019-12-11 01:27:04,786] INFO [Controller id=100] Updated leader epoch for
partition my-topic-0 to 1 (kafka.controller.KafkaController:66)
Reassignment of partition my-topic-0 is still in progress
There is an existing assignment running.
[2019-12-11 01:27:05,061] INFO [Controller id=100] Target replicas
ArrayBuffer(101, 102) have all caught up with the leader for reassigning
partition my-topic-0 (kafka.controller.KafkaController:66)
[2019-12-11 01:27:05,062] INFO [Controller id=100] Leader 100 for partition
my-topic-0 being reassigned, is not in the new list of replicas 101,102.
Re-electing leader (kafka.controller.KafkaController:66)
[2019-12-11 01:27:05,065] INFO [Controller id=100] Successfully updated
assignment of partition my-topic-0 to ReplicaAssignment(replicas=101,102,
addingReplicas=, removingReplicas=) (kafka.controller.KafkaController:66)
[2019-12-11 01:27:05,067] INFO [Controller id=100] Removing partitions
Map(my-topic-0 -> Buffer(101, 102)) from the list of reassigned partitions in
zookeeper (kafka.controller.KafkaController:66)
[2019-12-11 01:27:05,067] INFO [Controller id=100] No more partitions need to
be reassigned. Deleting zk path /admin/reassign_partitions
(kafka.controller.KafkaController:66)
Status of partition reassignment:
Reassignment of partition my-topic-0 completed successfully
Throttle was removed.
[2019-12-11 01:27:06,323] INFO [ControllerEventThread controllerId=100]
Shutting down (kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:27:06,324] INFO [ControllerEventThread controllerId=100]
Shutdown completed
(kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:27:06,324] INFO [ControllerEventThread controllerId=100] Stopped
(kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:27:06,327] INFO [Controller id=100] Resigned
(kafka.controller.KafkaController:66)
[2019-12-11 01:27:06,331] INFO [Controller id=102] 102 successfully elected as
the controller. Epoch incremented to 2 and epoch zk version is now 2
(kafka.controller.KafkaController:66)
[2019-12-11 01:27:06,331] INFO [Controller id=102] Registering handlers
(kafka.controller.KafkaController:66)
[2019-12-11 01:27:06,332] INFO [Controller id=102] Deleting log dir event
notifications (kafka.controller.KafkaController:66)
[2019-12-11 01:27:06,333] INFO [Controller id=102] Deleting isr change
notifications (kafka.controller.KafkaController:66)
[2019-12-11 01:27:06,333] INFO [Controller id=102] Initializing controller
context (kafka.controller.KafkaController:66)
[2019-12-11 01:27:06,335] INFO [Controller id=102] Initialized broker epochs
cache: Map(101 -> 44, 102 -> 60) (kafka.controller.KafkaController:66)
[2019-12-11 01:27:06,340] INFO [Controller id=102] Currently active brokers in
the cluster: Set(101, 102) (kafka.controller.KafkaController:66)
[2019-12-11 01:27:06,340] INFO [Controller id=102] Currently shutting brokers
in the cluster: Set() (kafka.controller.KafkaController:66)
[2019-12-11 01:27:06,340] INFO [Controller id=102] Current list of topics in
the cluster: Set(my-topic) (kafka.controller.KafkaController:66)
[2019-12-11 01:27:06,340] INFO [Controller id=102] Fetching topic deletions in
progress (kafka.controller.KafkaController:66)
[2019-12-11 01:27:06,341] INFO [Controller id=102] List of topics to be
deleted: (kafka.controller.KafkaController:66)
[2019-12-11 01:27:06,341] INFO [Controller id=102] List of topics ineligible
for deletion: (kafka.controller.KafkaController:66)
[2019-12-11 01:27:06,342] INFO [Controller id=102] Initializing topic deletion
manager (kafka.controller.KafkaController:66)
[2019-12-11 01:27:06,342] INFO [Controller id=102] Sending update metadata
request (kafka.controller.KafkaController:66)
[2019-12-11 01:27:06,342] INFO [Controller id=102] Ready to serve as the new
controller with epoch 2 (kafka.controller.KafkaController:66)
[2019-12-11 01:27:06,344] INFO [Controller id=102] Partitions undergoing
preferred replica election: (kafka.controller.KafkaController:66)
[2019-12-11 01:27:06,344] INFO [Controller id=102] Partitions that completed
preferred replica election: (kafka.controller.KafkaController:66)
[2019-12-11 01:27:06,344] INFO [Controller id=102] Skipping preferred replica
election for partitions due to topic deletion:
(kafka.controller.KafkaController:66)
[2019-12-11 01:27:06,344] INFO [Controller id=102] Resuming preferred replica
election for partitions: (kafka.controller.KafkaController:66)
[2019-12-11 01:27:06,344] INFO [Controller id=102] Starting replica leader
election (PREFERRED) for partitions triggered by ZkTriggered
(kafka.controller.KafkaController:66)
[2019-12-11 01:27:06,345] INFO [Controller id=102] Starting the controller
scheduler (kafka.controller.KafkaController:66)
[2019-12-11 01:27:06,729] INFO [ControllerEventThread controllerId=102]
Shutting down (kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:27:06,730] INFO [ControllerEventThread controllerId=102] Stopped
(kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:27:06,730] INFO [ControllerEventThread controllerId=102]
Shutdown completed
(kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:27:06,731] INFO [Controller id=102] Resigned
(kafka.controller.KafkaController:66)
[2019-12-11 01:27:06,835] INFO [Controller id=101] 101 successfully elected as
the controller. Epoch incremented to 3 and epoch zk version is now 3
(kafka.controller.KafkaController:66)
[2019-12-11 01:27:06,835] INFO [Controller id=101] Registering handlers
(kafka.controller.KafkaController:66)
[2019-12-11 01:27:06,837] INFO [Controller id=101] Deleting log dir event
notifications (kafka.controller.KafkaController:66)
[2019-12-11 01:27:06,837] INFO [Controller id=101] Deleting isr change
notifications (kafka.controller.KafkaController:66)
[2019-12-11 01:27:06,838] INFO [Controller id=101] Initializing controller
context (kafka.controller.KafkaController:66)
[2019-12-11 01:27:06,839] INFO [Controller id=101] Initialized broker epochs
cache: Map(101 -> 44) (kafka.controller.KafkaController:66)
[2019-12-11 01:27:06,842] INFO [Controller id=101] Currently active brokers in
the cluster: Set(101) (kafka.controller.KafkaController:66)
[2019-12-11 01:27:06,842] INFO [Controller id=101] Currently shutting brokers
in the cluster: Set() (kafka.controller.KafkaController:66)
[2019-12-11 01:27:06,843] INFO [Controller id=101] Current list of topics in
the cluster: Set(my-topic) (kafka.controller.KafkaController:66)
[2019-12-11 01:27:06,843] INFO [Controller id=101] Fetching topic deletions in
progress (kafka.controller.KafkaController:66)
[2019-12-11 01:27:06,843] INFO [Controller id=101] List of topics to be
deleted: (kafka.controller.KafkaController:66)
[2019-12-11 01:27:06,843] INFO [Controller id=101] List of topics ineligible
for deletion: my-topic (kafka.controller.KafkaController:66)
[2019-12-11 01:27:06,844] INFO [Controller id=101] Initializing topic deletion
manager (kafka.controller.KafkaController:66)
[2019-12-11 01:27:06,844] INFO [Controller id=101] Sending update metadata
request (kafka.controller.KafkaController:66)
[2019-12-11 01:27:06,846] INFO [Controller id=101] Ready to serve as the new
controller with epoch 3 (kafka.controller.KafkaController:66)
[2019-12-11 01:27:06,847] INFO [Controller id=101] Partitions undergoing
preferred replica election: (kafka.controller.KafkaController:66)
[2019-12-11 01:27:06,847] INFO [Controller id=101] Partitions that completed
preferred replica election: (kafka.controller.KafkaController:66)
[2019-12-11 01:27:06,847] INFO [Controller id=101] Skipping preferred replica
election for partitions due to topic deletion:
(kafka.controller.KafkaController:66)
[2019-12-11 01:27:06,847] INFO [Controller id=101] Resuming preferred replica
election for partitions: (kafka.controller.KafkaController:66)
[2019-12-11 01:27:06,847] INFO [Controller id=101] Starting replica leader
election (PREFERRED) for partitions triggered by ZkTriggered
(kafka.controller.KafkaController:66)
[2019-12-11 01:27:06,848] INFO [Controller id=101] Starting the controller
scheduler (kafka.controller.KafkaController:66)
[2019-12-11 01:27:07,453] INFO [ControllerEventThread controllerId=101]
Shutting down (kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:27:07,453] INFO [ControllerEventThread controllerId=101] Stopped
(kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:27:07,453] INFO [ControllerEventThread controllerId=101]
Shutdown completed
(kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:27:07,454] INFO [Controller id=101] Resigned
(kafka.controller.KafkaController:66)
[2019-12-11 01:27:08,362] INFO [ControllerEventThread controllerId=100]
Starting (kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:27:08,365] INFO [Controller id=100] 100 successfully elected as
the controller. Epoch incremented to 1 and epoch zk version is now 1
(kafka.controller.KafkaController:66)
[2019-12-11 01:27:08,365] INFO [Controller id=100] Registering handlers
(kafka.controller.KafkaController:66)
[2019-12-11 01:27:08,366] INFO [Controller id=100] Deleting log dir event
notifications (kafka.controller.KafkaController:66)
[2019-12-11 01:27:08,367] INFO [Controller id=100] Deleting isr change
notifications (kafka.controller.KafkaController:66)
[2019-12-11 01:27:08,367] INFO [Controller id=100] Initializing controller
context (kafka.controller.KafkaController:66)
[2019-12-11 01:27:08,369] INFO [Controller id=100] Initialized broker epochs
cache: Map(100 -> 25) (kafka.controller.KafkaController:66)
[2019-12-11 01:27:08,372] INFO [Controller id=100] Currently active brokers in
the cluster: Set(100) (kafka.controller.KafkaController:66)
[2019-12-11 01:27:08,372] INFO [Controller id=100] Currently shutting brokers
in the cluster: Set() (kafka.controller.KafkaController:66)
[2019-12-11 01:27:08,373] INFO [Controller id=100] Current list of topics in
the cluster: Set() (kafka.controller.KafkaController:66)
[2019-12-11 01:27:08,373] INFO [Controller id=100] Fetching topic deletions in
progress (kafka.controller.KafkaController:66)
[2019-12-11 01:27:08,373] INFO [Controller id=100] List of topics to be
deleted: (kafka.controller.KafkaController:66)
[2019-12-11 01:27:08,374] INFO [Controller id=100] List of topics ineligible
for deletion: (kafka.controller.KafkaController:66)
[2019-12-11 01:27:08,374] INFO [Controller id=100] Initializing topic deletion
manager (kafka.controller.KafkaController:66)
[2019-12-11 01:27:08,374] INFO [Controller id=100] Sending update metadata
request (kafka.controller.KafkaController:66)
[2019-12-11 01:27:08,374] INFO [Controller id=100] Ready to serve as the new
controller with epoch 1 (kafka.controller.KafkaController:66)
[2019-12-11 01:27:08,375] INFO [Controller id=100] Partitions undergoing
preferred replica election: (kafka.controller.KafkaController:66)
[2019-12-11 01:27:08,375] INFO [Controller id=100] Partitions that completed
preferred replica election: (kafka.controller.KafkaController:66)
[2019-12-11 01:27:08,375] INFO [Controller id=100] Skipping preferred replica
election for partitions due to topic deletion:
(kafka.controller.KafkaController:66)
[2019-12-11 01:27:08,375] INFO [Controller id=100] Resuming preferred replica
election for partitions: (kafka.controller.KafkaController:66)
[2019-12-11 01:27:08,375] INFO [Controller id=100] Starting replica leader
election (PREFERRED) for partitions triggered by ZkTriggered
(kafka.controller.KafkaController:66)
[2019-12-11 01:27:08,376] INFO [Controller id=100] Starting the controller
scheduler (kafka.controller.KafkaController:66)
[2019-12-11 01:27:08,407] INFO [Controller id=100] Newly added brokers: 101,
deleted brokers: , bounced brokers: , all live brokers: 100,101
(kafka.controller.KafkaController:66)
[2019-12-11 01:27:08,408] INFO [Controller id=100] New broker startup callback
for 101 (kafka.controller.KafkaController:66)
[2019-12-11 01:27:08,408] INFO [Controller id=100] Updated broker epochs cache:
Map(100 -> 25, 101 -> 44) (kafka.controller.KafkaController:66)
[2019-12-11 01:27:08,589] INFO [ControllerEventThread controllerId=101]
Starting (kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:27:08,639] INFO [Controller id=100] Newly added brokers: 102,
deleted brokers: , bounced brokers: , all live brokers: 100,101,102
(kafka.controller.KafkaController:66)
[2019-12-11 01:27:08,640] INFO [Controller id=100] New broker startup callback
for 102 (kafka.controller.KafkaController:66)
[2019-12-11 01:27:08,641] INFO [Controller id=100] Updated broker epochs cache:
Map(100 -> 25, 101 -> 44, 102 -> 60) (kafka.controller.KafkaController:66)
[2019-12-11 01:27:08,766] INFO [ControllerEventThread controllerId=102]
Starting (kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:27:08,781] INFO [Controller id=100] New topics: [Set(topic1)],
deleted topics: [Set()], new partition replica assignment [Map(topic1-2 ->
ReplicaAssignment(replicas=102,100, addingReplicas=, removingReplicas=),
topic1-1 -> ReplicaAssignment(replicas=101,102, addingReplicas=,
removingReplicas=), topic1-0 -> ReplicaAssignment(replicas=100,101,
addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController:66)
[2019-12-11 01:27:08,781] INFO [Controller id=100] New partition creation
callback for topic1-2,topic1-1,topic1-0 (kafka.controller.KafkaController:66)
[2019-12-11 01:27:08,847] ERROR [ReplicaFetcher replicaId=100, leaderId=102,
fetcherId=0] Error for partition topic1-2 at offset 0
(kafka.server.ReplicaFetcherThread:76)
org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server
does not host this topic-partition.
[2019-12-11 01:27:08,848] ERROR [ReplicaFetcher replicaId=102, leaderId=101,
fetcherId=0] Error for partition topic1-1 at offset 0
(kafka.server.ReplicaFetcherThread:76)
org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server
does not host this topic-partition.
[2019-12-11 01:27:09,187] INFO [Controller id=100] New topics: [Set(topic2)],
deleted topics: [Set()], new partition replica assignment [Map(topic2-2 ->
ReplicaAssignment(replicas=102,100, addingReplicas=, removingReplicas=),
topic2-1 -> ReplicaAssignment(replicas=101,102, addingReplicas=,
removingReplicas=), topic2-0 -> ReplicaAssignment(replicas=100,101,
addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController:66)
[2019-12-11 01:27:09,187] INFO [Controller id=100] New partition creation
callback for topic2-2,topic2-1,topic2-0 (kafka.controller.KafkaController:66)
Current partition replica assignment
{"version":1,"partitions":[{"topic":"topic1","partition":2,"replicas":[102,100],"log_dirs":["any","any"]},{"topic":"topic2","partition":0,"replicas":[100,101],"log_dirs":["any","any"]},{"topic":"topic2","partition":1,"replicas":[101,102],"log_dirs":["any","any"]},{"topic":"topic1","partition":0,"replicas":[100,101],"log_dirs":["any","any"]},{"topic":"topic1","partition":1,"replicas":[101,102],"log_dirs":["any","any"]},{"topic":"topic2","partition":2,"replicas":[102,100],"log_dirs":["any","any"]}]}
Save this to use as the --reassignment-json-file option during rollback
[2019-12-11 01:27:09,598] INFO [Controller id=100] Successfully updated
assignment of partition topic1-0 to ReplicaAssignment(replicas=100,102,101,
addingReplicas=102, removingReplicas=101) (kafka.controller.KafkaController:66)
[2019-12-11 01:27:09,600] INFO [Controller id=100] Updated leader epoch for
partition topic1-0 to 1 (kafka.controller.KafkaController:66)
[2019-12-11 01:27:09,601] INFO [Controller id=100] Successfully updated
assignment of partition topic2-2 to ReplicaAssignment(replicas=100,102,
addingReplicas=, removingReplicas=) (kafka.controller.KafkaController:66)
[2019-12-11 01:27:09,601] INFO [Controller id=100] Leader 102 for partition
topic2-2 being reassigned, is already in the new list of replicas 100,102 and
is alive (kafka.controller.KafkaController:66)
[2019-12-11 01:27:09,602] INFO [Controller id=100] Updated leader epoch for
partition topic2-2 to 1 (kafka.controller.KafkaController:66)
[2019-12-11 01:27:09,602] INFO [Controller id=100] Successfully updated
assignment of partition topic2-2 to ReplicaAssignment(replicas=100,102,
addingReplicas=, removingReplicas=) (kafka.controller.KafkaController:66)
[2019-12-11 01:27:09,603] INFO [Controller id=100] Removing partitions
Map(topic2-2 -> Buffer(100, 102)) from the list of reassigned partitions in
zookeeper (kafka.controller.KafkaController:66)
[2019-12-11 01:27:09,604] INFO [Controller id=100] Successfully updated
assignment of partition topic1-2 to ReplicaAssignment(replicas=100,102,
addingReplicas=, removingReplicas=) (kafka.controller.KafkaController:66)
[2019-12-11 01:27:09,604] INFO [Controller id=100] Leader 102 for partition
topic1-2 being reassigned, is already in the new list of replicas 100,102 and
is alive (kafka.controller.KafkaController:66)
[2019-12-11 01:27:09,605] INFO [Controller id=100] Updated leader epoch for
partition topic1-2 to 1 (kafka.controller.KafkaController:66)
[2019-12-11 01:27:09,605] INFO [Controller id=100] Successfully updated
assignment of partition topic1-2 to ReplicaAssignment(replicas=100,102,
addingReplicas=, removingReplicas=) (kafka.controller.KafkaController:66)
[2019-12-11 01:27:09,606] INFO [Controller id=100] Removing partitions
Map(topic1-2 -> Buffer(100, 102)) from the list of reassigned partitions in
zookeeper (kafka.controller.KafkaController:66)
[2019-12-11 01:27:09,607] INFO [Controller id=100] Successfully updated
assignment of partition topic2-1 to ReplicaAssignment(replicas=101,100,102,
addingReplicas=100, removingReplicas=102) (kafka.controller.KafkaController:66)
[2019-12-11 01:27:09,608] INFO [Controller id=100] Updated leader epoch for
partition topic2-1 to 1 (kafka.controller.KafkaController:66)
[2019-12-11 01:27:09,694] INFO [Controller id=100] Target replicas
ArrayBuffer(100, 102) have all caught up with the leader for reassigning
partition topic1-0 (kafka.controller.KafkaController:66)
[2019-12-11 01:27:09,695] INFO [Controller id=100] Leader 100 for partition
topic1-0 being reassigned, is already in the new list of replicas 100,102 and
is alive (kafka.controller.KafkaController:66)
[2019-12-11 01:27:09,696] INFO [Controller id=100] Updated leader epoch for
partition topic1-0 to 2 (kafka.controller.KafkaController:66)
[2019-12-11 01:27:09,698] INFO [Controller id=100] Successfully updated
assignment of partition topic1-0 to ReplicaAssignment(replicas=100,102,
addingReplicas=, removingReplicas=) (kafka.controller.KafkaController:66)
[2019-12-11 01:27:09,699] INFO [Controller id=100] Removing partitions
Map(topic1-0 -> Buffer(100, 102)) from the list of reassigned partitions in
zookeeper (kafka.controller.KafkaController:66)
[2019-12-11 01:27:09,706] INFO [Controller id=100] Target replicas
ArrayBuffer(101, 100) have all caught up with the leader for reassigning
partition topic2-1 (kafka.controller.KafkaController:66)
[2019-12-11 01:27:09,707] INFO [Controller id=100] Leader 101 for partition
topic2-1 being reassigned, is already in the new list of replicas 101,100 and
is alive (kafka.controller.KafkaController:66)
[2019-12-11 01:27:09,707] INFO [Controller id=100] Updated leader epoch for
partition topic2-1 to 2 (kafka.controller.KafkaController:66)
[2019-12-11 01:27:09,709] INFO [Controller id=100] Successfully updated
assignment of partition topic2-1 to ReplicaAssignment(replicas=101,100,
addingReplicas=, removingReplicas=) (kafka.controller.KafkaController:66)
[2019-12-11 01:27:09,710] INFO [Controller id=100] Removing partitions
Map(topic2-1 -> Buffer(101, 100)) from the list of reassigned partitions in
zookeeper (kafka.controller.KafkaController:66)
[2019-12-11 01:27:09,710] INFO [Controller id=100] No more partitions need to
be reassigned. Deleting zk path /admin/reassign_partitions
(kafka.controller.KafkaController:66)
Successfully started reassignment of partitions.
[2019-12-11 01:27:11,243] INFO [ControllerEventThread controllerId=101]
Shutting down (kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:27:11,243] INFO [ControllerEventThread controllerId=101] Stopped
(kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:27:11,243] INFO [ControllerEventThread controllerId=101]
Shutdown completed
(kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:27:11,244] INFO [Controller id=101] Resigned
(kafka.controller.KafkaController:66)
[2019-12-11 01:27:11,246] INFO [Controller id=100] Newly added brokers: ,
deleted brokers: 101, bounced brokers: , all live brokers: 100,102
(kafka.controller.KafkaController:66)
[2019-12-11 01:27:11,247] INFO [Controller id=100] Broker failure callback for
101 (kafka.controller.KafkaController:66)
[2019-12-11 01:27:11,251] INFO [Controller id=100] Updated broker epochs cache:
Map(100 -> 25, 102 -> 60) (kafka.controller.KafkaController:66)
[2019-12-11 01:27:11,373] INFO [ControllerEventThread controllerId=102]
Shutting down (kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:27:11,373] INFO [ControllerEventThread controllerId=100]
Shutting down (kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:27:11,373] INFO [ControllerEventThread controllerId=102]
Shutdown completed
(kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:27:11,373] INFO [ControllerEventThread controllerId=100]
Shutdown completed
(kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:27:11,373] INFO [ControllerEventThread controllerId=100] Stopped
(kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:27:11,373] INFO [ControllerEventThread controllerId=102] Stopped
(kafka.controller.ControllerEventManager$ControllerEventThread:66)
[2019-12-11 01:27:11,373] INFO [Controller id=102] Resigned
(kafka.controller.KafkaController:66)
[2019-12-11 01:27:11,375] INFO [Controller id=100] Resigned
(kafka.controller.KafkaController:66)
{noforma}
> Investigate failure of ReassignPartitionsClusterTest.shouldExpandCluster
> ------------------------------------------------------------------------
>
> Key: KAFKA-6078
> URL: https://issues.apache.org/jira/browse/KAFKA-6078
> Project: Kafka
> Issue Type: Bug
> Components: core, unit tests
> Affects Versions: 2.3.0
> Reporter: Dong Lin
> Priority: Major
> Labels: flaky-test
> Fix For: 2.5.0
>
>
> See https://github.com/apache/kafka/pull/4084
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
