[
https://issues.apache.org/jira/browse/KAFKA-7362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16805258#comment-16805258
]
Dhruvil Shah commented on KAFKA-7362:
-------------------------------------
Thanks [~xiongqiwu]. It will be interesting to hear your proposal on how to
make progress on topic deletion in spite of having offline brokers. I think the
main challenge there is to figure out what happens on topic recreation, i.e.
when you delete a topic and a topic with the same name is recreated.
I think it would make sense to decouple both of these issues though. Cleaning
up orphaned partitions is useful to reclaim the disk space, regardless of
whether we solve the topic deletion problem or not. I am also not sure if we
need a KIP to implement cleanup of orphaned partitions, as this does not change
user experience in any way. What do you think?
> enable kafka broker to remove orphan partitions automatically
> --------------------------------------------------------------
>
> Key: KAFKA-7362
> URL: https://issues.apache.org/jira/browse/KAFKA-7362
> Project: Kafka
> Issue Type: Improvement
> Components: core, log
> Reporter: xiongqi wu
> Assignee: xiongqi wu
> Priority: Major
>
> When partition reassignment removes topic partitions from a offline broker,
> those removed partitions become orphan partitions to the broker. When the
> offline broker comes back online, it is not able to clean up both data and
> folders that belong to orphan partitions. Log manager will scan all all dirs
> during startup, but the time based retention policy on a topic partition will
> not be kicked out until the broker is either a follower or a leader of the
> partition. In addition, we do not have logic to delete folders that belong
> to orphan partition today.
> Open this ticket to provide a mechanism (when enabled) to safely remove
> orphan partitions automatically.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
