Bill Warshaw created KAFKA-3178:
-----------------------------------
Summary: Expose a method in AdminUtils to manually truncate a
specific partition to a particular offset
Key: KAFKA-3178
URL: https://issues.apache.org/jira/browse/KAFKA-3178
Project: Kafka
Issue Type: Improvement
Reporter: Bill Warshaw
One of Kafka's officially-described use cases is a distributed commit log
(http://kafka.apache.org/documentation.html#uses_commitlog). In this case, for
a distributed service that needed a commit log, there would be a topic with a
single partition to guarantee log order. This service would use the commit log
to re-sync failed nodes. Kafka is generally an excellent fit for such a
system, but it does not expose an adequate mechanism for log cleanup in such a
case. The built-in log cleanup mechanisms are based on time / size thresholds,
which doesn't work well with a commit log; data can only be deleted from a
commit log when the client application determines that it is no longer needed.
Here we propose a new API exposed to clients through AdminUtils that will
delete all messages before a certain offset from a specific partition.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)