Bill Warshaw created KAFKA-3178:
-----------------------------------

             Summary: Expose a method in AdminUtils to manually truncate a 
specific partition to a particular offset
                 Key: KAFKA-3178
                 URL: https://issues.apache.org/jira/browse/KAFKA-3178
             Project: Kafka
          Issue Type: Improvement
            Reporter: Bill Warshaw


One of Kafka's officially-described use cases is a distributed commit log 
(http://kafka.apache.org/documentation.html#uses_commitlog).  In this case, for 
a distributed service that needed a commit log, there would be a topic with a 
single partition to guarantee log order.  This service would use the commit log 
to re-sync failed nodes.  Kafka is generally an excellent fit for such a 
system, but it does not expose an adequate mechanism for log cleanup in such a 
case.  The built-in log cleanup mechanisms are based on time / size thresholds, 
which doesn't work well with a commit log; data can only be deleted from a 
commit log when the client application determines that it is no longer needed.  
Here we propose a new API exposed to clients through AdminUtils that will 
delete all messages before a certain offset from a specific partition.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to