Eno Thereska created KAFKA-5533:
-----------------------------------
Summary: Timestamp-based log compaction
Key: KAFKA-5533
URL: https://issues.apache.org/jira/browse/KAFKA-5533
Project: Kafka
Issue Type: New Feature
Components: core
Affects Versions: 0.11.0.0
Reporter: Eno Thereska
Fix For: 0.11.0.1
Today log compaction is based on offsets, not timestamps. That means that a
late arriving record with a small timestamp TS can over-write a record with a
larger timestamp TL. This affects computations that depend on correct
processing of timestamps. For example, in the streams library, this would mean
that processing for KTables with late arriving data would not be correct.
This JIRA will require a KIP.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
