Hi, We just created KIP-31 to propose a message format change in Kafka.
https://cwiki.apache.org/confluence/display/KAFKA/KIP-31+-+Message+format+change+proposal As a summary, the motivations are: 1. Avoid server side message re-compression 2. Honor time-based log roll and retention 3. Enable offset search by timestamp at a finer granularity. Feedback and comments are welcome! Thanks, Jiangjie (Becket) Qin