Maxime Brugidou created KAFKA-845:
-------------------------------------
Summary: Re-implement shallow iteration on 0.8.1
Key: KAFKA-845
URL: https://issues.apache.org/jira/browse/KAFKA-845
Project: Kafka
Issue Type: Improvement
Components: core
Affects Versions: 0.8.1
Reporter: Maxime Brugidou
After KAFKA-732 we decided to not support the shallow iteration feature to
speed up the 0.8 release.
This severely impacts the performance for heavy mirroring between clusters. The
MirrorMaker needs to decompress/recompress the data which actually triple the
CPU compression cost in the data flow (initial compression + 2x compression for
mirroring).
It would be great to discuss a solution to re-implement the feature correctly.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
