[
https://issues.apache.org/jira/browse/KAFKA-8226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16817610#comment-16817610
]
Sönke Liebau edited comment on KAFKA-8226 at 4/15/19 7:14 AM:
--------------------------------------------------------------
Hi [~ernisv],
the functionality that you are implementing is definitely useful, however it
can also easily be achieved by implementing a custom MessageHandler that
preserves partitioning.
Personally I think we should try to avoid adding too many features for which
extensions point were already designed in Kafka.
Additionally there is [MirrorMaker
2.0|https://cwiki.apache.org/confluence/display/KAFKA/KIP-382%3A+MirrorMaker+2.0#KIP-382:MirrorMaker2.0-RemoteTopics,Partitions]
coming up, which I believe has this functionality built in.
was (Author: sliebau):
Hi [~ernisv],
the functionality that you are implementing is definitely useful, however it
can also easily be achieved by implementing a custom MessageHandler that
preserves partitioning.
Personally I think we should try to avoid adding too many features for which
extensions point were already designed in Kafka.
Additionally there is [MirrorMaker
2.0|https://cwiki.apache.org/confluence/display/KAFKA/KIP-382%3A+MirrorMaker+2.0#KIP-382:MirrorMaker2.0-RemoteTopics,Partitions]]
coming up, which I believe has this functionality built in.
> New MirrorMaker option partition.to.partition
> ---------------------------------------------
>
> Key: KAFKA-8226
> URL: https://issues.apache.org/jira/browse/KAFKA-8226
> Project: Kafka
> Issue Type: Improvement
> Components: core
> Reporter: Ernestas Vaiciukevičius
> Priority: Major
>
> Currently when MirrorMaker moves data between topics with records with null
> keys - it shuffles records between destination topic's partitions. Sometimes
> it's desirable to try preserving the original partition.
> Related PR adds new command line option to do that:
> When partition.to.partition=true MirrorMaker retains the partition number
> when mirroring records even without the keys.
> When using this option - source and destination topics are assumed to have
> the same number of partitions.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
