[
https://issues.apache.org/jira/browse/KAFKA-3472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15215143#comment-15215143
]
Hang Sun commented on KAFKA-3472:
---------------------------------
If we still need to do sampling/filtering after consume the messages, then it
defeats the purpose to reduce unnecessary load on the brokers and bandwidth on
the network infrastructure. As the new Kafka consumer provides ability to
assign partitions explicitly, it will be ideal to leverage that so the sampling
can be done more efficiently.
-thanks
> Allow MirrorMaker to copy selected partitions and choose target topic name
> --------------------------------------------------------------------------
>
> Key: KAFKA-3472
> URL: https://issues.apache.org/jira/browse/KAFKA-3472
> Project: Kafka
> Issue Type: Improvement
> Components: tools
> Affects Versions: 0.9.0.1
> Reporter: Hang Sun
> Priority: Minor
> Labels: mirror-maker
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> It would be nice if MirrorMaker can be used to copy only a few partitions
> instead of all to a different topic. My use case is to sample a small
> portion of production traffic in the pre-production environment for testing.
> The pre-production environment is usually smaller and cannot handle the full
> load from production.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
