Flume could be an option with an Interceptor although the throughput could be less compared to Mirror Maker with compression and shallow iterator enabled. On Tue, Aug 25, 2015 at 10:28 PM tao xiao <xiaotao...@gmail.com> wrote:
> In the trunk code mirror maker provides the ability to filter out messages > on demand by supplying a message handler. > > > https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/tools/MirrorMaker.scala#L443 > > On Wed, 26 Aug 2015 at 11:35 Binh Nguyen Van <binhn...@gmail.com> wrote: > > > Hi all, > > > > Is there any tool that allows to mirror a partition of a topic? > > I looked at the mirror maker but it is used to mirror the whole topic > > and I don't see any option that allow me to configure partitions. > > > > I want to mirror our live data to staging environment but my staging > > environment > > can't handle the whole topic so I am looking for a tool that I can use to > > mirror specific > > partitions of a topic only. > > > > Thanks > > -Binh > > >
