Hi All, We have Camus consumer which reads data from Kafka and writes to HDFS. Whenever this consumer runs, there is impact on producer latencies. We don't want producer latencies to be increased in anyway.
I want to know which design pattern is more suited for supporting this use case. 1) Single Kafka cluster with efficient throttling limits for consumers. 2) Separate Kafka cluster for producers and consumers. Data is replicated using MirrorMaker. Thanks, Nitin