Re: Limitation on kafka topic size

2013-10-28 Thread Guozhang Wang
Hello Suchi, Each topic will have its own partitions and each partition is represented as a list of file segments. Hence having multiple smaller topics means you will have # topics * avg. # partitions_per_topic file handlers. Volume is usually not a problem for Kafka topics, however, if you have

Re: Limitation on kafka topic size

2013-10-28 Thread Suchi Amalapurapu
We are using kafka 0.7.2 Suchi On Tue, Oct 29, 2013 at 12:53 AM, Suchi Amalapurapu wrote: > All > Are there any limitations on max topic size in Kafka. How large can a > topic get? > What are the implications on resources, latencies, performance and > feasability? > What are the pros and cons of