Thanks Todd. That's the current thinking. We use multiple clusters in a
single data center for solr to avoid a similar problem - number of
collections per cluster in solr's case.
Your numbers are encouraging. I will go ahead with this design for now.
Thanks!
Neelesh
On Mar 21, 2014 6:42 AM, "To
Filehandles can definitely be a concern here, but you can mitigate it to
some extent by adding more brokers to the cluster. The number of open file
handles is going to be driven in large part by the number of log files on
disk. This, in turn, is governed by the number of partitions and how many
fil
Hi,
We are prototyping kafka + storm for our stream processing / event
processing needs. One of the issues we face is a huge influx of stream data
from one of our customers. If we have a single topic for this stream for
all customers, other customers who are behind the big customer stream would
