Millions of messages per day (with each message being few bytes) is not
really 'Big Data'. Kafka has been tested for a million message per second.
The answer to all your question IMO is "It depends".
You can start with a single instance (Single machine installation). Let
your producer send messag
Hi,
I am planning to use Apache Kafka 0.8 to handle millions of messages per day.
Now I need to form the environment, like
(i) How many Topics to be created?
(ii) How many partitions/replications to be created?
(iii) How many Brokers to be created?
(iv) How many consumer instances in consum