Hi Ted,
The largest a partition can get is the size of the disk storing the
partition's log on the broker. You can use RAID to increase the "disk"
size, and hence the partition size. Whether or not you can fit all messages
in Kafka depends on your use case -- how much data you have, the size of
yo
Hi Ted,
Maybe it's usefull to take a look at samza, http://samza.apache.org/ they
use kafka in a way which sounds similar to how you want to use it. As I
recall from a youtube conference the creator of samza also mentioned to
never delete the events. These things are off course very dependent on y
Hello,
One of the big attractions of Kafka for me was the ability to write new
consumers of topics that would then be able to connect to a topic and
replay all the previous events.
However, most of the time, Kafka appears to be used with a retention period
- presumably in such cases, the events h
