Re: virtualized kafka

2015-08-31 Thread Helleren, Erik
Allen, 1. The design docs state that most OS¹s make good use of memory and keep recently written files in memory (http://kafka.apache.org/documentation.html#maximizingefficiency). Since everything was just written, it should still be fresh in the OS cache. 2. I cannot answer your virtualization qu

virtualized kafka

2015-08-31 Thread allen chan
I am currently using the Elasticsearch (ELK stack) and Redis is the current choice as broker. I want to move to a distributed broker to make that layer more HA. Currently exploring kafka as a replacement. I have a few questions: 1. I read that kafka is designed to write contents to disk and this