Hi LCassa,
That is expected. Most modern operating systems reserve all free memory as
"pagecache". Since Kafka reads/writes to the filesystem sequentially at
high throughput, most of the page cache is used up at all times. That is
good as well as expected.
This is different from the memory footpr
Hi,
I did not check above values for "PurgatorySize". Here is the output of
free -m when test was running.
total used free sharedbuffers cached
Mem: 48356 48217139 0419 44584
-/+ buffers/cache: 3212 45144
Are the following jmx values high on the brokers?
"kafka.server":name="PurgatorySize",type="ProducerRequestPurgatory"
"kafka.server":name="PurgatorySize",type="FetchRequestPurgatory"
Thanks,
Jun
On Mon, Mar 24, 2014 at 12:38 PM, Cassa L wrote:
> Hi,
> We have been doing some evaluation testi
How are you measuring memory usage? I would expect the OS page cache
to take 100% of unused memory, but that's not the same as being OOM.
- Niek
On Mon, Mar 24, 2014 at 12:38 PM, Cassa L wrote:
> Hi,
> We have been doing some evaluation testing against Kafka.We have 48GB RAM
> on each broker.
Hi,
We have been doing some evaluation testing against Kafka.We have 48GB RAM
on each broker. I created 3 broker cluster and one zookeeper and sent
10,000Messages/seconds to this cluster, continuously. Payload is very
small, less than Kilobyte. Consumer was readind 5,000Messages per second.
Wha
