tml
> >
> > as consumers of Kafka. The indexing service spawns 40 new indexing tasks
> > (Kafka consumers) every 15 mins.
> >
> > The heap memory used on Kafka seems fairly constant for an hour after
> > which it seems to shoot up to the max allocated space. Th
ge collection
logs of Kafka seems to indicate a memory leak in Kafka. Find attached the
plots generated from the GC logs.
*Kafka Deployment:*
3 nodes, with 3 topics and 64 partitions per topic
*Kafka Runtime jvm parameters:*
8GB Heap Memory
1GC swap Memory
Using G1GC
MaxGCPauseMilllis=20
InitiatingHeap
vice spawns 40 new indexing tasks
> (Kafka consumers) every 15 mins.
>
> The heap memory used on Kafka seems fairly constant for an hour after
> which it seems to shoot up to the max allocated space. The garbage
> collection logs of Kafka seems to indicate a memory leak in Kafka. F
ge collection
logs of Kafka seems to indicate a memory leak in Kafka. Find attached the
plots generated from the GC logs.
*Kafka Deployment:*
3 nodes, with 3 topics and 64 partitions per topic
*Kafka Runtime jvm parameters:*
8GB Heap Memory
1GC swap Memory
Using G1GC
MaxGCPauseMilllis=20
InitiatingHeap
