Re: Kafka slow reads from beginning of topic

2020-04-16 Thread Ilya R
There is RAID10 on 10 SSD Intel 1.9TB with raid cache 2GB. Topic size is 290GB it nearly fully in cache. Broker CPU usage near 2-3%. CPU is 2 x Intel(R) Xeon(R) Gold 6244 CPU @ 3.60GHz. I didn't find any bottlenecks via JMX graphs. On 2020/04/16 15:59:23, Seva Feldman wrote: > Hi, > > Can you

Re: Kafka slow reads from beginning of topic

2020-04-16 Thread Seva Feldman
Hi, Can you look at the disk IO while you are approaching end of the topic and your performance raises? End of the topic may reside in FS cache in memory and that may explain. BR On Thu, Apr 16, 2020 at 6:56 PM Ilya R wrote: > Hello, everyone > > I'm researching problem when reading a topic fr

Kafka slow reads from beginning of topic

2020-04-16 Thread Ilya R
Hello, everyone I'm researching problem when reading a topic from the beginning max speed per partition/per consumer not more than 80MB/s. But near the end of the topic speed rise up to 250-300MB/s unexpectedly, not only on the last log segment on several latest log segments. I've already chang