Re: High CPU Usage on Brokers

2020-01-12 Thread Navneeth Krishnan
Hi Ismael, We were previously running on 0.10.2.1 with 8 brokers running around 80% CPU. But now we have upgraded to 2.3 with 16 brokers. It's the same message rate, topics, producers and consumers but the CPU is still >80%. How can we troubleshoot to find where exactly is the problem? Thanks On

Re: High CPU Usage on Brokers

2020-01-12 Thread Navneeth Krishnan
Hi Lisheng, Here are the answers to your questions. do you set sun.security.jgss.native = true? No if not, there are some items need to be check. 1. GC, but you say gc is not problem - I have verified GC multiple times and I don't see that to be an issue. 2. if you suspect network thread, ho

Re: Streams Newbie Question - Deployment and Management of Stream Processors

2020-01-12 Thread Sachin Mittal
Hi, The way I have used streams processing in past; use case to process streams is when you have a continuous stream of data which needs to be processed and used by certain applications. Since in kafka streams can be a simple java application, this application can run in its own JVM which is differ

Streams Newbie Question - Deployment and Management of Stream Processors

2020-01-12 Thread M. Manna
Hello, Even though I have been using Kafka for a while, it's primarily for publish/subscribe event messaging ( and I understand them reasonably well). But I would like to do more regarding streams. For my initiative, I have been going through the code written in "examples" folder. I would like to