I am load testing my grpc server to see how it performs under high
throughput and what the average request latency is.
It is configured as:
server = NettyServerBuilder.forPort(port)
.addService(testService)
.executor(Executors.newFixedThreadPool(Runtime.getRuntime().availableProcessors()))
.build()
.start();
The machine the server is running on has 16 CPUs. (2 threads per core, 8
cores)
On my client, I am using Guava's RateLimiter
<https://google.github.io/guava/releases/22.0/api/docs/index.html?com/google/common/util/concurrent/RateLimiter.html>
to
send messages in a bi-di stream at 1000 per second. (All using a shared
channel and stub).
Each message I am sending in a Runnable() just to parallelize the work.
Same behavior happens if I just call `onNext` directly without the task
submission step.
Code roughly looks like:
final long startTime = System.currentTimeMillis();
final long oneMinute = TimeUnit.MINUTES.toMillis(1);
final RateLimiter rateLimiter = RateLimiter.create(1000);
final StreamObserver<TestMessageRequest> requestObserver =
client.asyncStub.testMessageRpc(client.replyObserver);
while (System.currentTimeMillis() - startTime < oneMinute) {
rateLimiter.acquire(1);
threadPool.submit(() -> {
TestMessageRequest request = TestMessageRequest.getDefaultInstance();
requestObserver.onNext(request);
});
}
So anywhere from the 20-60 second mark my server throws a:
SEVERE: Exception while executing runnable
io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1@48544a03
[java] java.lang.OutOfMemoryError: GC overhead limit exceeded
Am I doing something wrong? Is there any way to have the server support
this high load.
Thanks in advance!
--
You received this message because you are subscribed to the Google Groups
"grpc.io" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To post to this group, send email to [email protected].
Visit this group at https://groups.google.com/group/grpc-io.
To view this discussion on the web visit
https://groups.google.com/d/msgid/grpc-io/5da1e865-e9b7-4a9c-9f42-55f1ad0050c7%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
