Performance tuning embedded Tomcat 10.1.7: High requests/second, HTTPs and a lot of keep alive connections

Hi community, We are facing some challenges with performance tunning for embedded Tomcat using Spring Boot 3 (Tomcat version 10.1.7) and we would like to ask for advice. The following is an overview of how our workload looks like: - The client is a CDN distributed around the world - Tomcat serves

Re: Performance tuning embedded Tomcat 10.1.7: High requests/second, HTTPs and a lot of keep alive connections

Thanks chris for your thoughts. > This is obviously a "big" question whose answer likely take months to > really determine. But we can get started :) I am aware the question is too broad but better to ask than to be silent. Will try to go for increasing maxKeepAliveRequests first and see where th

Tracking keep alive connections

Hi community, We have a heavy workload where the client uses a lot of keep-alive connections, and we want to measure how many keep-alive connections are open, but we cannot find metrics (MBean) with that information. The closest one is tomcat_connections_keepalive_current but it seems weird the da

Re: Tracking keep alive connections

> What kind of number are you looking for? I would say something like the time a connection has been open. > Can you please give the JMX path to tomcat_connections_keepalive_current > and tomcat_connections_current? I have no idea what you are talking > about there... is there some tool that prov

Re: Tracking keep alive connections

Christopher, So... when a connection is established, save the current timestamp on > the connection. When it closes, take the delta of the > start-of-connection and end-of-connection, and add it to a bounded queue > (say, 100? 1000?) of most-recent-connection-lifetimes. Any time you > request the

Tomcat 10.1.x: Using CoyoteInputStream to read a Chunked Transfer Encoding (CTE) stream, manually, skiping ChunkedInputFilter

Hi Tomcat community, I have a requirement where we want to manually decode a Chunked Transfer Encoding (CTE) stream using CoyoteInputStream to have access to the chunk size. This means I want to use CoyoteInputStream.read method and get the whole CTE bytes. Saying it in another way: we want to dec

Re: Tomcat 10.1.x: Using CoyoteInputStream to read a Chunked Transfer Encoding (CTE) stream, manually, skiping ChunkedInputFilter

El lun, 26 jun 2023 a las 14:53, Mark Thomas () escribió: > On 26/06/2023 20:34, Christopher Schultz wrote: > > Daniel, > > > > On 6/26/23 12:47, Daniel Andres Pelaez Lopez wrote: > >> Hi Tomcat community, > >> > >> I have a requirement whe

Re: Tomcat 10.1.x: Using CoyoteInputStream to read a Chunked Transfer Encoding (CTE) stream, manually, skiping ChunkedInputFilter

Christopher, El mar, 27 jun 2023 a las 9:33, Christopher Schultz (< ch...@christopherschultz.net>) escribió: > Daniel, > > On 6/26/23 16:15, Daniel Andres Pelaez Lopez wrote: > > El lun, 26 jun 2023 a las 14:53, Mark Thomas () > escribió: > > > >> On 26/0

Re: Tomcat 10.1.x: Using CoyoteInputStream to read a Chunked Transfer Encoding (CTE) stream, manually, skiping ChunkedInputFilter

El mar, 27 jun 2023 a las 13:48, Christopher Schultz (< ch...@christopherschultz.net>) escribió: > Daniel, > > On 6/27/23 12:56, Daniel Andres Pelaez Lopez wrote: > > Christopher, > > > > El mar, 27 jun 2023 a las 9:33, Christopher Schultz (< > &g

Re: Tomcat 10.1.x: Using CoyoteInputStream to read a Chunked Transfer Encoding (CTE) stream, manually, skiping ChunkedInputFilter

El mié, 28 jun 2023 a las 7:15, Christopher Schultz (< ch...@christopherschultz.net>) escribió: > Daniel, > > On 6/27/23 15:40, Daniel Andres Pelaez Lopez wrote: > > You are right, the CMAF format of the segment might bring the fragment > size > > information, but

Pinned threads for HTTP2 using Virtual Threads on Tomcat 10.1.7

Hi community, I am working on a Spring Boot + Tomcat embedded application using Virtual Threads (https://openjdk.org/jeps/425), and everything looks great until we activate HTTP2. We started to see the following logs: Thread[#72,ForkJoinPool-1-worker-9,5,CarrierThreads] org.apache.coyote.http

Re: Pinned threads for HTTP2 using Virtual Threads on Tomcat 10.1.7

Mark, Thanks for letting me know. I will wait for the August release to test. Regards. El jue, 6 jul 2023 a las 15:13, Mark Thomas () escribió: > > > 6 Jul 2023 20:09:01 Daniel Andres Pelaez Lopez : > > > I am aware Tomcat community did a great effort to move Tomat to &