Re: [ANNOUNCE] haproxy-3.1-dev3 (more infos on the story with fd-hard-limit and systemd)

2024-07-17 Thread Willy Tarreau
On Wed, Jul 17, 2024 at 02:06:03PM +0200, Lukas Tribus wrote: > On Wed, 17 Jul 2024 at 11:25, Willy Tarreau wrote: > > > > At this point, do you (or anyone else) still have any objection against > > backporting the DEFAULT_MAXFD patch so as to preserve the current > > defaults for users, and/or do

Re: [ANNOUNCE] haproxy-3.1-dev3 (more infos on the story with fd-hard-limit and systemd)

2024-07-17 Thread Lukas Tribus
On Wed, 17 Jul 2024 at 11:25, Willy Tarreau wrote: > > At this point, do you (or anyone else) still have any objection against > backporting the DEFAULT_MAXFD patch so as to preserve the current > defaults for users, and/or do you have any alternate proposal, or just > want to discuss other possib

Re: [ANNOUNCE] haproxy-3.1-dev3 (more infos on the story with fd-hard-limit and systemd)

2024-07-17 Thread Willy Tarreau
Hi Lukas, On Tue, Jul 16, 2024 at 11:28:12PM +0200, Lukas Tribus wrote: > Hi Valentine, hi Willy, > > after spending some time testing I agree tuning maxconn/fd-limits is hard ... In fact we know that it's hard for experts, and it's even harder for new users. > With 8GB RAM we can still OOM wit

Re: [ANNOUNCE] haproxy-3.1-dev3 (more infos on the story with fd-hard-limit and systemd)

2024-07-16 Thread Lukas Tribus
Hi Valentine, hi Willy, after spending some time testing I agree tuning maxconn/fd-limits is hard ... With 8GB RAM we can still OOM with 1M FDs / 500k maxconn (no TLS), but it appears to be around the sweetspot. It thought it would require more memory considering that we suggest 1GB of memory

Re: [ANNOUNCE] haproxy-3.1-dev3 (more infos on the story with fd-hard-limit and systemd)

2024-07-16 Thread Valentine Krasnobaeva
Hi Lukas ! Hi All! Below are some links and comments just to provide more information on "fd-hard-limit" default value subject :). On 11/07/2024 12:17, Lukas Tribus wrote: Hi, I will get back to this for further research and discussion in about a week. In the meantime, do we agree that the

Re: [ANNOUNCE] haproxy-3.1-dev3

2024-07-11 Thread Willy Tarreau
Hi Lukas, On Thu, Jul 11, 2024 at 12:17:53PM +0200, Lukas Tribus wrote: > Hi, > > I will get back to this for further research and discussion in about a week. OK! In the mean time I'll revert the pending patches from 3.0 so that we can issue 3.0.3 without them. > In the meantime, do we agree th

Re: [ANNOUNCE] haproxy-3.1-dev3

2024-07-11 Thread Lukas Tribus
Hi, I will get back to this for further research and discussion in about a week. In the meantime, do we agree that the environment we are developing the fix for is the following: the hard limit is always set to the maximum available in the kernel which on amd64 is one billion with a B, whether t

Re: [ANNOUNCE] haproxy-3.1-dev3

2024-07-10 Thread Willy Tarreau
Hi Lukas, and first, many thanks for sharing your thoughts and opinions on this. [ responding to both of your messages at once ] On Wed, Jul 10, 2024 at 09:30:55PM +0200, Lukas Tribus wrote: > On Wed, 10 Jul 2024 at 16:39, Willy Tarreau wrote: > > > > Another change that will need to be backpor

Re: [ANNOUNCE] haproxy-3.1-dev3

2024-07-10 Thread Lukas Tribus
On Wed, 10 Jul 2024 at 21:30, Lukas Tribus wrote: > There are ways to push defaults like this out if really needed: with > default configuration files, like we have in examples/ and like > distributions provide in their repositories. This default the users > will then find in the configuration fil

Re: [ANNOUNCE] haproxy-3.1-dev3

2024-07-10 Thread Lukas Tribus
Hello, On Wed, 10 Jul 2024 at 16:39, Willy Tarreau wrote: > > Another change that will need to be backported after some time concerns > the handling of default FD limits. For a few decades, operating systems > would advertise safe limits (i.e. those they were able to deal with based > on their a

Re: [ANNOUNCE] haproxy-3.1-dev3

2024-07-10 Thread Willy Tarreau
On Wed, Jul 10, 2024 at 06:49:52PM +0200, Aleksandar Lazic wrote: > > > On 2024-07-10 (Mi.) 16:39, Willy Tarreau wrote: > > Hi, > > > > HAProxy 3.1-dev3 was released on 2024/07/10. It added 35 new commits > > after version 3.1-dev2. > > [snipp] > > > And I'm still trying to free some time for

Re: [ANNOUNCE] haproxy-3.1-dev3

2024-07-10 Thread Aleksandar Lazic
On 2024-07-10 (Mi.) 16:39, Willy Tarreau wrote: Hi, HAProxy 3.1-dev3 was released on 2024/07/10. It added 35 new commits after version 3.1-dev2. [snipp] And I'm still trying to free some time for the pending reviews (I have not forgotten you but stuff that depends on multiple persons cann