Hi Harald,
On Sun, Mar 16, 2025 at 10:29:13PM +0100, Harald Anlauf via Gcc wrote:
> Am 15.08.24 um 21:31 schrieb Mark Wielaard:
> >On Thu, Aug 15, 2024 at 10:31:12AM -0700, H.J. Lu via Gcc wrote:
> >>On Thu, Aug 15, 2024 at 10:17 AM Harald Anlauf via Gcc <gcc@gcc.gnu.org>
> >>wrote:
> >>>is it only me who is recently experiencing intermittent
> >>>but extreme slowness of "git pull"?
> [...]
> >This was caused by agressive spiders that ignore robots.txt and
> >queried bugzilla over and over again. We have apache modqos and
> >fail2ban to capture so such spiders get banned after a short time,
> >till they get unbanned again and the whole circus starts over :{ We
> >should probably be more agressive, but we don't want to block regular
> >really active users or multiple users behind the same outgoing NAT ip.
> >
> >The 16 most frequent fail2banners, those that just come back every
> >time after the ban times out, have been added to the permanent block
> >list. Hopefully that helps.
> >
> >We have isolated the services so no service can overload the system
> >completely. But it can still slow down some others.
>
> since I am experiencing extreme (temporary) performance problems
> again with a recently increased frequency and only during evening
> hours in Europe, I am asking if this is still the same cause.
There is currently a botnet attacking lots of http git endpoints on
various systems including sourceware. We are trying to coordinate a
bit, but given that it seems a fairly large botnet with lots of ips
(which often only do one or two hits per day), it is hard to get a
good defense in place. We believe we have something now that at least
makes sure people can get at git (and bugzilla), although maybe a bit
slower than usual.
> Today I've been waiting for hours for a git pull to succeed (i.e.
> to not timeout), not to mention a push.
Hours however is really odd. Certainly for pushes which should go over
ssh and aren't throttled.
> Is there some throttling also affecting me? Or am I doing
> anything wrong?
Things can be slow with the botnet attacks going on, but shouldn't be
that slow. Feel free to reach out to overse...@sourceware.org or join
#overseers on irc.libera.chat if you need more help.
Cheers,
Mark
