Hi, On 2024-12-19 17:47:13 +1100, Michael Harris wrote: > I have attached a file containing all the errors I collected. The > error is happening pretty regularly - over 400 times in a ~6 hour > period. The number of blocks being extended varies from ~9 to ~15, and > the statfs result shows plenty of available space & inodes at the > time. The errors do seem to come in bursts.
One interesting moment is this: 2024-12-19 01:59:39 CET [2559130]: LOG: mdzeroextend FileFallocate failing with ENOSPC: free space for filesystem containing "pg_tblspc/107724/PG_16_202307071/465960/3232056651" f_blocks: 2683831808, f_bfree: 198915036, f_bavail: 198915036 f_files: 1073741376, f_ffree: 1069932412 2024-12-19 01:59:39 CET [2559130]: ERROR: could not extend file "pg_tblspc/107724/PG_16_202307071/465960/3232056651" by 9 blocks, from 59723 to 59732, using FileFallocate(): No space left on device 2024-12-19 04:47:04 CET [2646363]: LOG: mdzeroextend FileFallocate failing with ENOSPC: free space for filesystem containing "pg_tblspc/107724/PG_16_202307071/465960/3232056651.2" f_blocks: 2683831808, f_bfree: 300862306, f_bavail: 300862306 f_files: 1073741376, f_ffree: 1069821450 2024-12-19 04:47:04 CET [2646363]: ERROR: could not extend file "pg_tblspc/107724/PG_16_202307071/465960/3232056651.2" by 11 blocks, from 29850 to 29861, using FileFallocate(): No space left on device Note that there's a) a few hours between messages, whereas previous they were more frequent b) f_bfree increased substantially. I assume that somewhere around 2AM some script prunes old partitions? Greetings, Andres Freund