Re: REINDEXdb performance degrading gradually PG13.4

2022-06-01 Thread Jeff Janes
On Tue, May 31, 2022 at 11:14 AM Praneel Devisetty < devisettypran...@gmail.com> wrote: > > Hi, >> >> We are trying to reindex 600k tables in a single database of size 2.7TB >> using reindexdb utility in a shell script >> reindexdb -v -d $dbname -h $hostname -U tkcsowner --concurrently -j >> $par

Re: REINDEXdb performance degrading gradually PG13.4

2022-06-01 Thread Praneel Devisetty
On Tue, May 31, 2022 at 9:12 PM David G. Johnston < david.g.johns...@gmail.com> wrote: > On Tuesday, May 31, 2022, Praneel Devisetty > wrote: > >> >> Initially it was processing 1000 tables per minute. Performance is >>> gradually dropping and now after 24 hr it was processing 90 tables per >>> m

Re: REINDEXdb performance degrading gradually PG13.4

2022-05-31 Thread Michael Paquier
On Tue, May 31, 2022 at 08:42:06AM -0700, David G. Johnston wrote: > Building indexes is so IO heavy that the non-IO bottlenecks that exists > likely have minimal impact on the overall times this rebuild everything > will take. That said, I’ve never done anything at this scale before. I > wouldn’

REINDEXdb performance degrading gradually PG13.4

2022-05-31 Thread David G. Johnston
On Tuesday, May 31, 2022, Praneel Devisetty wrote: > > Initially it was processing 1000 tables per minute. Performance is >> gradually dropping and now after 24 hr it was processing 90 tables per >> minute. >> > That seems like a fairly problematic metric given the general vast disparities in siz

REINDEXdb performance degrading gradually PG13.4

2022-05-31 Thread Praneel Devisetty
> Hi, > > We are trying to reindex 600k tables in a single database of size 2.7TB > using reindexdb utility in a shell script > reindexdb -v -d $dbname -h $hostname -U tkcsowner --concurrently -j > $parallel -S $schema > > our config is as below > name | setting > --