Re: pg_upgrade parallelism

2022-01-11 Thread Jaime Casanova
On Wed, Nov 17, 2021 at 08:04:41PM +, Jacob Champion wrote: > On Wed, 2021-11-17 at 14:44 -0500, Jaime Casanova wrote: > > I'm trying to add more parallelism by copying individual segments > > of a relfilenode in different processes. Does anyone one see a big > > problem in trying to do that? I

Re: pg_upgrade parallelism

2021-11-23 Thread Tom Lane
Jacob Champion writes: > Right. What I'm worried about is, if disk space or write performance on > the new cluster is a concern, then having a copy-mode upgrade silently > use copy-on-write could be a problem if the DBA needs copy mode to > actually copy. Particularly for the cross-filesystem cas

Re: pg_upgrade parallelism

2021-11-23 Thread Jacob Champion
On Tue, 2021-11-23 at 13:51 -0600, Justin Pryzby wrote: > > I guess you're concerned for someone who wants to be able to run pg_upgrade > and > preserve the ability to start the old cluster in addition to the new. Right. What I'm worried about is, if disk space or write performance on the new cl

Re: pg_upgrade parallelism

2021-11-23 Thread Justin Pryzby
On Tue, Nov 23, 2021 at 06:54:03PM +, Jacob Champion wrote: > On Wed, 2021-11-17 at 14:34 -0600, Justin Pryzby wrote: > > On Wed, Nov 17, 2021 at 02:44:52PM -0500, Jaime Casanova wrote: > > > > > > - why we read()/write() at all? is not a faster way of copying the file? > > > i'm asking that

Re: pg_upgrade parallelism

2021-11-23 Thread Jacob Champion
On Wed, 2021-11-17 at 14:34 -0600, Justin Pryzby wrote: > On Wed, Nov 17, 2021 at 02:44:52PM -0500, Jaime Casanova wrote: > > > > - why we read()/write() at all? is not a faster way of copying the file? > > i'm asking that because i don't actually know. > > No portable way. Linux has this: > h

Re: pg_upgrade parallelism

2021-11-18 Thread Bruce Momjian
On Wed, Nov 17, 2021 at 02:44:52PM -0500, Jaime Casanova wrote: > Hi, > > Currently docs about pg_upgrade says: > > """ > > The --jobs option allows multiple CPU cores to be used > for copying/linking of files and to dump and reload database schemas > in parallel; a good plac

Re: pg_upgrade parallelism

2021-11-17 Thread Justin Pryzby
On Wed, Nov 17, 2021 at 02:44:52PM -0500, Jaime Casanova wrote: > Hi, > > Currently docs about pg_upgrade says: > > """ > > The --jobs option allows multiple CPU cores to be used > for copying/linking of files and to dump and reload database schemas > in parallel; a good plac

Re: pg_upgrade parallelism

2021-11-17 Thread Jacob Champion
On Wed, 2021-11-17 at 14:44 -0500, Jaime Casanova wrote: > I'm trying to add more parallelism by copying individual segments > of a relfilenode in different processes. Does anyone one see a big > problem in trying to do that? I'm asking because no one did it before, > that could not be a good sign.