Bug#890324: [Piuparts-devel] Bug#890324: Bug#890324: Bug#890324: piuparts-master backup strategy

2018-02-14 Thread Holger Levsen
On Wed, Feb 14, 2018 at 06:57:31PM +, Holger Levsen wrote: > fwiw, I agree, so I've just manually created 49 .nobackup files in all > those pass directories in master. and in all those master/*/archive/pass/ directories too. > (This should actually be done by src:piuparts in future.) -- ch

Bug#890324: [Piuparts-devel] Bug#890324: Bug#890324: piuparts-master backup strategy

2018-02-14 Thread Holger Levsen
hi, fwiw, I agree, so I've just manually created 49 .nobackup files in all those pass directories in master. (This should actually be done by src:piuparts in future.) -- cheers, Holger signature.asc Description: PGP signature

Bug#890324: [Piuparts-devel] Bug#890324: piuparts-master backup strategy

2018-02-14 Thread Martin Zobel-Helas
Hi Holger, On Wed Feb 14, 2018 at 12:53:16 +, Holger Levsen wrote: > On Wed, Feb 14, 2018 at 01:41:31PM +0100, Andreas Beckmann wrote: > > Since htdocs/ contains a lot of hardlinks to master/ and df counts the > > files only on the first occurrence. I'm afraid master will be much > > larger t

Bug#890324: [Piuparts-devel] Bug#890324: piuparts-master backup strategy

2018-02-14 Thread Holger Levsen
On Wed, Feb 14, 2018 at 01:41:31PM +0100, Andreas Beckmann wrote: > Since htdocs/ contains a lot of hardlinks to master/ and df counts the > files only on the first occurrence. I'm afraid master will be much > larger than 60GB. Probably 200+ GB. hmpf. also DSA still seems to be unhappy about too m

Bug#890324: [Piuparts-devel] Bug#890324: piuparts-master backup strategy

2018-02-14 Thread Andreas Beckmann
On 2018-02-14 13:33, Holger Levsen wrote: > piupartsm@pejacevic:/srv/piuparts.debian.org$ du -sch * > 474Mbackup > 516Ketc > 0 fails > 336Khome-master > 24K home-slave > 192Ghtdocs > 3,0Mlib > 60G master > 2,9Msbin > 616Kshare > 14M src > 0 tmp >

Bug#890324: piuparts-master backup strategy

2018-02-14 Thread Holger Levsen
On Tue, Feb 13, 2018 at 03:51:28PM +, Holger Levsen wrote: > I've just created that file, everything in /htdocs is generated, looking at > other directories in /srv/piuparts.debian.org/ now, assuming the rest (/) is > set up by DSA nicely already. > > For restoring piuparts.debian.org all we n

Bug#890324: piuparts-master backup strategy

2018-02-13 Thread Holger Levsen
On Tue, Feb 13, 2018 at 01:22:08PM +, Holger Levsen wrote: > > /srv/piuparts.debian.org/htdocs with a few flat directories with a huge > > number of small files. This causes backups to take too long and too > > much space (and/or fail because they're taking too long). I've just created that f

Bug#890324: piuparts-master backup strategy

2018-02-13 Thread Holger Levsen
package: piuparts.debian.org severity: important x-debbugs-cc: d...@debian.org On Tue, Feb 13, 2018 at 02:01:47PM +0100, Julien Cristau wrote: > can you please look at /srv/piuparts.d.o on pejacevic with backups in > mind? Any directory without a .nobackup file is getting backed up, this > seems