Bug#851241: www.debian.org: packages.debian.org update hangs every now and then
Package: www.debian.org Severity: normal Hi, I got notified today that the packages website didn't update, and that this seems to be an issue appearing more regularly. I didn't had much time unfortunately to investigate it further, but this is what appeared to me: #v+ pkg_user 21873 0.0 0.0 103296 5192 ?SJän07 0:07 sshd: pkg_user@notty pkg_user 21887 0.0 0.0 4336 764 ?Ss Jän07 0:00 \_ dash -c /srv/packages.debian.org/bin/push_update pkg_user 21898 0.0 0.0 13348 1656 ?SJän07 0:00 \_ /bin/bash /srv/packages.debian.org/bin/push_update pkg_user 21958 0.0 0.0 4224 1476 ?SJän07 0:00 \_ run-parts --verbose /srv/packages.debian.org/cron.d pkg_user 22309 0.0 0.0 13344 1640 ?SJän07 0:00 \_ /bin/bash /srv/packages.debian.org/cron.d/200proce pkg_user 25601 99.0 0.7 154500 122188 ? RJän07 7804:48 \_ /usr/bin/perl -w ./bin/parse-contents pkg_user 20378 0.0 0.0 4336 712 ?SJän07 0:00 \_ sh -c sort -T /srv/packages.debian.org/tm pkg_user 20379 0.0 0.0 9080 3864 ?SJän07 3:24 \_ sort -T /srv/packages.debian.org/tmp - #v- The running time of parse-contents was increasing, but the sort didn't do anything. An strace showed that it was hanging: #v+ $ strace -p 20379 Process 20379 attached write(1, "-data:kfreebsd-i386\nyp.margorp_e"..., 4096^CProcess 20379 detached #v- Unfortunately I didn't had the time to investigate further, but if it hangs again and maybe at the same place I guess the tmp file(s) would be useful to investigate further. Sorry for not much more right now, Rhonda -- Fühlst du dich mutlos, fass endlich Mut, los | Fühlst du dich hilflos, geh raus und hilf, los| Wir sind Helden Fühlst du dich machtlos, geh raus und mach, los | 23.55: Alles auf Anfang Fühlst du dich haltlos, such Halt und lass los|
Processed: Re: Bug#820119: Info received (Bug#820119 closed by Debian WWW CVS (reply to debian-www@lists.debian.org) (Debian WWW CVS commit by djpig fixes #820119))
Processing commands for cont...@bugs.debian.org:
> unarchive 820119
Bug #820119 {Done: Debian WWW CVS } [www.debian.org] tidy
reports valid NCR as invalid
Unarchived Bug 820119
> reopen 820119
Bug #820119 {Done: Debian WWW CVS } [www.debian.org] tidy
reports valid NCR as invalid
Bug reopened
Ignoring request to alter fixed versions of bug #820119 to the same values
previously set
> --
Stopping processing here.
Please contact me if you need assistance.
--
820119: http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=820119
Debian Bug Tracking System
Contact ow...@bugs.debian.org with problems
Bug#820119: restores original characters instead of taking care of every time numeric references coming up
first, it is stupid to blame about names which are valid.
it is also stupid that taking care of each occurrences coming up.
as pages are all utf-8 now, no need to keep such references,
this patch restores original characters instead of numeric references
patch below:
Index: english/international/l10n/scripts/gen-files.pl
===
--- english/international/l10n/scripts/gen-files.pl (revision 232)
+++ english/international/l10n/scripts/gen-files.pl (working copy)
@@ -3,6 +3,7 @@
use strict;
use File::Path;
use Getopt::Long;
+use Encode qw(encode);
use lib ($0 =~ m|(.*)/|, $1 or ".") ."/../../../../Perl";
@@ -117,8 +118,7 @@
$name =~ s/\s*<.*//;
$name =~ s/&(?!#)/&/g;
$name =~ s/=\?.*?\?=//g;
-# BREAK PERMITTED HERE (U+0082) is not allowed in HTML 4.01.
-$name =~ s/(?:�*130;|�*82;|\N{U+0082})//ig;
+$name =~ s/&#(\d+);/encode("UTF-8",chr($1))/ge;
$name = 'DDTP' if $name eq 'Debian Description Translation Project';
$name = '' if $name =~ m/\@/;
return $name;
--
victory
no need to CC me :-)
Validation failed
Hi, for some time 14 Debian localization team every day receive validation error report. > On Fri, 13 Jan 2017 15:41:39 + > Debian Webmaster wrote: > > > *** Errors validating > > /srv/www.debian.org/www/international/l10n/po/en_GB.ru.html: *** > > Line 119, character 351: "128513" is not a character number in the > > document character set > > Line 307, character 337: "128513" is not a character number in the > > document character set > > Line 1305, character 241: "128513" is not a character number in the > > document character set > > > > -- > > You received this mail for the language code ru. > > Please edit webwml/english/devel/website/validation.data if this is not > > accurate > > Please also update webwml/english/devel/website/ with the new > > coordinator(s) data > > > > The cause is UTF-8 character (&=128513; - 'GRINNING FACE WITH SMILING EYES'), that translator Anthony Harrington has after his name. https://www.debian.org/international/l10n/po/en_GB.en.html I think it's false error message, because this is correct UTF-8 character. Does somebody know how to fix this validation error? --- Best regards, Andrey Skvortsov signature.asc Description: PGP signature
Re: Validation failed
Hi El 13 de enero de 2017 22:29:33 CET, Andrey Skvortsov escribió: >Hi, > >for some time 14 Debian localization team every day receive validation >error report. > >> On Fri, 13 Jan 2017 15:41:39 + >> Debian Webmaster wrote: >> >> > *** Errors validating >> >/srv/www.debian.org/www/international/l10n/po/en_GB.ru.html: *** >> > Line 119, character 351: "128513" is not a character number in the >> >document character set >> > Line 307, character 337: "128513" is not a character number in the >> >document character set >> > Line 1305, character 241: "128513" is not a character number in >the >> >document character set >> > >> > -- >> > You received this mail for the language code ru. >> > Please edit webwml/english/devel/website/validation.data if this >is not accurate >> > Please also update webwml/english/devel/website/ with the new >coordinator(s) data >> > >> > > >The cause is UTF-8 character (&=128513; - 'GRINNING FACE WITH SMILING >EYES'), that translator Anthony Harrington has after his name. > >https://www.debian.org/international/l10n/po/en_GB.en.html > >I think it's false error message, because this is correct UTF-8 >character. >Does somebody know how to fix this validation error? > I didn't know how to fix it. Victory submitted a patch today, in bug #820119. Tomorrow I'll try to review and merge but my perl scripts are few so any comment on the patch is welcome. Cheers Laura Arjona Reina https://wiki.debian.org/LauraArjona
Re: Validation failed
On Sat, 14 Jan 2017 00:01:53 +0100 Laura Arjona Reina wrote: > >The cause is UTF-8 character (&=128513; - 'GRINNING FACE WITH SMILING > >EYES'), that translator Anthony Harrington has after his name. > >https://www.debian.org/international/l10n/po/en_GB.en.html > >I think it's false error message, because this is correct UTF-8 > >character. > >Does somebody know how to fix this validation error? > I didn't know how to fix it. > Victory submitted a patch today, in bug #820119. (I thought gen-file.pl "broke" but the contents in "unstable" file is already "broken") the patch restores content broken by script used on i18n.d.o, perhaps debian-l10n/dl10n.git:/dl10n-check 769-770 which invoke 666-. other way to fix is disable these lines; I chose handling in webwml side in the patch as I'm not sure (how and if) the file is used in other places; if it is not used on any other places, or who use on other scripts are smart enough to adjust their scripts, adjusting i18n.d.o side is a right way, as it does extra handling. > Tomorrow I'll try to review and merge but my perl scripts are few so any > comment on the patch is welcome. you are whining since before saying like, my skills are ... , or ..., for a long time, and will continue to do so in the future :(, that never generate anything positive for the future, and stuck there forever. do not run away from doing tests, otherwise you'll acquire no skills.. no current webmasters have such ones after all. then you, as a DD/webmasters, should do thousands of test against as many as possible instead. maybe you should get perl people, at least for review -- victory no need to CC me :-)
