On Mon, Jul 01, 2024 at 05:39:12AM +0000, Lev Lazinskiy wrote:
> > Notice here that the latest log is from 22nd of May, which suggests that the
> > code creating the log never runs (or stops before creating the log).
> > 
> > The latest log available does not show anything interesting:
> > > $ cat /srv/qa.debian.org/log/popcon.log.0
> > > Sun May 19 15:54:44 2024 popcon-import[26445] Imported 
> > > popcon-2024-05-19.gz in 258.5s
> > > Mon May 20 15:54:58 2024 popcon-import[14181] Imported 
> > > popcon-2024-05-20.gz in 271.7s
> > > Tue May 21 15:55:03 2024 popcon-import[30832] Imported 
> > > popcon-2024-05-21.gz in 283.0s
> > > Wed May 22 15:55:00 2024 popcon-import[25033] Imported 
> > > popcon-2024-05-22.gz in 281.9s
> > 
> > I hope that helps.
> > 
> > (That is all I had time for)
> 
> Thanks so much for checking this out Niels. I assume this is running on
> a cron or something. I am happy to help with any sys admin type tasks
> but I am not a DD so its hard to do anything from my side and its 
> possible I am creating more noise at this point. 
> 
> If someone from the QA team sees this, assuming there is a cron job that
> is running this script, it seems to no longer be running. There should
> be some more information in /var/mail/$user (where user is whatever user
> the cron job runs at) 

cron output is actually mailed to a few users (including myself), so you
won't find anything in /var/mail ;)

fwiw, the error I'm receiving is:

Subject: Cron <qa@quantz> nice -15 flock -n /srv/qa.debian.org/lock/popcon 
/srv/qa.debian.org/data/cronjobs/popcon

Traceback (most recent call last):
  File "/srv/qa.debian.org/data/popcon/./extract_popcon-tobdb.py", line 17, in 
<module>
    import sys, os, re, fileinput, dbm, bsddb
ModuleNotFoundError: No module named 'bsddb'


And, the timing matches when the server was upgraded to bookworm.

Jcristau likely tried to fix it, but it wasn't quite enough:
https://salsa.debian.org/dsa-team/mirror/debian.org/-/commit/ef916448b40e714b6886ca4ad97d65eaffebe6c0
as it also required some changes in the script too, which I'm not doing.

A bit sad as that python script is called before the import perl script
that you found, so this tiny failure was blocking all the import.


Anyway, I'm manually running ./popcon-import now, and it's crunching
through the data.  :)

-- 
regards,
                        Mattia Rizzolo

GPG Key: 66AE 2B4A FCCF 3F52 DA18  4D18 4B04 3FCD B944 4540      .''`.
More about me:  https://mapreri.org                             : :'  :
Launchpad user: https://launchpad.net/~mapreri                  `. `'`
Debian QA page: https://qa.debian.org/developer.php?login=mattia  `-

Attachment: signature.asc
Description: PGP signature

Reply via email to