Hello Bálint,
thanks a lot for having a look at this!
# ls -l /var/log/unattended-upgrades/unattended-upgrades-dpkg.log*
-rw-r----- 1 root adm 0 Aug 2 06:01
/var/log/unattended-upgrades/unattended-upgrades-dpkg.log
-rw-r----- 1 root adm 663 Jul 28 06:25
/var/log/unattended-upgrades/unattended-upgrades-dpkg.log.1.gz
-rw-r----- 1 root adm 931 Jun 29 06:33
/var/log/unattended-upgrades/unattended-upgrades-dpkg.log.2.gz
[...]
the one from August is empty, so I guess it must have been the one from
July. I'm attaching the log (in unzipped form) to this mail.
I did run the "reproducer" you provided on:
* the attached log
* the gzipp'ed version of it
* an empty file
but "reproducer" ran through on each of them without an error.
*t
On Tue, 6 Aug 2019, Bálint Réczey wrote:
Control: tags -1 moreinfo
Hi Tomas,
Tomas Pospisek <tpo_...@sourcepole.ch> ezt írta (időpont: 2019. júl. 29., H,
10:54):
>
> Package: unattended-upgrades
> Version: 1.11.2
> Severity: normal
>
> This is what I get from cron:
>
> /etc/cron.daily/apt-compat:
> Traceback (most recent call last):
> File "/usr/bin/unattended-upgrade", line 1538, in <module>
> main(options)
> File "/usr/bin/unattended-upgrade", line 1476, in main
> log_content = get_dpkg_log_content(logfile_dpkg, install_start_time)
> File "/usr/bin/unattended-upgrade", line 1116, in get_dpkg_log_content
> for line in fp.readlines():
> File "/usr/lib/python3.5/codecs.py", line 321, in decode
> (result, consumed) = self._buffer_decode(data, self.errors, final)
> UnicodeDecodeError: 'utf-8' codec can't decode byte 0xfc in position 749:
invalid start byte
>
> No idea what's up with that error message.
> *t
Could you please attach the part of
/var/log/unattended-upgrades/unattended-upgrades-dpkg.log that triggers the
error?
In theory this is what unattended-upgrade does and this should crash on the bad
log:
#!/usr/bin/python3
# reproducer for Debian #933325
import io
with io.open("test-data", encoding='utf-8', errors='replace') as f:
for line in f.readlines():
pass
Cheers,
Balint
Log started: 2019-07-21 06:26:22
(Lese Datenbank ... (Lese Datenbank ... 5%(Lese Datenbank ... 10%(Lese
Datenbank ... 15%(Lese Datenbank ... 20%(Lese Datenbank ... 25%(Lese Datenbank
... 30%(Lese Datenbank ... 35%(Lese Datenbank ... 40%(Lese Datenbank ...
45%(Lese Datenbank ... 50%(Lese Datenbank ... 55%(Lese Datenbank ... 60%(Lese
Datenbank ... 65%(Lese Datenbank ... 70%(Lese Datenbank ... 75%(Lese Datenbank
... 80%(Lese Datenbank ... 85%(Lese Datenbank ... 90%(Lese Datenbank ...
95%(Lese Datenbank ... 100%(Lese Datenbank ... 38806 Dateien und Verzeichnisse
sind derzeit installiert.)
Vorbereitung zum Entpacken von .../linux-libc-dev_4.9.168-1+deb9u4_i386.deb ...
Entpacken von linux-libc-dev:i386 (4.9.168-1+deb9u4) �ber (4.9.168-1+deb9u3) ...
linux-libc-dev:i386 (4.9.168-1+deb9u4) wird eingerichtet ...
Unable to get Terminal Size. The TIOCGWINSZ ioctl didn't work. The COLUMNS and
LINES environment variables didn't work. The resize program didn't work. The
stty program didn't work. at /usr/share/perl5/NeedRestart/UI.pm line 50.
Fehler beim Ermitteln der verf�gbaren Kernel-Versionen.
Unable to get Terminal Size. The TIOCGWINSZ ioctl didn't work. The COLUMNS and
LINES environment variables didn't work. The resize program didn't work. The
stty program didn't work. at /usr/share/perl5/NeedRestart/UI.pm line 50.
Dienste, die neu gestartet werden m�ssen:
invoke-rc.d dovecot restart
Unable to get Terminal Size. The TIOCGWINSZ ioctl didn't work. The COLUMNS and
LINES environment variables didn't work. The resize program didn't work. The
stty program didn't work. at /usr/share/perl5/NeedRestart/UI.pm line 50.
Es m�ssen keine Container neu gestartet werden.
Unable to get Terminal Size. The TIOCGWINSZ ioctl didn't work. The COLUMNS and
LINES environment variables didn't work. The resize program didn't work. The
stty program didn't work. at /usr/share/perl5/NeedRestart/UI.pm line 50.
Es gibt keine Nutzer-Sitzungen mit veralteten Prozessen.
Log ended: 2019-07-21 06:26:35
Log started: 2019-07-28 06:25:22
(Lese Datenbank ... (Lese Datenbank ... 5%(Lese Datenbank ... 10%(Lese
Datenbank ... 15%(Lese Datenbank ... 20%(Lese Datenbank ... 25%(Lese Datenbank
... 30%(Lese Datenbank ... 35%(Lese Datenbank ... 40%(Lese Datenbank ...
45%(Lese Datenbank ... 50%(Lese Datenbank ... 55%(Lese Datenbank ... 60%(Lese
Datenbank ... 65%(Lese Datenbank ... 70%(Lese Datenbank ... 75%(Lese Datenbank
... 80%(Lese Datenbank ... 85%(Lese Datenbank ... 90%(Lese Datenbank ...
95%(Lese Datenbank ... 100%(Lese Datenbank ... 38806 Dateien und Verzeichnisse
sind derzeit installiert.)
Vorbereitung zum Entpacken von .../patch_2.7.5-1+deb9u2_i386.deb ...
Entpacken von patch (2.7.5-1+deb9u2) �ber (2.7.5-1+deb9u1) ...
patch (2.7.5-1+deb9u2) wird eingerichtet ...
Trigger f�r man-db (2.7.6.1-2) werden verarbeitet ...
Unable to get Terminal Size. The TIOCGWINSZ ioctl didn't work. The COLUMNS and
LINES environment variables didn't work. The resize program didn't work. The
stty program didn't work. at /usr/share/perl5/NeedRestart/UI.pm line 50.
Fehler beim Ermitteln der verf�gbaren Kernel-Versionen.
Unable to get Terminal Size. The TIOCGWINSZ ioctl didn't work. The COLUMNS and
LINES environment variables didn't work. The resize program didn't work. The
stty program didn't work. at /usr/share/perl5/NeedRestart/UI.pm line 50.
Dienste, die neu gestartet werden m�ssen:
invoke-rc.d dovecot restart
Unable to get Terminal Size. The TIOCGWINSZ ioctl didn't work. The COLUMNS and
LINES environment variables didn't work. The resize program didn't work. The
stty program didn't work. at /usr/share/perl5/NeedRestart/UI.pm line 50.
Es m�ssen keine Container neu gestartet werden.
Unable to get Terminal Size. The TIOCGWINSZ ioctl didn't work. The COLUMNS and
LINES environment variables didn't work. The resize program didn't work. The
stty program didn't work. at /usr/share/perl5/NeedRestart/UI.pm line 50.
Es gibt keine Nutzer-Sitzungen mit veralteten Prozessen.
Log ended: 2019-07-28 06:25:40