On Wed, 3 Apr 2024, Matthew Hibberd via clamav-users wrote:

 *   I am hosting the ClamAV DB files on S3.
 *   I have a lambda routinely running as a cron job that downloads the latest 
DB files from S3 to a local dir and runs freshclam against said dir as its 
database directory.
 *   freshclam is correctly identifying the daily.cvd as out of date
    *   log: daily database available for update (local version: 27225, remote 
version: 27234)
 *   however, it is failing to unpack daily.cvd so it can be patched
    *   log: WARNING: Wed Apr 3 21:15:46 2024 -> [LibClamAV] cli_untgz: Wrote 0 
instead of 512 
(/tmp/clamav/db/tmp.21bd42c58a/clamav-1e208e14d7df16a662a09232b9ee56b8.tmp/daily.hsb)
    *   log: WARNING: Wed Apr 3 21:15:46 2024 -> [LibClamAV] CVD unpacking 
failed for: daily.cvd
    *   log: ERROR: Wed Apr 3 21:15:46 2024 -> mkdir_and_chdir_for_cdiff_tmp: 
Can't unpack daily.cvd into 
/tmp/clamav/db/tmp.21bd42c58a/clamav-1e208e14d7df16a662a09232b9ee56b8.tmp
 *   After this freshclam gives up trying to patch daily.cvd and downloads the 
full file again

Running the same image locally within Docker desktop everything works fine. The 
main difference I can see is that when running locally it's running as root.
I have tried to set total open permissions (chmod -R 777) on /tmp/clamav/db 
after obtaining the latest DB files from S3; didn't fix it.
I also notice that the clamav user is not present (when list users via getent 
passwd) when running as a lambda.

Lambda is running from a docker container; base image is alpine with clamav installed as 
"apk add --no-cache clamav-daemon clamav-libunrar".

Any ideas what I can look at next?

How much RAM and disk do you have ?

(I have
    CompressLocalDatabase no
in freshclam.conf and)
for me freshclam builds a daily.cld and updates that with the cdiffs.

This daily.cld is currently > 200million bytes.

Are you running a clam daemon on this VM ?
That will need > 1GB RAM, and twice that while updating, unless you
have the option to pause the service while updating.

Could it be timing out ? There are several timeouts in my freshclam.conf.

--
Andrew C. Aitchison                      Kendal, UK
                   and...@aitchison.me.uk
_______________________________________________

Manage your clamav-users mailing list subscription / unsubscribe:
https://lists.clamav.net/mailman/listinfo/clamav-users


Help us build a comprehensive ClamAV guide:
https://github.com/Cisco-Talos/clamav-documentation

https://docs.clamav.net/#mailing-lists-and-chat

Reply via email to