On 12/17/05, GiM <[EMAIL PROTECTED]> wrote: > des in message '[Clamav-users] XML and large file scan performance' wrote: > > In investigating heavy load during clamd scanning on an email server, > > I noticed that scanning XML files appears to take longer than similar > > sized binary files. I'm also seeing a big drop off in performance when > > scanning certain large files, e.g. PowerPoint, Word. Tests with > > clamdscan on a dual PIII 1.2GHz: > > > > 1. MS Office files are treated differently then normal files.
Order of magnitude slower though? > 2. Are you scanning under windows or *nix system? Linux. > 3. How much tests have you made on each file? The results were an average of 5 runs per file. > 4. Your Scanning rates seems to be below 2MB/s, > this mean, you probably haven't compiled DNA into the kernel This was with SCSI disk and 2GB RAM, running clamdscan against files on the filesystem (eliminating any email part of the equation). The other scanner was running from command line against the same files on disk and wasn't daemonised. The second scanner isn't so much the point though, I'm interested in improving clamd performance. :) The 7MB file took 1.5s with the other scanner. Looking at disk transfer speeds doesn't come close to explaining the PowerPoint scan time (66s). So you are seeing much lower scan times with similar sized files of these types? You don't see the big difference between file types? If so, that's great, I can investigate the OS/hardware setup. I did some brief tests on 3.2 GHz Xeon (same OS) and saw the same the same pattern, but didn't look in detail. Thanks, -- des -- http://frommars.org/ _______________________________________________ http://lurker.clamav.net/list/clamav-users.html
