Just an update and thanks for the input so far.- The "bareos-fd Version: 17.2.4" idea seems to improve things a little, but not 100% and not a really solution. - The problem is on the client and nothing to do with the network (well at this time), since I did a test using the "estimate level=full" and it was to long.
Saying all the above I last night checked the Windows Performance tool and all monitors were fine(disk, cpu, network), except I noticed the Memory Hard Faults/sec was max out, so that could be the problem, to many errrors. So, I need to talk to the Windows server people to see if I can get them to increase the memory on this Windows Hyper-V client.
Thanks and will report back when I get more data. Andrew On 4/23/2020 6:40 PM, Josh Fisher wrote:
On 4/22/2020 12:23 PM, Cejka Rudolf wrote:Hello, I have exactly the same problem: Too slow filesystem traversal by Bacula Windows Client. I think that it has to be some problem with Bacula Client cross compilation (low level of compiler optimalization?), some setting or some other little thing, because if I switch the client to Bareos, incremental backup is usually two to three times faster than with Bacula client in my environment. I tried many versions of clients including the oldest clients from times, when projects "splitted", but behavior of all versions has been the same: All Bacula clients were two to three times slower than all Bareos clients for incremental backups in my environment. Very disappointing and I did not find anything yet, what could change that.Are you using the same Maximum Network Buffer size on both? People have reported issues in the past with the default 64k Maximum Network Buffer Size on Windows. Try reducing that to 32k.I have two Windows servers. The first one is doable using Bacula Windows Client, but on the second one, I had to switch to Bareos Windows Client, because Bacula Windows Client did not want to finish under 20 hours, while Bareos Windows Client needs just 8 to 9 hours. And I really do not know, what to do after a year, two or three...backup-dir Version: 9.4.4 (28 May 2019) x86_64-unknown-freebsd11.3 freebsd 11.3-STABLEbacula-fd Version: 9.4.4 (28 May 2019) VSS Linux Cross-compile Win64 bareos-fd Version: 17.2.4 (21 Sep 2017) VSS Linux Cross-compile Win64 (maybe the last working client with Bacula server?) Best regards. Andrew Watkins wrote (2020/04/22):Thanks folks, I have a feeling it's nothing to do with the network, but the speed of bacula searching the filesystem. In 1 minute it only searched 11k (Examined=67,235 & 60seconds later Examined=72,873) Any ideas except get a better server?and the following seems to be showing that there is only 1 process scanningthe files? *stat client=winfs-fd Connecting to Client winfs-fd at winfs.dcs.bbk.ac.uk:9102 winfs-fd Version: 9.6.3 (09 March 2020) VSS Linux Cross-compile Win64 Daemon started 22-Apr-20 15:02. Jobs: run=0 running=1. Microsoft Standard Edition (build 9200), 64-bit Priv 0x22f Memory: WorkingSetSize: 23,273,472 QuotaPagedPoolUsage: 259,456 QuotaNonPagedPoolUsage: 19,896 PagefileUsage: 12,668,928 APIs=OPT,ATP,LPV,CFA,CFW, WUL,WMKD,GFAA,GFAW,GFAEA,GFAEW,SFAA,SFAW,BR,BW,SPSP, WC2MB,MB2WC,FFFA,FFFW,FNFA,FNFW,SCDA,SCDW, GCDA,GCDW,GVPNW,GVNFVMPW,LZO,!EFS Heap: heap=23,273,472 smbytes=399,505 max_bytes=425,467 bufs=296 max_bufs=353 Sizes: boffset_t=8 size_t=8 debug=100 trace=1 mode=0,0 bwlimit=0kB/s Running Jobs: JobId 155 Job BackupWINFS.2020-04-22_14.10.06_10 is running. VSS Incremental Backup Job started: 22-Apr-20 15:10 Files=2 Bytes=1,829 AveBytes/sec=2 LastBytes/sec=0 Errors=0 Bwlimit=0 ReadBytes=1,829 Files: Examined=67,235 Backed up=2 Processing file: G:/home/abella05/Desktop SDReadSeqNo=6 fd=1300 SDtls=0 Director connected at: 22-Apr-20 15:23 ====
-- ************************************************** **** At home during the crisis trying to work **** ************************************************** **** Support Request to s...@dcs.bbk.ac.uk **** ************************************************** Andrew Watkins * Birkbeck, University of London * Computer Science * * http://notallmicrosoft.blogspot.com * ::e-mails are only read & actioned between 0900 and 1730 hours (Monday - Friday) _______________________________________________ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
