Hi Sebastian, After looking at the logs some more I noticed that all jobs with this warning have in common that they're using compression (LZ4) and autoxflate on replication. Perhaps this combination is still not entirely fixed yet. I'll try disabling autoxflate in the coming days.
The entire result of bscan is in the attachment. However here's the last
part of it where bscan seems to abort (?):
$ sudo -u bareos bscan -b md5_digest_error_copy_only.bsr --list-records
TapeDevice2 2>&1 | tee records.txt
...
bscan: stored/bscan.cc:494-0 Record: SessId=3480 SessTim=1707222936
FileIndex=23 Stream=2 len=65536
bscan: stored/bscan.cc:494-0 Record: SessId=3480 SessTim=1707222936
FileIndex=23 Stream=2 len=65536
bscan: stored/bscan.cc:494-0 Record: SessId=3480 SessTim=1707222936
FileIndex=23 Stream=2 len=65536
bscan: stored/bscan.cc:494-0 Record: SessId=3480 SessTim=1707222936
FileIndex=23 Stream=2 len=22528
bscan: stored/bscan.cc:494-0 Record: SessId=3480 SessTim=1707222936
FileIndex=23 Stream=3 len=16
bscan: stored/bscan.cc:494-0 Record: SessId=3480 SessTim=1707222936
FileIndex=24 Stream=1 len=100
bscan: stored/bscan.cc:494-0 Record: SessId=3480 SessTim=1707222936
FileIndex=25 Stream=1 len=83
bscan: stored/bscan.cc:494-0 Record: SessId=3480 SessTim=1707222936
FileIndex=-5 Stream=94145 len=193
bscan: stored/bscan.cc:681-0 Could not find SessId=3480 SessTime=1707222936
for EOS record.
Records would have been added or updated in the catalog:
0 Media
1 Pool
0 Job
0 File
0 RestoreObject
23-Feb 12:05 bscan JobId 0: Releasing device "TapeDevice2"
(/dev/tape/by-id/scsi-35000e111c71ac0bf-nst).
I also tried restoring the copy which ends in error.
Most files are restored successfully except for one file which happens to
have FileIndex=2 (corresponding to the `attributes=2` in the warning?):
Enter SQL query: select path,name from file,path where jobid=94146 and
fileindex=2 and file.pathid=path.pathid;
+-----------------------------------+--------------------------+
| path | name |
+-----------------------------------+--------------------------+
| /var/backup/old/2024-02-07_23:30/ | backup_www_1100CC.tar.gz |
+-----------------------------------+--------------------------+
A full restore of the original non-copy backup jobs works fine, as do
restores of other copy jobs on tape of filesets that don't use compression.
The original job that was copied (93682) doesn't exist anymore; I think it
was an always-incremental consolidated incremental backup which got
consolidated again the following day.
Best regards,
Samuel
--
You received this message because you are subscribed to the Google Groups
"bareos-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to bareos-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/bareos-users/e766e8c6-5b58-424f-816f-f7c5d7252180n%40googlegroups.com.
<<attachment: records.txt.zip>>
md5_digest_error_copy_only.bsr
Description: Binary data
*list joblog jobid=94145 Automatically selected Catalog: Catalog Using Catalog "Catalog" 2024-02-22 10:01:21 bareos-dir JobId 94145: Copying using JobId=93682 Job=<...>.2024-02-21_10.05.41_59 2024-02-22 10:01:21 bareos-dir JobId 94145: Bootstrap records written to /var/lib/bareos/bareos-dir.restore.2913.bsr 2024-02-22 11:23:13 bareos-dir JobId 94145: Start Copying JobId 94145, Job=CopyToTape-AI-I.2024-02-22_10.01.21_26 2024-02-22 11:23:13 bareos-dir JobId 94145: Connected Storage daemon at 127.0.0.1:9103, encryption: TLS_CHACHA20_POLY1305_SHA256 TLSv1.3 2024-02-22 11:23:13 bareos-dir JobId 94145: Encryption: TLS_CHACHA20_POLY1305_SHA256 TLSv1.3 2024-02-22 11:23:13 bareos-dir JobId 94145: Using Device "FileDevice-ReadOnly-0001" to read. 2024-02-22 11:23:13 bareos-dir JobId 94145: Using Device "TapeDevice1" to write. 2024-02-22 11:23:13 bareos-sd JobId 94145: Ready to read from volume "AI-Consolidated-0911" on device "FileDevice-ReadOnly-0001" (/backup_1/bareos). 2024-02-22 11:23:13 bareos-sd JobId 94145: autoxflate-sd: Autochanger1 OUT:[SD->inflate=yes->deflate=no->DEV] IN:[DEV->inflate=no->deflate=no->SD] 2024-02-22 11:23:13 bareos-sd JobId 94145: Forward spacing Volume "AI-Consolidated-0911" to file:block 3:430720382. 2024-02-22 11:23:17 bareos-dir JobId 94145: Warning: dird/catreq.cc:608 MD5 digest not same File=3 as attributes=2 2024-02-22 11:23:36 bareos-sd JobId 94145: Elapsed time=00:00:23, Transfer rate=281.7 M Bytes/second 2024-02-22 11:23:36 bareos-sd JobId 94145: Releasing device "TapeDevice1" (/dev/tape/by-id/scsi-35000e111c71ac0b5-nst). 2024-02-22 11:23:38 bareos-sd JobId 94145: Releasing device "FileDevice-ReadOnly-0001" (/backup_1/bareos). 2024-02-22 11:23:38 bareos-sd JobId 94145: autoxflate-sd: inflate ratio: 100.63% 2024-02-22 11:23:38 bareos-dir JobId 94145: Insert of attributes batch table with 24 entries start 2024-02-22 11:23:38 bareos-dir JobId 94145: Insert of attributes batch table done 2024-02-22 11:23:38 bareos-dir JobId 94145: Bareos bareos-dir 23.0.2~pre32.0a0e55739 (31Jan24): Build OS: Ubuntu 20.04.5 LTS Prev Backup JobId: 93682 Prev Backup Job: <...>.2024-02-21_10.05.41_59 New Backup JobId: 94146 Current JobId: 94145 Current Job: CopyToTape-AI-I.2024-02-22_10.01.21_26 Backup Level: Incremental Client: bareos-fd FileSet: "SelfTest" Read Pool: "IDF-Full" (From command line) Read Storage: "File-IDF" (From Pool resource) Write Pool: "AI-Tape-Copy" (From Job's NextPool resource) Write Storage: "Tape" (From Storage from Job's NextPool resource) Next Pool: "AI-Tape-Copy" (From Job's NextPool resource) Catalog: "Catalog" (From Client resource) Start time: 22-Feb-2024 11:23:13 End time: 22-Feb-2024 11:23:38 Elapsed time: 25 secs Priority: 20 SD Files Written: 25 SD Bytes Written: 6,479,645,452 (6.479 GB) Rate: 259185.8 KB/s Volume name(s): UB1028L8 Volume Session Id: 3480 Volume Session Time: 1707222936 Last Volume Bytes: 1,017,444,992,000 (1.017 TB) SD Errors: 0 SD termination status: OK Bareos binary info: Bareos community build (UNSUPPORTED): Get professional support from https://www.bareos.com Job triggered by: User Termination: Copying OK 2024-02-22 11:23:38 bareos-dir JobId 94145: console command: run AfterJob "update jobid=94146 jobtype=A"
*list joblog jobid=94308 Automatically selected Catalog: Catalog Using Catalog "Catalog" 2024-02-22 16:39:42 bareos-dir JobId 94308: Start Restore Job Restore-Files.2024-02-22_16.39.42_31 2024-02-22 16:39:42 bareos-dir JobId 94308: Connected Storage daemon at 127.0.0.1:9103, encryption: TLS_CHACHA20_POLY1305_SHA256 TLSv1.3 2024-02-22 16:39:42 bareos-dir JobId 94308: Encryption: TLS_CHACHA20_POLY1305_SHA256 TLSv1.3 2024-02-22 16:39:42 bareos-dir JobId 94308: Using Device "TapeDevice2" to read. 2024-02-22 16:39:42 bareos-dir JobId 94308: Connected Client: bareos-fd at localhost:9102, encryption: TLS_CHACHA20_POLY1305_SHA256 TLSv1.3 2024-02-22 16:39:42 bareos-dir JobId 94308: Handshake: Immediate TLS 2024-02-22 16:39:42 bareos-dir JobId 94308: Encryption: TLS_CHACHA20_POLY1305_SHA256 TLSv1.3 2024-02-22 16:39:44 bareos-fd JobId 94308: Connected Storage daemon at 127.0.0.1:9103, encryption: TLS_CHACHA20_POLY1305_SHA256 TLSv1.3 2024-02-22 16:39:44 bareos-fd JobId 94308: Encryption: TLS_CHACHA20_POLY1305_SHA256 TLSv1.3 2024-02-22 16:39:44 bareos-sd JobId 94308: 3307 Issuing autochanger "unload slot 6, drive 1" command. 2024-02-22 16:40:36 bareos-sd JobId 94308: 3304 Issuing autochanger "load slot 22, drive 1" command. 2024-02-22 16:41:08 bareos-sd JobId 94308: 3305 Autochanger "load slot 22, drive 1", status is OK. 2024-02-22 16:41:11 bareos-sd JobId 94308: Ready to read from volume "UB1028L8" on device "TapeDevice2" (/dev/tape/by-id/scsi-35000e111c71ac0bf-nst). 2024-02-22 16:41:11 bareos-sd JobId 94308: autoxflate-sd: Autochanger1 OUT:[SD->inflate=yes->deflate=no->DEV] IN:[DEV->inflate=no->deflate=no->SD] 2024-02-22 16:41:11 bareos-sd JobId 94308: Forward spacing Volume "UB1028L8" to file:block 269:0. 2024-02-22 16:42:25 bareos-fd JobId 94308: Error: findlib/attribs.cc:381 File size of restored file /tmp/bareos-restores/var/backup/old/2024-02-07_23:30/backup_www_1100CC.tar.gz not correct. Original 738212473, restored 442105856. 2024-02-22 16:42:52 bareos-sd JobId 94308: Releasing device "TapeDevice2" (/dev/tape/by-id/scsi-35000e111c71ac0bf-nst). 2024-02-22 16:42:52 bareos-dir JobId 94308: Error: Bareos bareos-dir 23.0.2~pre32.0a0e55739 (31Jan24): Build OS: Ubuntu 20.04.5 LTS JobId: 94308 Job: Restore-Files.2024-02-22_16.39.42_31 Restore Client: "bareos-fd" 23.0.2~pre32.0a0e55739 (31Jan24) Ubuntu 20.04.5 LTS,ubuntu Start time: 22-Feb-2024 16:39:42 End time: 22-Feb-2024 16:42:52 Elapsed time: 3 mins 10 secs Files Expected: 24 Files Restored: 24 Bytes Restored: 6,183,535,753 Rate: 32544.9 KB/s FD Errors: 1 FD termination status: Error SD termination status: OK Bareos binary info: Bareos community build (UNSUPPORTED): Get professional support from https://www.bareos.com Job triggered by: User Termination: *** Restore Error ***
