Re: [Bacula-users] Backup from client with deduplication

[Рукавцов Дмитрий Геннадьевич]

No i didn't testing, unable to restore to machine without deduplication 
is already an issue. And i don't think it will work with another machine 
cause you need to backup " chunk store" as well.

https://docs.microsoft.com/en-us/previous-versions/windows/desktop/dedup/backup-and-restore-of-data-deduplication-enabled-volumes?redirectedfrom=MSDN
"Enable VSS = no" as i said not solving this problem, and i dunno why, i 
don't care about locks. Bacula can't just copy files?


07.10.2020 12:45, Žiga Žvan пишет:

Yes, probably the deduplicated amount (54) instead od full amount 
(700). First I thought that there is just an error in bacula reporting 
the correct size (eg. incorrectly interpreting windows size/size on 
disk columns), but it is actual this size on disk. I also thought that 
perhaps I need to turn off Snapshot/VSS (and deal with file locks) but 
then I stopped testing this, because my restores were ok.

Did you try to enable deduplication on different server and then 
restore to this drive?

Lets wait for some reply in communiy...

Regards,
Ziga



On 07.10.2020 11:16, Рукавцов Дмитрий Геннадьевич wrote:

You mean you have 700gb raw data but bacula backing it up as 54gb? If 
you will restore it to the same windows 2012 server it will work, but 
if you will restore it to server which not have deduplication think 
most files will be corrupted.

I have no idea how to force bacula backup all data.

07.10.2020 11:48, Žiga Žvan пишет:

Hi,
I'm able to backup Windows 2012 server with deduplication enabled. 
My bacula server is also centos, bacula version 9.6.5 (on client and 
server). I have tested only individual file restores but it always 
worked for me. Backup is very small (54 GB for app. 700 GB raw 
data). I'm not sure how bacula manages to backup and encrypt 
deduplicated amount (I would expect that there will be 700 GB on the 
wire). I'm having some performance problems (see thread 
performance&design&configuration challenges).

I'm at the the end of testing bacula sw, so I'm not an experienced 
user. I would also appreciate if someone confirms, that this should 
work. If it helps, there is log from my last backup.
Kind regards,
Ziga



02-Oct 23:05 bacula-dir JobId 692: Start Backup JobId 692, 
Job=dc1-monthly-backup.2020-10-02_23.05.00_09
02-Oct 23:05 bacula-dir JobId 692: Created new Volume="dc1-monthly-vol-0297", 
Pool="dc1-monthly-pool", MediaType="File" in catalog.
02-Oct 23:05 bacula-dir JobId 692: Using Device "FSLocalBackup" to write.
02-Oct 23:05 bacula-sd JobId 692: Labeled new Volume "dc1-monthly-vol-0297" on File 
device "FSLocalBackup" (/storage/bacula/backup).
02-Oct 23:05 bacula-sd JobId 692: Wrote label to prelabeled Volume "dc1-monthly-vol-0297" 
on File device "FSLocalBackup" (/storage/bacula/backup)
02-Oct 23:05 dc1.kranj.cetrtapot.si-fd JobId 692: Generate VSS snapshots. 
Driver="Win64 VSS"
02-Oct 23:05 dc1.kranj.cetrtapot.si-fd JobId 692:     Snapshot mount point: D:\
03-Oct 13:42 dc1.kranj.cetrtapot.si-fd JobId 692: VSS Writer (BackupComplete): "Task 
Scheduler Writer", State: 0x1 (VSS_WS_STABLE)
03-Oct 13:42 dc1.kranj.cetrtapot.si-fd JobId 692: VSS Writer (BackupComplete): "VSS 
Metadata Store Writer", State: 0x1 (VSS_WS_STABLE)
03-Oct 13:42 dc1.kranj.cetrtapot.si-fd JobId 692: VSS Writer (BackupComplete): 
"Performance Counters Writer", State: 0x1 (VSS_WS_STABLE)
03-Oct 13:42 dc1.kranj.cetrtapot.si-fd JobId 692: VSS Writer (BackupComplete): 
"System Writer", State: 0x1 (VSS_WS_STABLE)
03-Oct 13:42 dc1.kranj.cetrtapot.si-fd JobId 692: VSS Writer (BackupComplete): "ASR 
Writer", State: 0x1 (VSS_WS_STABLE)
03-Oct 13:42 dc1.kranj.cetrtapot.si-fd JobId 692: VSS Writer (BackupComplete): "IIS 
Config Writer", State: 0x1 (VSS_WS_STABLE)
03-Oct 13:42 dc1.kranj.cetrtapot.si-fd JobId 692: VSS Writer (BackupComplete): "WMI 
Writer", State: 0x1 (VSS_WS_STABLE)
03-Oct 13:42 dc1.kranj.cetrtapot.si-fd JobId 692: VSS Writer (BackupComplete): "IIS 
Metabase Writer", State: 0x1 (VSS_WS_STABLE)
03-Oct 13:42 dc1.kranj.cetrtapot.si-fd JobId 692: VSS Writer (BackupComplete): 
"Dedup Writer", State: 0x1 (VSS_WS_STABLE)
03-Oct 13:42 dc1.kranj.cetrtapot.si-fd JobId 692: VSS Writer (BackupComplete): 
"Registry Writer", State: 0x1 (VSS_WS_STABLE)
03-Oct 13:42 dc1.kranj.cetrtapot.si-fd JobId 692: VSS Writer (BackupComplete): 
"Shadow Copy Optimization Writer", State: 0x1 (VSS_WS_STABLE)
03-Oct 13:42 dc1.kranj.cetrtapot.si-fd JobId 692: VSS Writer (BackupComplete): "DFS 
Replication service writer", State: 0x1 (VSS_WS_STABLE)
03-Oct 13:42 dc1.kranj.cetrtapot.si-fd JobId 692: VSS Writer (BackupComplete): "NPS 
VSS Writer", State: 0x1 (VSS_WS_STABLE)
03-Oct 13:42 dc1.kranj.cetrtapot.si-fd JobId 692: VSS Writer (BackupComplete): 
"Certificate Authority", State: 0x1 (VSS_WS_STABLE)
03-Oct 13:42 dc1.kranj.cetrtapot.si-fd JobId 692: VSS Writer (BackupComplete): "Dhcp 
Jet Writer", State: 0x1 (VSS_WS_STABLE)
03-Oct 13:42 dc1.kranj.cetrtapot.si-fd JobId 692: VSS Writer (BackupComplete): "COM+ 
REGDB Writer", State: 0x1 (VSS_WS_STABLE)
03-Oct 13:42 dc1.kranj.cetrtapot.si-fd JobId 692: VSS Writer (BackupComplete): 
"NTDS", State: 0x1 (VSS_WS_STABLE)
03-Oct 13:42 bacula-sd JobId 692: Elapsed time=14:37:01, Transfer rate=1.081 M 
Bytes/second
03-Oct 13:42 bacula-sd JobId 692: Sending spooled attrs to the Director. 
Despooling 462,280,104 bytes ...
03-Oct 13:42 bacula-dir JobId 692: Bacula bacula-dir 9.6.5 (11Jun20):
   Build OS:               x86_64-redhat-linux-gnu-bacula redhat (Core)
   JobId:                  692
   Job:                    dc1-monthly-backup.2020-10-02_23.05.00_09
   Backup Level:           Full
   Client:                 "dc1.kranj.cetrtapot.si-fd" 9.6.5 (11Jun20) 
Microsoft Standard Edition (build 9200), 64-bit,Cross-compile,Win64
   FileSet:                "dc1-fileset" 2020-09-25 18:20:26
   Pool:                   "dc1-monthly-pool" (From Job resource)
   Catalog:                "MyCatalog" (From Client resource)
   Storage:                "FSLocalBackup" (From Job resource)
   Scheduled time:         02-Oct-2020 23:05:00
   Start time:             02-Oct-2020 23:05:02
   End time:               03-Oct-2020 13:42:34
   Elapsed time:           14 hours 37 mins 32 secs
   Priority:               10
   FD Files Written:       1,706,949
   SD Files Written:       1,706,949
   FD Bytes Written:       55,666,483,955 (55.66 GB)
   SD Bytes Written:       56,910,661,569 (56.91 GB)
   Rate:                   1057.3 KB/s
   Software Compression:   None
   Comm Line Compression:  6.9% 1.1:1
   Snapshot/VSS:           yes
   Encryption:             yes
   Accurate:               no
   Volume name(s):         dc1-monthly-vol-0297
   Volume Session Id:      32
   Volume Session Time:    1601373419
   Last Volume Bytes:      57,046,591,963 (57.04 GB)
   Non-fatal FD errors:    0
   SD Errors:              0
   FD termination status:  OK
   SD termination status:  OK
   Termination:            Backup OK

03-Oct 13:42 bacula-dir JobId 692: Begin pruning Jobs older than 6 months .
03-Oct 13:42 bacula-dir JobId 692: No Jobs found to prune.
03-Oct 13:42 bacula-dir JobId 692: Begin pruning Files.
03-Oct 13:42 bacula-dir JobId 692: No Files found to prune.
03-Oct 13:42 bacula-dir JobId 692: End auto prune.



On 07.10.2020 08:38, Radosław Korzeniewski wrote:
Hello,

śr., 7 paź 2020 o 06:37 Рукавцов Дмитрий Геннадьевич 
<m...@santel-navi.ru <mailto:m...@santel-navi.ru>> napisał(a):

    So, there is no solution? Bacula can't backup such clients?

I know nothing about windows filesystem deduplication capabilities, 
but I assume to properly read contents of these files a standard 
win32 BackupRead() dedicated to backup function is not sufficient 
and requires special handling.
I do not know if this special handling is available in Bacula, but 
as this is not my area of interests in Bacula my answer could be 
incomplete.

best regards
--
Radosław Korzeniewski
rados...@korzeniewski.net <mailto:rados...@korzeniewski.net>


_______________________________________________
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


_______________________________________________
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
_______________________________________________
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users