I use Backblaze B2. It is S3 compliant but about the lowest cost I could find, certainly a fraction of the price of AWS.
It works mostly OK except for errors of the kind in the log below. The "no tomes" error is from B2 when there are no upload slots available temporarily. B2 says that the user application is expected to retry the transfer if this occurs. AKAIK the S3 driver doesn’t retry, just gives up. There is a bconsole 'cloud' command to upload volumes to cloud manually. A listing of the cloud volumes shows that the errored volume in the log wasn't uploaded but I could do it manually. Because of this I do not delete the cache after backup, the downside being I have to provision the disc space. Chris 29-Nov 00:20 raspberrypi-dir JobId 3617: Start Backup JobId 3617, Job=pi-cloud-docs.2023-11-29_00.20.00_30 29-Nov 00:20 raspberrypi-dir JobId 3617: Max configured use duration=10,800 sec. exceeded. Marking Volume "usb16tb-cloud-incr4767" as Used. 29-Nov 00:20 raspberrypi-dir JobId 3617: Created new Volume="usb16tb-cloud-incr4768", Pool="usb16tb-cloud-incr", MediaType="Cloud" in catalog. 29-Nov 00:20 raspberrypi-dir JobId 3617: Using Device "B2Bucket" to write. 29-Nov 00:20 raspberrypi-sd JobId 3617: Labeled new Volume "usb16tb-cloud-incr4768" on Cloud device "B2Bucket" (/mnt/usb16tb/cache). 29-Nov 00:20 raspberrypi-sd JobId 3617: Wrote label to prelabeled Volume "usb16tb-cloud-incr4768" on Cloud device "B2Bucket" (/mnt/usb16tb/cache) 29-Nov 00:20 raspberrypi-sd JobId 3617: Using S3 cloud driver Host= s3.eu-central-003.backblazeb2.com Bucket=bacula01 29-Nov 00:20 raspberrypi-sd JobId 3617: Elapsed time=00:00:01, Transfer rate=9.620 M Bytes/second 29-Nov 00:20 raspberrypi-sd JobId 3617: Cloud Upload transfers: 29-Nov 00:20 raspberrypi-sd JobId 3617: Error: usb16tb-cloud-incr4768/part.1 state=error size=257 B duration=0s msg=S3_put_object ERR=no tomes available CURL Effective URL: https://s3.eu-central-003.backblazeb2.com/bacula01/usb16tb-cloud-incr4768/part.1 CURL Effective URL: https://s3.eu-central-003.backblazeb2.com/bacula01/usb16tb-cloud-incr4768/part.1 29-Nov 00:20 raspberrypi-sd JobId 3617: Error: usb16tb-cloud-incr4768/part.2 state=error size=9.628 MB duration=0s msg=S3_put_object ERR=no tomes available CURL Effective URL: https://s3.eu-central-003.backblazeb2.com/bacula01/usb16tb-cloud-incr4768/part.2 CURL Effective URL: https://s3.eu-central-003.backblazeb2.com/bacula01/usb16tb-cloud-incr4768/part.2 29-Nov 00:20 raspberrypi-sd JobId 3617: Sending spooled attrs to the Director. Despooling 3,019 bytes ... 29-Nov 00:20 raspberrypi-dir JobId 3617: Bacula raspberrypi-dir 11.0.6 (10Mar22): Build OS: aarch64-unknown-linux-gnu debian 11.3 JobId: 3617 On Thu, 30 Nov 2023, 03:47 MylesDearBusiness via Bacula-users, < bacula-users@lists.sourceforge.net> wrote: > It appears I'm out of luck. > > Apprently, curlftpfs no longer supports the open+read+write operation > that Bacula requires, so it looks like I'll have to move to a different > storage provider. > > https://sourceforge.net/p/curlftpfs/discussion/542750/thread/53e47b71/ > > Thanks for all the help so far, much appreciated. > > <Myles> > > > On 2023-11-29 5:47 a.m., MylesDearBusiness wrote: > > > > Hello, Bacula experts. > > > > Due to message length limitations of this mailing list, I have been > > unable to post the majority of necessary details, which is why I was > > using my github gist system to store, apologies for the confusion or > > inconvenience this caused. I just thought it would be more confusing > > to break up the details into multiple messages. > > > > The latest after following up on some of Bill's suggestions, I added a > > second device in my File Changer and now bconsole shows I am being > > asked to execute the "label" command, which is failing. > > > > As a reminder, I'm running bacula-dir under user "bacula" (which does > > not have access to the storage mount /mnt/my_backup). > > I'm running bacula-sd and bacula-fd under user "backupuser" which has > > sole permission to read/write files under this mount. > > > > Please see > > https://gist.github.com/mdear/99ed7d56fd5611216ce08ecff6244c8b for > > more, I just added a new comment with additional details. > > > > Thanks, > > > > <Myles> > > > > > > > > _______________________________________________ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users >
_______________________________________________ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
