Re: [Bacula-users] Backup restauration question

2020-02-13 Thread Dimitri Maziuk via Bacula-users
On 2/13/20 12:47 PM, Jean Mark Orfali wrote: > Hello Phil, > > Thank you for your answer. But what if I need a complete folder and some file > has been changed but no other? There's a Russian saying: "go there I don't know where, bring me that I don't know what". One advantage of having on-line

Re: [Bacula-users] [EXTERNAL] Re: bacula cloud backup

2020-02-11 Thread Dimitri Maziuk via Bacula-users
On 2/11/20 10:59 AM, Radosław Korzeniewski wrote: > Because a community _always_ know better then developers. :) Just read some > hot threads on this group. BS. This is IT 101: users don't know what they want. >> > This is a small tip of the ideberg! and the devil is in the details - > always! I

Re: [Bacula-users] [EXTERNAL] Re: bacula cloud backup

2020-02-10 Thread Dimitri Maziuk via Bacula-users
On 2/10/20 4:12 AM, Radosław Korzeniewski wrote: > So, why not to design a special kind of SD which will get data from FD and > then save it on different backend SD synchronously defining full and > flexible RAIT or EC solution? How should I know why you need a "specail" SD instead of a "regular"

Re: [Bacula-users] [EXTERNAL] Re: bacula cloud backup

2020-02-10 Thread Dimitri Maziuk via Bacula-users
On 2/10/20 11:31 AM, Josh Fisher wrote: > What about a SD writing to multiple local 'Device' objects? And segueing > into a related subject, why is a job locked into a particular Device at > job startup? Rather than a one-time allocation of device and then one or > more subsequent allocations of v

Re: [Bacula-users] [EXTERNAL] Re: bacula cloud backup

2020-01-31 Thread Dimitri Maziuk via Bacula-users
On 1/31/20 10:36 AM, Josh Fisher wrote: > > Actually, it is pretty tricky from user space and why the need for the > md kernel module in Linux. For true RAIT, like for RAID, it should be a > device driver. Yes, iff you need true RAIT. If all you want is to write to 2 file descriptors instead of o

Re: [Bacula-users] Backups to S3

2020-01-17 Thread Dimitri Maziuk via Bacula-users
On 1/17/20 1:03 PM, Jason Voorhees wrote: ... > I'll start playing around with it. I'll let you know if anything does > not work as expected. You made me look: what I can find on amazon is VTL is - $125/mo/gateway - $0.30/restore - $0.09/GB/month in regular or $0.01/GB/month in "glacial" storage.

Re: [Bacula-users] How to verify copy job written on cartridge ?

2019-12-05 Thread Dimitri Maziuk via Bacula-users
On 12/5/2019 3:18 AM, Frédéric F. wrote: Hello, Nobody has an idea to verify tapes data ? FWIW back in the Legato days we used to have a post-backup job that picked a random file and restored it. Dima ___ Bacula-users mailing list Bacula-users@l

Re: [Bacula-users] [EXTERNAL] SAS HBA support on Linux

2019-10-21 Thread Dimitri Maziuk via Bacula-users
On 10/21/19 11:00 AM, Alan Brown wrote: > I spend an awful lot of time making things work in a RHEL environment > when it "just works" in Debianish ones, but the choice of environment > isn't my call. It was a rhetorical question. Although I do think the "scientific community" is beginning to

Re: [Bacula-users] [EXTERNAL] SAS HBA support on Linux

2019-10-21 Thread Dimitri Maziuk via Bacula-users
On 10/21/2019 9:14 AM, Clark, Patti via Bacula-users wrote: ... My question (rhetorical), why do you want to use an OS that is recently released and still bleeding for a backup server? I understand upgrade headaches, but backup servers need to be rock solid. Why use any RHEL > 6 for any kind

Re: [Bacula-users] SAS HBA support on Linux

2019-10-18 Thread Dimitri Maziuk via Bacula-users
On 10/18/19 4:45 PM, William Muriithi wrote: > Hello, > > Have any of you deployed RHEL 8/Centos 8 and would be willing to share what > HBA card they are using? > On centos 7 > # lspci ... > 03:00.0 Serial Attached SCSI controller: Broadcom / LSI SAS2308 PCI-Express > Fusion-MPT SAS-2 (rev 05

Re: [Bacula-users] False "Intervention needed" flood

2019-09-27 Thread Dimitri Maziuk via Bacula-users
(This originally went to Gary instead of the list) On 9/26/2019 7:41 AM, Gary R. Schmidt wrote: Would it be very difficult to change Bacula so that rather than trying every five (or whatever) minutes it did an exponential back-off? One problem with exponential back-off is it's pretty easy to

Re: [Bacula-users] Looking to move away from tape

2019-09-20 Thread Dimitri Maziuk via Bacula-users
On 9/20/19 5:25 PM, David Brodbeck wrote: > That's fair, although most cloud backup schemes are zero-knowledge, i.e. > the data is encrypted before it leaves your premises. I don't know how hard > that is to set up with Bacula because I haven't tried. (One hard truth > about academia is it's easie

Re: [Bacula-users] Looking to move away from tape

2019-09-18 Thread Dimitri Maziuk via Bacula-users
On 9/18/19 12:38 PM, Phil Stracchino wrote: > ... But I've *got* to get > away from tape. *I* want to get away from backups. The group where we use HDDs and vchanger has data archival policy, that's what that "backup" is: an archive. But the other group, we keep the 36-bay ZFS bacula box largel

Re: [Bacula-users] Looking to move away from tape

2019-09-18 Thread Dimitri Maziuk via Bacula-users
On 9/18/19 11:19 AM, Phil Stracchino wrote: > On 9/18/19 11:50 AM, Josh Fisher wrote: >> >> ... I see around 120 MB/s write speeds. > > But ... that's painfully slow even compared to the LTO-4 drive I just > gave up on, which writes at up to twice that. Well, I get ~300MB/s despooling to SATA (ZF

Re: [Bacula-users] Looking to move away from tape

2019-09-17 Thread Dimitri Maziuk via Bacula-users
On 9/17/19 6:23 PM, Phil Stracchino wrote: > And just use Bacula's vchanger, you say? I've never actually played > with that yet. Not bacula changer, Josh's vchanger. It has its quirks but you get a "magazine" per disk with "volume" files and it all stays in the catalog. So if you ever need to r

Re: [Bacula-users] Looking to move away from tape

2019-09-17 Thread Dimitri Maziuk via Bacula-users
On 9/17/19 5:01 PM, Dimitri Maziuk via Bacula-users wrote: > I think you really want at least 4 drives for this setup PS. but only one of them really needs to be removable... -- Dimitri Maziuk Programmer/sysadmin BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu signature.

Re: [Bacula-users] Looking to move away from tape

2019-09-17 Thread Dimitri Maziuk via Bacula-users
On 9/17/19 3:05 PM, Phil Stracchino wrote: > ... I'd prefer to have my full backup media actually > physically offline and airgapped when not actually running. Which is > why I was asking for people's experiences with removable-drive setups > and how best to do it in Bacula. Basic hot-swap SATA

Re: [Bacula-users] Looking to move away from tape

2019-09-17 Thread Dimitri Maziuk via Bacula-users
On 9/17/19 1:08 PM, Phil Stracchino wrote: > What are folks using for removable-drive backup storage, how do you have > it configured in Bacula, and how well is it working out for you? I > desperately need a better solution here. We stick the old and the cheapest desktop SATA drives into a serve

Re: [Bacula-users] [EXTERNAL] Re: Bacula-FD - RedHat

2019-08-19 Thread Dimitri Maziuk via Bacula-users
On 8/19/2019 8:16 AM, Clark, Patti via Bacula-users wrote: I highly disagree with the RHEL 8 suggestion. You don't need to be fighting new release problems with an OS on a backup server that will require frequent patching and reboots. As for Bacula community don't use the RHEL provided packag

Re: [Bacula-users] bacula and SQLite

2019-07-23 Thread Dimitri Maziuk via Bacula-users
On 7/23/2019 6:02 AM, Martin Simmons wrote: If this is being caused by the PathVisibility table then you could try to either delete that table if it is empty or alter its schema definition to use bigint instead of int8 and integer instead of int4. (I'm assuming you are working with a copy of the

Re: [Bacula-users] bacula performance

2019-06-03 Thread Dimitri Maziuk via Bacula-users
On 6/3/19 2:06 PM, ce wrote: > running multiple jobs for the same client at the same time makes it > worse...!!! I use neither encryption nor windows, but this hints at disk i/o. I'm sure sysinternals have some iostat equivalent, or you maybe you could try watching it in task manager/perfmon? --

Re: [Bacula-users] How to backup structured fodler tree (avoiding incremental as much as possible)?

2019-05-31 Thread Dimitri Maziuk via Bacula-users
On 5/31/19 3:24 PM, Lloyd Brown wrote: > Use a script to generate the list of directories to backup, and shove > that into the FileSet definition. E.g. this: FileSet { ... Include { File = "\\|sh -c 'find /home \\( -name fid -o -name ser \\) -mmin +60 -exec dirname \\{} \\; | sort |

Re: [Bacula-users] Multiple bacula jobs at the same time

2019-05-16 Thread Dimitri Maziuk via Bacula-users
On 5/16/19 12:06 PM, ce wrote: > Hi, > > How can I setup bacula to run multiple bacula jobs at the same time for the > same windows client? > should I just set Maximum Concurrent Jobs to more than one, can I set 3 or > 4 concurrent bacula jobs for a windows client? is that possible? Setting that

Re: [Bacula-users] multiple bacula jobs at the same time

2019-05-16 Thread Dimitri Maziuk via Bacula-users
On 5/16/19 11:12 AM, ce wrote: > This message was sent on May 16, 2019 at 9:13:03 AM PDT > You can open it by clicking the link below. This link will only work for > bacula-users@lists.sourceforge.net. It seems AI has evolved itself a built-in IQ test. -- Dimitri Maziuk Programmer/sysadmin Bio

Re: [Bacula-users] bacula and SQLite

2019-05-10 Thread Dimitri Maziuk via Bacula-users
On 5/9/19 5:41 PM, David Brodbeck wrote: > On Wed, May 1, 2019 at 3:14 PM Phil Stracchino wrote: >> Surely you could have just bscanned the media you had? >> ... Obviously now that > the SQLite rug is going to be pulled out from under me I may have to > revisit the bscan idea. I haven't tried t

Re: [Bacula-users] bacula and SQLite

2019-05-02 Thread Dimitri Maziuk via Bacula-users
On 5/2/19 1:35 PM, Tilman Schmidt wrote: > Am 02.05.2019 um 00:14 schrieb Phil Stracchino: >> Surely you could have just bscanned the media you had? > > s/just/hired a few temps who'd/ :-) Might still be cheaper than hiring one database guru to hand-edit catalog.sql for psql. ;) -- Dimitri Mazi

Re: [Bacula-users] bacula and SQLite

2019-05-01 Thread Dimitri Maziuk via Bacula-users
On 5/1/19 3:47 AM, Kern Sibbald wrote: > Aside from the work it takes to maintain the code, please be aware that if > ever > a SQLite database > becomes corrupted, to the best of my knowledge there are no tools to correct > it. That is a valid argument, however, the fix for that is rather simpl

Re: [Bacula-users] Failed to connect to Client -fd

2019-04-30 Thread Dimitri Maziuk via Bacula-users
On 4/30/19 11:42 AM, William Muriithi wrote: > Heitor, > > He is using Centos, and version 5.2.13 ended up being whats shipped by > RedHat. Very understandable > > Do you know why RedHat does ship something newer? Like even version 7? RedHat gets paid for supporting their customers. Presumably

Re: [Bacula-users] bacula and SQLite

2019-04-29 Thread Dimitri Maziuk via Bacula-users
On 4/29/19 1:57 PM, Josip Deanovic wrote: > Because of the reasons Kern already wrote. Yes, but they have nothing to do with the question. > It's not that SQLite is bad or does not have the needed capabilities Precisely: back when it was supported there was nothing wrong with using it, provided

Re: [Bacula-users] bacula and SQLite

2019-04-29 Thread Dimitri Maziuk via Bacula-users
On 4/29/19 10:54 AM, Phil Stracchino wrote: > Was SQLite *ever* actually *recommended* for production? For a small dataset with a very limited number of volumes and backup cycles, why not? -- Dimitri Maziuk Programmer/sysadmin BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu signature.a

Re: [Bacula-users] Doubts about Bacula

2019-04-24 Thread Dimitri Maziuk via Bacula-users
On 4/24/19 11:44 AM, Radosław Korzeniewski wrote: > To make a reschedule after restart possible a Director should save > reschedule state in catalog database. It should save the number of > reschedules passed and an exact time when last reschedule pass started to > checks if it is required to cont

Re: [Bacula-users] Doubts about Bacula

2019-04-19 Thread Dimitri Maziuk via Bacula-users
On 4/19/19 11:56 AM, Radosław Korzeniewski wrote: > When you implement Bacula in the shared storage cluster, you can failover > backup service from node to node in any direction in just a seconds. Your > shared storage cluster can do it for you automatically as soon as it check > that a service is

Re: [Bacula-users] Doubts about Bacula

2019-04-16 Thread Dimitri Maziuk via Bacula-users
On 4/16/19 1:22 PM, Josip Deanovic wrote: > The usual way to do it is a shared storage. > Servers would need to be able to connect to the storage and see the > exported LUN over fibre channel, iSCSI or similar protocol. And what I was saying is that at this point DRBD would be very low on my list

Re: [Bacula-users] Doubts about Bacula

2019-04-16 Thread Dimitri Maziuk via Bacula-users
Not sure how this happened: > The easy way you migrate a running from one host to another VM is have -- it was meant to be "a running VM from one host to another". 8-\ boggle -- Dimitri Maziuk Programmer/sysadmin BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu signature.asc Description

Re: [Bacula-users] Doubts about Bacula

2019-04-16 Thread Dimitri Maziuk via Bacula-users
On 4/16/19 10:04 AM, Josip Deanovic wrote: > NFS and DRBD are not really comparable that way. The easy way you migrate a running from one host to another VM is have the image on an NFS mounted on both hosts. The hard way involves copying the actual image file, however, if you use ZFS you may get

Re: [Bacula-users] Doubts about Bacula

2019-04-16 Thread Dimitri Maziuk via Bacula-users
On 4/16/19 10:27 AM, Josh Fisher wrote: > > > Running jobs will fail, but the automated "Reschedule On Error" feature > allows restarting them after the fail-over. Also, fail-over doesn't > affect scheduled jobs that haven't started yet at the time of fail-over. > Putting the OS on DRBD and runni

Re: [Bacula-users] Run ClientBeforeJob script in background instead of waiting for it.

2019-02-06 Thread Dimitri Maziuk via Bacula-users
On 2/6/19 4:14 PM, David Brodbeck wrote: > I think I'm barking up the wrong tree and the ClientBeforeJob functionality > just isn't meant for this sort of thing. I gather from earlier conversation > that it was only working for me in 7.4.x because of a bug. From a brief look at google it seems yo

Re: [Bacula-users] [External] Re: [Bacula-devel] IBAdmin

2019-01-24 Thread Dimitri Maziuk via Bacula-users
On 1/24/19 4:15 PM, mark.berg...@uphs.upenn.edu wrote: > Putting it very bluntly, the data in Bacula's database is the only > important component. Your tool -- and every other GUI front-end -- is a > convenience, not a necessary part of the backup infrastructure, and your > tool (and every other G

Re: [Bacula-users] [Bacula-devel] IBAdmin

2019-01-24 Thread Dimitri Maziuk via Bacula-users
On 1/24/19 3:03 PM, Radosław Korzeniewski wrote: > Hello, > > czw., 24 sty 2019 o 20:28 Dimitri Maziuk via Bacula-users < > bacula-users@lists.sourceforge.net> napisał(a): > >> !@#ck no, are you kidding? >> >> > Thanks for feedback. :) Like I said,

Re: [Bacula-users] [Bacula-devel] IBAdmin

2019-01-24 Thread Dimitri Maziuk via Bacula-users
On 1/24/19 12:47 PM, Radosław Korzeniewski wrote: > I assume the Bacula Catalog are all the objects used by Bacula Director to > perform its operations, so, no. IBAdmin does not store its configuration > data in Bacula Catalog but stores it in the same Postgresql database. You can isolate admin s

Re: [Bacula-users] Run ClientBeforeJob script in background instead of waiting for it.

2019-01-07 Thread Dimitri Maziuk via Bacula-users
On 1/7/19 12:32 PM, David Brodbeck wrote: > Hmm, good catch on the redirect, but it still doesn't work. Neither does > adding the exec line. nohup just does what is says: no HUP. You may want to try `CMD & ; disown` if your shell has disown, or `setsid CMD`. You'd still ned the redirects. Or rewr

Re: [Bacula-users] Nagios notification setup

2018-12-04 Thread Dimitri Maziuk via Bacula-users
On 12/04/2018 12:57 PM, Donna Hofmeister wrote: > On Tue, Dec 4, 2018 at 11:26 AM Dimitri Maziuk via Bacula-users < > bacula-users@lists.sourceforge.net> wrote: >> How do you monitor for bacula's critical notifications? >> > > I'm not doing any rocket sc

Re: [Bacula-users] Nagios notification setup

2018-12-04 Thread Dimitri Maziuk via Bacula-users
On 12/03/2018 06:27 PM, Elma wrote: > Hi, > > I wonder if we can send nagios critical notification of specific clients to > a separate email address. > right now one email address is used for all the critical notification. How do you monitor for bacula's critical notifications? -- Dimitri Maziu

Re: [Bacula-users] PostgreSQL: WAL and log management

2018-11-26 Thread Dimitri Maziuk via Bacula-users
On 11/26/2018 11:40 AM, George via Bacula-users wrote: > Just one more question: when automating the backup of > all postgresql databases, should I also backup > template1? I have found that template0 cannot be > backed up due to how postgresql works but couldn't > find similar info about template

Re: [Bacula-users] PostgreSQL: WAL and log management

2018-11-23 Thread Dimitri Maziuk via Bacula-users
On 11/20/2018 06:32 PM, George Anchev via Bacula-users wrote: > $ du -hs pg_wal/ > 769Mpg_wal/ > $ psql -U postgres -d postgres -c checkpoint > CHECKPOINT > $ du -hs pg_wal/ > 769Mpg_wal/ If it still hasn't gone down, check your postgresql.conf for #wal_level = replica

[Bacula-users] PostgreSQL: WAL and log management

2018-11-20 Thread Dimitri Maziuk via Bacula-users
PS https://www.postgresql.org/docs/10/sql-checkpoint.html -- Dimitri Maziuk Programmer/sysadmin BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu signature.asc Description: OpenPGP digital signature ___ Bacula-users mailing list Bacula-users@l

Re: [Bacula-users] PostgreSQL: WAL and log management

2018-11-20 Thread Dimitri Maziuk via Bacula-users
On 11/20/2018 04:56 PM, George Anchev via Bacula-users wrote: > On the link I read wal_keep_segments "Specifies the > *minimum* number of past log file segments kept in the > pg_wal directory". Isn't there a setting which > controls the *maximum* number/volume/retention of those > files? (like in

Re: [Bacula-users] PostgreSQL: WAL and log management

2018-11-20 Thread Dimitri Maziuk via Bacula-users
On 11/20/2018 03:49 PM, George Anchev via Bacula-users wrote: > On Mon, 19 Nov 2018 17:16:52 -0600 Dimitri Maziuk via > Bacula-users wrote: > >> https://www.postgresql.org/docs/10/routine-vacuuming.html > > Good info. Thanks. > >> WAL: don't worry about it un

Re: [Bacula-users] PostgreSQL: WAL and log management

2018-11-19 Thread Dimitri Maziuk via Bacula-users
On 11/19/2018 04:12 PM, George Anchev via Bacula-users wrote: > 1. Am I doing everything correctly? https://www.postgresql.org/docs/10/routine-vacuuming.html > 2. How to manage WAL and logs so that old unnecessary > data doesn't fill up disk (and backup tape) space? Logs: https://www.postgresql

Re: [Bacula-users] Migrating from MariaDB to PostgreSQL

2018-11-16 Thread Dimitri Maziuk via Bacula-users
On 11/16/2018 05:06 PM, George Anchev via Bacula-users wrote: >> -bash-4.2$ echo $PGDATA >> /var/lib/pgsql/data > > I get the same echo output but: > > # ls /var/lib/pgsql/data > ls: cannot access '/var/lib/pgsql/data': No such file or directory Well, that's b0rk3d. > POSTGRES_DATADIR="~postgr

Re: [Bacula-users] Migrating from MariaDB to PostgreSQL

2018-11-16 Thread Dimitri Maziuk via Bacula-users
On 11/16/2018 04:25 PM, George Anchev via Bacula-users wrote: > I still wonder though why there is nothing postgresql > related in /etc... Need I install any other packages > or how should this be set up? # su - postgres Last login: Wed Jan 24 15:59:20 CST 2018 on pts/1 -bash-4.2$ echo $PGDATA /v

Re: [Bacula-users] Migrating from MariaDB to PostgreSQL

2018-11-16 Thread Dimitri Maziuk via Bacula-users
On 11/16/2018 12:15 PM, Martin Simmons wrote: >> On Fri, 16 Nov 2018 12:50:12 +0200, George Anchev via Bacula-users said: >> nm: '/usr/lib/libpq.a': No such file > Also, you may only have .so files installed, That is the most likely cause, many distros don't even ship .a's in -devel package

Re: [Bacula-users] modifying established jobs

2018-10-26 Thread Dimitri Maziuk via Bacula-users
On 10/26/2018 04:51 PM, Phil Stracchino wrote: > Simple. A reload *does its best* to properly reinitialize all of the > relevant data in the Director without interrupting any running jobs, but > there have been plenty of reports in the past that the Director can > become unstable after multiple r

Re: [Bacula-users] Bacula SD on a QNAP TS-231

2018-10-12 Thread Dimitri Maziuk via Bacula-users
On 10/12/2018 03:46 PM, Tilman Schmidt wrote: > Hello Heitor, > > On 12.10.2018 19:27 Heitor Faria wrote: > [in reply to Andrea Venturoli's question:] >>> Is there any way I could install bacula storage daemon on the NAS in >>> subject? > [...]>> Of course I could use NFS, but I'd *REALLY* like to

Re: [Bacula-users] Ubuntu 18.04 / Bacula 9.0.6 and Postgres 10

2018-09-06 Thread Dimitri Maziuk via Bacula-users
On 09/06/2018 01:34 PM, Ivan Adzhubey wrote: > Just to clarify, this is my problem: > > $ pg_lsclusters > Ver Cluster Port Status OwnerData directory Log file > 9.5 main5432 online postgres /var/lib/postgresql/9.5/main /var/log/ > postgresql/postgresql-9.5-main.log > 10 main

Re: [Bacula-users] Trying to restore, but can't

2018-06-13 Thread Dimitri Maziuk via Bacula-users
On 6/13/2018 5:59 AM, Josh Fisher wrote: I suggest moving the catalog to postgres on SSD storage, while you're at it. Mine's on spinning rust and it still works OK given enough RAM. I think another issue here is the expectations: we ran a one-CPU (relatively) low-RAM test server for a while

Re: [Bacula-users] Trying to restore, but can't

2018-06-12 Thread Dimitri Maziuk via Bacula-users
On 06/12/2018 11:35 AM, Ryan Butler wrote: > We're on version 7.0.5, which I know is old, and I have plans to update it > after this disaster. > > Here's the details on that particular Job: > > JobFiles: 2,927,789 Version has nothing to do with it. There are several SQL joins involved in getti

Re: [Bacula-users] Bacula h/w write fails, but tar writes w/out error?

2018-06-09 Thread Dimitri Maziuk via Bacula-users
On 6/9/2018 7:36 AM, Josh Fisher wrote: ... The shear volume of media for large sites makes LTO cheaper and D2D2T makes more sense. I think it depends on your definition of "sheer" as well as site's retention policies. Tapes are only cheaper to archive, as in write once and put on the she

Re: [Bacula-users] Bacula h/w write fails, but tar writes w/out error?

2018-06-08 Thread Dimitri Maziuk via Bacula-users
On 06/08/2018 01:26 PM, Phil Stracchino wrote: > > I have to declare I'm getting awful tired of replacing my tape drive > every few years, and I'm looking forward to being able to replace it > with some kind of cartridge SSD. Just get a "hot swap" enclosure and use non-cartridge HDDs. Bacula suck