Hello, it will run forewer if you don't create indexes. You better stop it (also make sure the sql query is stopped as this was not a case here) and then do something that Frank Alpeter posted once here, I'll quote him:
--- I'm running dbcheck periodically every sunday with the following script: ------------------------------------------------------------------------------------------------ #!/bin/sh PATH="/bin:/usr/bin:/usr/local/bin:/sbin:/usr/sbin:/usr/local/sbin" echo "$(date) Creating temp indices for bacula database..." mysql -ubacula <<EOFA use bacula CREATE INDEX file_tmp_filenameid_idx ON File (FilenameId); CREATE INDEX file_tmp_pathid_idx ON File (PathId); EOFA echo "$(date) Running dbcheck..." dbcheck -c /usr/local/etc/bacula-dir.conf -f -b -v echo "$(date) Removing indices and optimizing bacula database..." mysql -ubacula <<EOFB use bacula DROP INDEX file_tmp_filenameid_idx ON File; DROP INDEX file_tmp_pathid_idx ON File; OPTIMIZE TABLE UnsavedFiles, Counters, CDImages, BaseFiles, Device, Version, Status, MediaType, Storage, FileSet, Client, Pool, Media, Job, JobMedia, File, Path, Filename; EOFB echo "$(date) Done..." ------------------------------------------------------------------------------------------------ Due to the additional index entries, the script runs for about 90 minutes (eternally without them) with a database of 24 million file entries from 88 clients, mostly application servers. It helps a lot, but still it doesn't help against orphaned entries from previously removed clients. --- Regards. Tuesday, July 31, 2007, 3:08:22 PM: MWa> I started the DB check yesterday morning. It is still running. How long MWa> does this usually take? Or am I doing something wrong? MWa> Wolfgang MWa> -----Original Message----- MWa> From: Julien [mailto:[EMAIL PROTECTED] MWa> Sent: Monday, July 30, 2007 10:22 MWa> To: Mair Wolfgang-awm013 MWa> Cc: Doytchin Spiridonov; bacula-users MWa> Subject: Re: [Bacula-users] Restore errors MWa> Hi Mair, MWa> did you tried with a dbcheck ? MWa> (dbcheck -c /path/to/bacula-dir.conf ; Toggle modify database flag ; 16) MWa> All (3-15)) MWa> I had also a huge difference between files expected and files restored, MWa> but the operation above fixed that ... MWa> Regards, MWa> Julien MWa> On Mon, 2007-07-30 at 09:03 +0100, Mair Wolfgang-awm013 wrote: >> Hello, >> >> In my case spooling brought a remarkable improvement. Where as I had >> hundreds of errors on one restore I hardly see them now again with >> spooling in place. >> >> Doytchin, >> I also saw the same behavior like you did. With the concurrent jobs = >> 1, there were no errors. In this case no matter with or without MWa> spooling. >> >> Unfortunately setting the concurrent jobs = 1 is not an option in our >> environment. So my current setting is spooling = on and concurrent >> jobs = 5. >> >> With this settings, it looks like that the Linux systems (OpenSuse and >> red hat) are ok but Solaris still has problems. >> >> For example below is a restore I did on Friday. Of course I don't mind >> about the door files. But the difference between expected and restored >> files is ways to much. And even worse, I have no idea what happened to >> the missing files. I don't know if this has to do something with the >> restore errors we saw. This could also be something different. >> >> During the weekend I moved bacula to a new and separate server. It >> runs on OpenSuse 10.2 with the latest patches in place now. The few >> restore jobs I've done so far with this went ok. >> >> All in all I still don't feel very comfortable with this, it needs >> more tests to be done. I will continue with testing and keep you MWa> updated. >> >> Wolfgang >> >> >> 27-Jul 11:07 porsche-dir: Start Restore Job >> RestoreFiles.2007-07-27_11.07.03 27-Jul 11:07 porsche-sd: Ready to >> read from volume "full-27-7-2007.20" on device "FileStorageFull" >> (/export/bacula-dump). >> 27-Jul 11:07 porsche-sd: Forward spacing Volume "full-27-7-2007.20" to >> file:block 0:3999802558. >> 27-Jul 11:08 porsche-sd: End of file 1 on device "FileStorageFull" >> (/export/bacula-dump), Volume "full-27-7-2007.20" >> 27-Jul 11:08 porsche-sd: End of Volume at file 1 on device >> "FileStorageFull" (/export/bacula-dump), Volume "full-27-7-2007.20" >> 27-Jul 11:08 porsche-sd: Ready to read from volume "full-27-7-2007.21" >> on device "FileStorageFull" (/export/bacula-dump). >> 27-Jul 11:08 porsche-sd: Forward spacing Volume "full-27-7-2007.21" to >> file:block 0:200. >> 27-Jul 11:33 prinz-fd: RestoreFiles.2007-07-27_11.07.03 Error: >> create_file.c:245 Cannot make node /export/xxx/dev/.zone_reg_door: >> ERR=Invalid argument 27-Jul 11:33 prinz-fd: >> RestoreFiles.2007-07-27_11.07.03 Error: create_file.c:245 Cannot make >> node /export/xxx/dev/.devfsadm_synch_door: ERR=Invalid argument 27-Jul >> 11:33 prinz-fd: RestoreFiles.2007-07-27_11.07.03 Error: >> create_file.c:245 Cannot make node >> /export/xxx/etc/sysevent/devfsadm_event_channel/reg_door: ERR=Invalid >> argument 27-Jul 11:33 prinz-fd: RestoreFiles.2007-07-27_11.07.03 MWa> Error: >> create_file.c:245 Cannot make node >> /export/xxx/etc/sysevent/devfsadm_event_channel/1: ERR=Invalid >> argument 27-Jul 11:33 prinz-fd: RestoreFiles.2007-07-27_11.07.03 MWa> Error: >> create_file.c:245 Cannot make node >> /export/xxx/etc/sysevent/syseventconfd_event_channel/reg_door: >> ERR=Invalid argument 27-Jul 11:33 prinz-fd: >> RestoreFiles.2007-07-27_11.07.03 Error: create_file.c:245 Cannot make >> node /export/xxx/etc/sysevent/sysevent_door: ERR=Invalid argument >> 27-Jul >> 11:33 prinz-fd: RestoreFiles.2007-07-27_11.07.03 Error: >> create_file.c:245 Cannot make node >> /export/xxx/etc/sysevent/piclevent_door: ERR=Invalid argument 27-Jul >> 11:15 porsche-sd: End of file 1 on device "FileStorageFull" >> (/export/bacula-dump), Volume "full-27-7-2007.21" >> 27-Jul 11:15 porsche-sd: End of Volume at file 1 on device >> "FileStorageFull" (/export/bacula-dump), Volume "full-27-7-2007.21" >> 27-Jul 11:15 porsche-sd: Ready to read from volume "full-27-7-2007.22" >> on device "FileStorageFull" (/export/bacula-dump). >> 27-Jul 11:15 porsche-sd: Forward spacing Volume "full-27-7-2007.22" to >> file:block 0:200. >> 27-Jul 11:21 porsche-sd: End of file 1 on device "FileStorageFull" >> (/export/bacula-dump), Volume "full-27-7-2007.22" >> 27-Jul 11:21 porsche-sd: End of Volume at file 1 on device >> "FileStorageFull" (/export/bacula-dump), Volume "full-27-7-2007.22" >> 27-Jul 11:21 porsche-sd: Ready to read from volume "full-27-7-2007.23" >> on device "FileStorageFull" (/export/bacula-dump). >> 27-Jul 11:21 porsche-sd: Forward spacing Volume "full-27-7-2007.23" to >> file:block 0:200. >> 27-Jul 11:28 porsche-sd: End of file 1 on device "FileStorageFull" >> (/export/bacula-dump), Volume "full-27-7-2007.23" >> 27-Jul 11:28 porsche-sd: End of Volume at file 1 on device >> "FileStorageFull" (/export/bacula-dump), Volume "full-27-7-2007.23" >> 27-Jul 11:28 porsche-sd: End of all volumes. >> 27-Jul 11:28 porsche-dir: RestoreFiles.2007-07-27_11.07.03 Error: >> Bacula >> 2.0.3 (06Mar07): 27-Jul-2007 11:28:34 >> JobId: 40 >> Job: RestoreFiles.2007-07-27_11.07.03 >> Client: prinz-fd >> Start time: 27-Jul-2007 11:07:05 >> End time: 27-Jul-2007 11:28:34 >> Files Expected: 303,761 >> Files Restored: 301,923 >> Bytes Restored: 27,412,500,483 >> Rate: 21266.5 KB/s >> FD Errors: 7 >> FD termination status: Error >> SD termination status: OK >> Termination: *** Restore Error *** >> >> 27-Jul 11:28 porsche-dir: Begin pruning Jobs. >> 27-Jul 11:28 porsche-dir: No Jobs found to prune. >> 27-Jul 11:28 porsche-dir: Begin pruning Files. >> 27-Jul 11:28 porsche-dir: No Files found to prune. >> 27-Jul 11:28 porsche-dir: End auto prune. >> >> >> >> >> -----Original Message----- >> From: [EMAIL PROTECTED] >> [mailto:[EMAIL PROTECTED] On Behalf Of >> Doytchin Spiridonov >> Sent: Saturday, July 28, 2007 02:02 >> To: bacula-users >> Subject: Re: [Bacula-users] Restore errors >> >> Hello, >> >> just to note that several days after a full backup and incremental >> bacpus, restores are OK, which again proves that the problem was >> caused by running concurrent jobs. >> >> Wolfgang do you have the same results? >> >> Regards >> >> >> Wednesday, July 25, 2007, 8:12:25 PM: >> >> DS> Hello, >> >> DS> 2nd day w/o concurrent jobs: we have 1xFULL and 1xINCREMENTAL for >> DS> all clients. >> >> DS> Restore OK of all jobs. >> >> DS> Seems this (concurrent jobs) is the problem. >> >> DS> Regards. >> >> >> DS> Tuesday, July 24, 2007, 9:57:35 PM: >> >> DS>> I don't have any other ideas to check with to provide more cases. >> DS>> It's developers turn now... >> >> >> >> ---------------------------------------------------------------------- >> -- >> - >> This SF.net email is sponsored by: Splunk Inc. >> Still grepping through log files to find problems? Stop. >> Now Search log events and configuration files using AJAX and a MWa> browser. >> Download your FREE copy of Splunk now >> http://get.splunk.com/ >> _______________________________________________ >> Bacula-users mailing list >> Bacula-users@lists.sourceforge.net >> https://lists.sourceforge.net/lists/listinfo/bacula-users >> >> ---------------------------------------------------------------------- >> --- This SF.net email is sponsored by: Splunk Inc. >> Still grepping through log files to find problems? Stop. >> Now Search log events and configuration files using AJAX and a MWa> browser. >> Download your FREE copy of Splunk now >> http://get.splunk.com/ >> _______________________________________________ >> Bacula-users mailing list >> Bacula-users@lists.sourceforge.net >> https://lists.sourceforge.net/lists/listinfo/bacula-users ------------------------------------------------------------------------- This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now >> http://get.splunk.com/ _______________________________________________ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
