On Thursday 27 March 2008 18:27:48 Bob Hetzel wrote: > Kern, > > First, your theory that I hadn't fully understood the use of regular > expressions is correct, of course! The reason I was using them instead > of Wild commands is because that section of the manual wasn't helpful > enough to me. > > Specifically, I was looking for a way to exclude specific directory and > file names that could be anywhere in the filesystem. I now realize that > to exclude the "Cache" folders I can use lines like... > > WildDir = "*/Cache" > > and for the files such as "thumbs.db" > WildFile = "*/thumbs.db" > > (Windows XP creates the thumbs.db file all over the place and there's no > reason I can see to back it up) > > Perhaps a note about this specific style of usage of WildDir and > WildFile could be added to the docs.
Yes, it is clear that a lot more could be said in the manual. I myself am really poor at regular expressions (there are whole books on them). Anyway, now that you have probably figured this out quite well, if you could send a few words that would have helped you, I will be glad to add them to the manual. > > Additionally, the following example occurs in the doc page at > http://www.bacula.org/en/rel-manual/Configuring_Director.html#FileSetResour >ce > > RegexFile = ".*" > > Not being well versed in regular expressions, I tried to adapt that > example line. > > My fileset definition got so long because I was trying to use a > one-size-fits-all approach... the fact that I can do this at all is a > major plus for bacula over other backup systems! However, I'm aware > that great caution must be used in doing this for a lot of different > backup client computers. Your experience is quite common -- unfortunately, it happens all the time with programmers -- and in Bacula code too :-) > > Perhaps it would be good to put your note #2 (found below) in the docs > as well. Yes, good idea, I will do so. Best of luck in figuring out regular expressions. Don't over look the possibility of using the "tools" referred to in the manual to testing them -- they are quite crude tools but at least they run Bacula's internal versions of wildcards and regexes ... Kern > > Bob > > Kern Sibbald wrote: > > Hmmm. OK, your FileSet convinces me that the most likely problem is in > > the Regex code, which is ported from Linux. I don't think the code is > > really heavily tested even on Linux -- the regex code base we use was > > quite buggy so I imagine there are still some bugs in it. > > > > I note a number of things in your setup: > > > > 1. You are not using VSS, which IMO you should be providing your machine > > handles it (i.e. Win2003, WinXP, WinVista, ...). > > > > 2. You are using a lot of Regex statements, which will cost quite a lot > > of CPU time. I recommend you simplify them if you can, or better yet > > convert them to Wild statements which are much more efficient. > > > > 3. Some of the Regex statements are not going to work the way you expect > > them to -- you are using them much like wild cards. E.g. a single period > > in a regex has an entirely different meaning than matching a single > > period. You might be able to get some help for getting the regexes to > > work they way you want on the bacula-users list. > > > > I'll try putting your Regex commands into a test program to see if I can > > reproduce the problem. > > > > I recommend that you submit a bug report on this: see www.bacula.org -> > > Bug Reports. It is the only way to *guarantee* that the problem will be > > eventually resolved. > > > > Best regards, > > > > Kern > > > > On Wednesday 26 March 2008 14:23:30 Bob Hetzel wrote: > >> Kern Sibbald wrote: > >>> On Tuesday 25 March 2008 19:58:00 Bob Hetzel wrote: > >>>> Hi all, > >>>> > >>>> This is with the 2.2.9-b2 beta candidate announced today, but > >>>> similarly affected backups on this computer with other versions. > >>>> > >>>> I've got a problem whereby bacula-fd abends in the middle of a backup. > >>>> This is on a windows Server 2003 / SP2 client. > >>>> > >>>> I ran a crash analysis using Debug Diagnostics 1.1 and it produced the > >>>> following page... > >>>> > >>>> http://casemed.case.edu/admin_computing/bacula/CrashHang_Report__PID_5 > >>>>27 6__ 03252008144224247.htm > >>>> > >>>> > >>>> I assume this is only the start of what might be helpful so if there's > >>>> anything else I can provide to help solve this I'd be willing to do > >>>> whatever I can. > >>> > >>> Well, it looks like it could be caused by a regex regex. Could you > >>> provide the FileSet that you were using? > >>> > >>> If I understand what you wrote above, you are saying that this is > >>> nothing new with this version -- that you have seen it in prior > >>> versions. Is that correct? > >> > >> Yes, it abends in the 2.2.8 (and I think 2.2.7) versions too on this > >> server, I didn't try any much older versions as I'm still in the midst > >> of trying to migrate my servers and workstations to bacula. > >> > >> Here's the fileset it's using... > >> > >> FileSet { > >> Name = "d-drive-dirs" > >> EnableVSS=no > >> Ignore FileSet Changes = yes > >> Include { > >> Options { > >> @/etc/bacula/bacula-filesets.inc > >> } > >> File = "D:/" > >> } > >> } > >> > >> And here's the include file... > >> signature = MD5 > >> noatime = yes > >> ignore case = yes > >> Exclude = yes > >> RegexDir = "Cache" > >> RegexDir = "Windows Defender" > >> RegexDir = "Temporary Internet Files" > >> RegexDir = "bacula" > >> RegexDir = "Temp" > >> > >> RegexDir = "ATI Technologies" > >> > >> RegexDir = "wmdownloads" > >> RegexDir = "My Music" > >> RegexDir = "iTunes" > >> RegexDir = "Cookies" > >> > >> RegexFile = "desktop.ini" > >> RegexFile = "thumbs.db" > >> RegexFile = "acrobat7.exe" > >> RegexFile = "acr6win.exe" > >> RegexFile = "AdbeRdr70_enu_full.exe" > >> RegexFile = "antivirus10_1_5.exe" > >> #thunderbird lock file > >> RegexFile = "parent.lock" > >> > >> RegexDir = "Retrospect Restore Points" > >> > >> #exclude i386 director of windows installer files > >> WildDir = "[A-Z]:/i386" > >> > >> # Exclude Mozilla-based programs' file caches > >> WildDir = "[A-Z]:/Documents and Settings/*/Application > >> Data/*/Profiles/*/*/ImapMail" > >> WildDir = "[A-Z]:/Users/*/Application > >> Data/*/Profiles/*/*/ImapMail" > >> > >> # Exclude user's registry files - they're always in use anyway. > >> WildFile = "[A-Z]:/Documents and Settings/*/Local > >> Settings/Application Data/Microsoft/Windows/usrclass.*" > >> WildFile = "[A-Z]:/Users/*/Local Settings/Application > >> Data/Microsoft/Windows/usrclass.*" > >> WildFile = "[A-Z]:/Documents and Settings/*/ntuser.*" > >> WildFile = "[A-Z]:/Users/*/ntuser.*" > >> > >> WildDir = "[A-Z]:/Documents and Settings/*/Recent" > >> WildDir = "[A-Z]:/Users/*/Recent" > >> > >> WildDir = "[A-Z]:/Documents and Settings/*/Local > >> Settings/History" WildDir = "[A-Z]:/Users/*/Local Settings/History" > >> > >> # These are always open and unable to be backed up > >> WildFile = "[A-Z]:/Documents and Settings/All Users/Application > >> Data/Microsoft/Network/Downloader/qmgr[01].dat" > >> WildFile = "[A-Z]:/Users/All Users/Application > >> Data/Microsoft/Network/Downloader/qmgr[01].dat" > >> > >> #Exclude all of Windows... > >> WildDir = "[A-Z]:/windows" > >> WildDir = "[A-Z]:/winnt" > >> WildDir = "[A-Z]:/winxp" > >> WildDir = "[A-Z]:/win" > >> > >> #symantec antivirus app stuff > >> WildDir = "[A-Z]:/*/Symantec*" > >> > >> #system volume information > >> WildDir = "[A-Z]:/System Volume Information" > >> > >> WildFile = "*.tmp" > >> # ghost image and spanning files > >> WildFile = "*.gho" > >> WildFile = "*.ghs" > >> > >> # Recycle bins > >> WildDir = "[A-Z]:/RECYCLER" > >> WildDir = "[A-Z]:/RECYCLER" > >> WildDir = "[A-Z]:/RECYCLED" > >> WildDir = "[A-Z]:/$RECYCLE.BIN" > >> > >> # Swap files > >> WildFile = "[A-Z]:/pagefile.sys" > >> > >> # These are programs and are easier to reinstall than restore > >> from # backup > >> WildDir = "[A-Z]:/cygwin" > >> WildDir = "[A-Z]:/Program Files/Adobe/Acrobat 7.0" > >> WildDir = "[A-Z]:/Program Files/Adobe/Acrobat 8.0" > >> > >> WildDir = "[A-Z]:/Program Files/Common Files/Software Center" > >> WildDir = "[A-Z]:/Software Center" > >> > >> WildDir = "[A-Z]:/Program Files/Grisoft" > >> WildDir = "[A-Z]:/Program Files/Java" > >> WildDir = "[A-Z]:/Program Files/Java Web Start" > >> WildDir = "[A-Z]:/Program Files/JavaSoft" > >> WildDir = "[A-Z]:/Program Files/Microsoft Office" > >> WildDir = "[A-Z]:/Program Files/Mozilla Firefox" > >> WildDir = "[A-Z]:/Program Files/Mozilla Thunderbird" > >> WildDir = "[A-Z]:/Program Files/mozilla.org" > >> WildDir = "[A-Z]:/Program Files/OpenOffice*" > >> > >> > >> > >> ------------------------------------------------------------------------ > >>- Check out the new SourceForge.net Marketplace. > >> It's the best place to buy or sell services for > >> just about anything Open Source. > >> http://ad.doubleclick.net/clk;164216239;13503038;w?http://sf.net/marketp > >>lac e _______________________________________________ > >> Bacula-devel mailing list > >> Bacula-devel@lists.sourceforge.net > >> https://lists.sourceforge.net/lists/listinfo/bacula-devel > > ------------------------------------------------------------------------- > Check out the new SourceForge.net Marketplace. > It's the best place to buy or sell services for > just about anything Open Source. > http://ad.doubleclick.net/clk;164216239;13503038;w?http://sf.net/marketplac >e _______________________________________________ > Bacula-devel mailing list > Bacula-devel@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-devel a ------------------------------------------------------------------------- Check out the new SourceForge.net Marketplace. It's the best place to buy or sell services for just about anything Open Source. http://ad.doubleclick.net/clk;164216239;13503038;w?http://sf.net/marketplace _______________________________________________ Bacula-devel mailing list Bacula-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-devel
