Kern, First, your theory that I hadn't fully understood the use of regular expressions is correct, of course! The reason I was using them instead of Wild commands is because that section of the manual wasn't helpful enough to me.
Specifically, I was looking for a way to exclude specific directory and file names that could be anywhere in the filesystem. I now realize that to exclude the "Cache" folders I can use lines like... WildDir = "*/Cache" and for the files such as "thumbs.db" WildFile = "*/thumbs.db" (Windows XP creates the thumbs.db file all over the place and there's no reason I can see to back it up) Perhaps a note about this specific style of usage of WildDir and WildFile could be added to the docs. Additionally, the following example occurs in the doc page at http://www.bacula.org/en/rel-manual/Configuring_Director.html#FileSetResource RegexFile = ".*" Not being well versed in regular expressions, I tried to adapt that example line. My fileset definition got so long because I was trying to use a one-size-fits-all approach... the fact that I can do this at all is a major plus for bacula over other backup systems! However, I'm aware that great caution must be used in doing this for a lot of different backup client computers. Perhaps it would be good to put your note #2 (found below) in the docs as well. Bob Kern Sibbald wrote: > Hmmm. OK, your FileSet convinces me that the most likely problem is in the > Regex code, which is ported from Linux. I don't think the code is really > heavily tested even on Linux -- the regex code base we use was quite buggy so > I imagine there are still some bugs in it. > > I note a number of things in your setup: > > 1. You are not using VSS, which IMO you should be providing your machine > handles it (i.e. Win2003, WinXP, WinVista, ...). > > 2. You are using a lot of Regex statements, which will cost quite a lot of > CPU > time. I recommend you simplify them if you can, or better yet convert them > to Wild statements which are much more efficient. > > 3. Some of the Regex statements are not going to work the way you expect them > to -- you are using them much like wild cards. E.g. a single period in a > regex has an entirely different meaning than matching a single period. You > might be able to get some help for getting the regexes to work they way you > want on the bacula-users list. > > I'll try putting your Regex commands into a test program to see if I can > reproduce the problem. > > I recommend that you submit a bug report on this: see www.bacula.org -> Bug > Reports. It is the only way to *guarantee* that the problem will be > eventually resolved. > > Best regards, > > Kern > > On Wednesday 26 March 2008 14:23:30 Bob Hetzel wrote: >> Kern Sibbald wrote: >>> On Tuesday 25 March 2008 19:58:00 Bob Hetzel wrote: >>>> Hi all, >>>> >>>> This is with the 2.2.9-b2 beta candidate announced today, but similarly >>>> affected backups on this computer with other versions. >>>> >>>> I've got a problem whereby bacula-fd abends in the middle of a backup. >>>> This is on a windows Server 2003 / SP2 client. >>>> >>>> I ran a crash analysis using Debug Diagnostics 1.1 and it produced the >>>> following page... >>>> >>>> http://casemed.case.edu/admin_computing/bacula/CrashHang_Report__PID_527 >>>> 6__ 03252008144224247.htm >>>> >>>> >>>> I assume this is only the start of what might be helpful so if there's >>>> anything else I can provide to help solve this I'd be willing to do >>>> whatever I can. >>> Well, it looks like it could be caused by a regex regex. Could you >>> provide the FileSet that you were using? >>> >>> If I understand what you wrote above, you are saying that this is nothing >>> new with this version -- that you have seen it in prior versions. Is >>> that correct? >> Yes, it abends in the 2.2.8 (and I think 2.2.7) versions too on this >> server, I didn't try any much older versions as I'm still in the midst >> of trying to migrate my servers and workstations to bacula. >> >> Here's the fileset it's using... >> >> FileSet { >> Name = "d-drive-dirs" >> EnableVSS=no >> Ignore FileSet Changes = yes >> Include { >> Options { >> @/etc/bacula/bacula-filesets.inc >> } >> File = "D:/" >> } >> } >> >> And here's the include file... >> signature = MD5 >> noatime = yes >> ignore case = yes >> Exclude = yes >> RegexDir = "Cache" >> RegexDir = "Windows Defender" >> RegexDir = "Temporary Internet Files" >> RegexDir = "bacula" >> RegexDir = "Temp" >> >> RegexDir = "ATI Technologies" >> >> RegexDir = "wmdownloads" >> RegexDir = "My Music" >> RegexDir = "iTunes" >> RegexDir = "Cookies" >> >> RegexFile = "desktop.ini" >> RegexFile = "thumbs.db" >> RegexFile = "acrobat7.exe" >> RegexFile = "acr6win.exe" >> RegexFile = "AdbeRdr70_enu_full.exe" >> RegexFile = "antivirus10_1_5.exe" >> #thunderbird lock file >> RegexFile = "parent.lock" >> >> RegexDir = "Retrospect Restore Points" >> >> #exclude i386 director of windows installer files >> WildDir = "[A-Z]:/i386" >> >> # Exclude Mozilla-based programs' file caches >> WildDir = "[A-Z]:/Documents and Settings/*/Application >> Data/*/Profiles/*/*/ImapMail" >> WildDir = "[A-Z]:/Users/*/Application Data/*/Profiles/*/*/ImapMail" >> >> # Exclude user's registry files - they're always in use anyway. >> WildFile = "[A-Z]:/Documents and Settings/*/Local >> Settings/Application Data/Microsoft/Windows/usrclass.*" >> WildFile = "[A-Z]:/Users/*/Local Settings/Application >> Data/Microsoft/Windows/usrclass.*" >> WildFile = "[A-Z]:/Documents and Settings/*/ntuser.*" >> WildFile = "[A-Z]:/Users/*/ntuser.*" >> >> WildDir = "[A-Z]:/Documents and Settings/*/Recent" >> WildDir = "[A-Z]:/Users/*/Recent" >> >> WildDir = "[A-Z]:/Documents and Settings/*/Local Settings/History" >> WildDir = "[A-Z]:/Users/*/Local Settings/History" >> >> # These are always open and unable to be backed up >> WildFile = "[A-Z]:/Documents and Settings/All Users/Application >> Data/Microsoft/Network/Downloader/qmgr[01].dat" >> WildFile = "[A-Z]:/Users/All Users/Application >> Data/Microsoft/Network/Downloader/qmgr[01].dat" >> >> #Exclude all of Windows... >> WildDir = "[A-Z]:/windows" >> WildDir = "[A-Z]:/winnt" >> WildDir = "[A-Z]:/winxp" >> WildDir = "[A-Z]:/win" >> >> #symantec antivirus app stuff >> WildDir = "[A-Z]:/*/Symantec*" >> >> #system volume information >> WildDir = "[A-Z]:/System Volume Information" >> >> WildFile = "*.tmp" >> # ghost image and spanning files >> WildFile = "*.gho" >> WildFile = "*.ghs" >> >> # Recycle bins >> WildDir = "[A-Z]:/RECYCLER" >> WildDir = "[A-Z]:/RECYCLER" >> WildDir = "[A-Z]:/RECYCLED" >> WildDir = "[A-Z]:/$RECYCLE.BIN" >> >> # Swap files >> WildFile = "[A-Z]:/pagefile.sys" >> >> # These are programs and are easier to reinstall than restore from >> # backup >> WildDir = "[A-Z]:/cygwin" >> WildDir = "[A-Z]:/Program Files/Adobe/Acrobat 7.0" >> WildDir = "[A-Z]:/Program Files/Adobe/Acrobat 8.0" >> >> WildDir = "[A-Z]:/Program Files/Common Files/Software Center" >> WildDir = "[A-Z]:/Software Center" >> >> WildDir = "[A-Z]:/Program Files/Grisoft" >> WildDir = "[A-Z]:/Program Files/Java" >> WildDir = "[A-Z]:/Program Files/Java Web Start" >> WildDir = "[A-Z]:/Program Files/JavaSoft" >> WildDir = "[A-Z]:/Program Files/Microsoft Office" >> WildDir = "[A-Z]:/Program Files/Mozilla Firefox" >> WildDir = "[A-Z]:/Program Files/Mozilla Thunderbird" >> WildDir = "[A-Z]:/Program Files/mozilla.org" >> WildDir = "[A-Z]:/Program Files/OpenOffice*" >> >> >> >> ------------------------------------------------------------------------- >> Check out the new SourceForge.net Marketplace. >> It's the best place to buy or sell services for >> just about anything Open Source. >> http://ad.doubleclick.net/clk;164216239;13503038;w?http://sf.net/marketplac >> e _______________________________________________ >> Bacula-devel mailing list >> Bacula-devel@lists.sourceforge.net >> https://lists.sourceforge.net/lists/listinfo/bacula-devel > > ------------------------------------------------------------------------- Check out the new SourceForge.net Marketplace. It's the best place to buy or sell services for just about anything Open Source. http://ad.doubleclick.net/clk;164216239;13503038;w?http://sf.net/marketplace _______________________________________________ Bacula-devel mailing list Bacula-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-devel
