Re: Backup scripts

2014-09-04 Thread Henri Shustak
Hello, You may want to check out the LBackup source code as a possible starting point if you are looking to create your own customised backup script : http://www.lbackup.org/source Disclaimer : I am involved with the development of LBackup. -

Re: Backup scripts

2014-09-09 Thread Henri Shustak
Hello, The --link-dest approach is the way LBackup works and this is also what allows the lcd command (part of LBackup) to move you back and forth in time while you remain in the same directory relative directory. This makes finding a particular data quite easy during a partial restore. In par

Re: rsync with 8bit file names?

2014-09-11 Thread Henri Shustak
Hello, Guessing the source drive is formatted HFS+ or HFS+J. What is the file system on the destination drive? I know that rsync is capable of correctly coping over file and folder names on Mac OS X which contain non-ASCII characters. Hence my question relating to the destination file system?

Re: rsync with 8bit file names?

2014-09-11 Thread Henri Shustak
by LBackup, an open source backup solution. http://www.lbackup.org On 12/09/2014, at 12:40 PM, LuKreme wrote: > On 11 Sep 2014, at 16:22 , Henri Shustak wrote: >> Guessing the source drive is formatted HFS+ or HFS+J. > > The source drive is a Drobo. The destination i

Re: rsync with 8bit file names?

2014-09-17 Thread Henri Shustak
> When trying to sync my TV folder to a mirror drive, episodes with non-ASCII > characters in them cannot be processed by rsync. Anything I can do about this? (Q1) What do you mean by a mirror drive? Is this a RAID1 external enclosure or some sort of softRAID? Or is it just a copy of the TV fol

Re: rsync with 8bit file names?

2014-09-17 Thread Henri Shustak
Hello again, Three further questions : (Q2-1) Have you tried this same setup when booted from another OS (e.g. 10.9)? (Q2-2) Have you tried this using some other hardware? (Q2-3) Have you tried coping this specific file over using the Finder (say to the Desktop) and then using rsync to copy it

Re: rsync with 8bit file names?

2014-09-18 Thread Henri Shustak
>>> When trying to sync my TV folder to a mirror drive, episodes with non-ASCII >>> characters in them cannot be processed by rsync. Anything I can do about >>> this? >> >> (Q1) What do you mean by a mirror drive? Is this a RAID1 external enclosure >> or some sort of softRAID? Or is it just a c

Re: rsync to multiple destinations

2015-02-01 Thread Henri Shustak
>> I am looking for a way to start one rsync command with multiple destinations. >> My use case: >> I have one (slow) usb drive which should be synced to two other >> harddrives. It would be great if rsync could read one file which is to >> be copied to both hard drives only once, so the slow usb c

Re: rsync --link-dest won't link even if existing file is out of date

2015-04-14 Thread Henri Shustak
Hi Ken, You may wish to take a quick look at LBackup (disclaimer I am a developer on this project) which is a wrapper to rsync ; designed for reliable user data backups. LBackup always starts a new backup snapshot with an empty directory. I have been looking at extending --link-dest options t

Re: rsync --link-dest won't link even if existing file is out of date

2015-04-14 Thread Henri Shustak
> Ill take a look but I imagine I cant backup the 80 Million files I need > to in under the 5 hours i have for nightly maintenance/backups. Currently > it's possible by recycling directories... To cover that many files in that much time you will require a high speed system. Just another thought. P

Re: Recycling directories and backup performance. Was: Re: rsync --link-dest won't link even if existing file is out of date (fwd)

2015-04-16 Thread Henri Shustak
> Our backup procudures have provision for looking back at previous > directories, but there is not much to be gained with recycled directories. > Without recycling, and after a failure, the latest available backup may not > have much in it. Just wanted to point out that LBackup has a number o

Re: Recycling directories and backup performance. Was: Re: rsync --link-dest won't link even if existing file is out of date (fwd)

2015-04-16 Thread Henri Shustak
> How do you handle snapshotting? or do you leave that to the block/fs > virtualization layer? I am guessing this question is directed at me. Firstly, when I used the word snapshot, I was referring to the snapshot in the LBackup context. It is outlined at the following page

Re: Verifying backups

2016-03-07 Thread Henri Shustak
Just chiming in slightly off topic. As a first step if you are going to be backing up files to some media with a computer it would be a really good idea to ensure, that the hardware being used is not faulty. I am not saying that your hardware is faulty. However, it would be worth checking this

Re: Empty directories aren't backed up in backup-dir

2016-03-07 Thread Henri Shustak
Using the link-dest option would be one way to solve this. If you are seeking a backup system which uses hard links (link-dest), then you may wish to take a look at LBackup Hope this helps. This email

Re: OS X and rsync: unpack_smb_acl errors and --numeric-ids

2016-04-06 Thread Henri Shustak
> Submitted as bug: > https://bugzilla.samba.org/show_bug.cgi?id=10649 This bug has been stale for a while. In order to dive in and have a go at working out what is wrong and how to fix it ; is signing up with the samba bug tracker required? Probably will not have time to look at it immediately

Re: rsync with overlay tree

2016-04-09 Thread Henri Shustak
If you are looking at overlays specifically have you checked out RADMIND? http://rsug.itd.umich.edu/software/radmind/macosx.html Note : The link above is more specific to the MacOSX release but it is a good starting point Hope that helps!

Re: rsync failure on corrupted source data

2016-06-28 Thread Henri Shustak
+1 for ddrescue :) > https://www.gnu.org/software/ddrescue/ This email is protected by LBackup, an open source backup solution http://www.lbackup.org -- Please use reply-all for most replies to avoid omitting the mailing lis

Re: rsync: connection unexpectedly closed

2016-10-16 Thread Henri Shustak
>> Have you tried performing a copy to a known good local device? If a >> local copy fails, then I would start checking the file system of the >> source and also the hardware of that system. > > That's a good idea. I just tried that and it copied no problem. Do you have another system you could

Re: Robustness: sometimes write times after having renamed the temp file

2016-11-30 Thread Henri Shustak
I believe some work on this was happening at one point in rsync (not specific to OS X). In terms of your issues specifically, would the fuzzy option possibly help you? > --fuzzy find similar file for basis if no dest file Could you report if it makes a difference for your use case? --

Re: downloading only specific directories from directory tree

2017-01-22 Thread Henri Shustak
The following URL may also be helpful in terms of another example : http://www.lbackup.org/developer/advanced_excludes_file_examples Hope that link is helpful. HTRAX 2013 Revitalised : EGYPTIAN HUMP HTRAX : Direct URL download

Re: Huge directory tree: Get files to sync via tools like sysdig

2017-02-09 Thread Henri Shustak
As Ben mentioned, ZFS snapshots is one possible approach. Another approach is to have a faster storage system. I have seen considerable speed improvements with rsync on similar data sets by say upgrading the storage sub system.

Re: Huge directory tree: Get files to sync via tools like sysdig

2017-02-09 Thread Henri Shustak
That sounds like it certinally would not hurt! This email is protected by LBackup, an open source backup solution http://www.lbackup.org -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscri

Re: Another cygwin/rsync question

2010-01-18 Thread Henri Shustak
> I'ts a simplistic backup using rsync from a Windows 2k3 machine to a Linux > box out on the 'net, using pre-shared ssh keys. In this case I'm saving, > files belonging to various users, using the administrator account on the > windows machine and the destination is a normal user account and it

Re: rsync for mailbox backup

2010-02-05 Thread Henri Shustak
> > Am using rsync to mirror all mailboxes to a backup server. > I have configured rsync to run every 1 min. we have around 50 mailboxws for > now. You may want to consider that (depending on the systems) the rsync process may take more than 1 minute to finish. Rayn had a good suggestion rega

Re: rsync --link-dest, --delete and hard-link count

2010-02-05 Thread Henri Shustak
> > The fist backup is done to an empty destination. Than, each following backup > will be done to a freshly created empty dir with current date as name but > with --link-dest option pointing at the previous (latest) backup directory. LBackup also allows you quickly setup this kind of rotating ha

Re: rsync --link-dest, --delete and hard-link count

2010-02-08 Thread Henri Shustak
> Rsync would then need an extra option to enable it to report such > "deleted" files, because I sure don't need that nor do I need the extra > overhead that encurs. I agree. If deletion reporting is to become part of rsync (when invoked with the dest option --link-dest option), then I would su

Re: Rsync / ssh high cpu load

2010-02-17 Thread Henri Shustak
> Although there is a small version difference in the rsync versions, I would > say that this is caused by the cygwin layer. When using rsync over SSH you may find that the CPU load is substantial depending upon multiple factors including but not limited to your processor, disks and network. Ho

Re: old files not getting deleted

2010-02-18 Thread Henri Shustak
>> Maybe you are getting an I/O error. By default, rsync skips all >> deletion of destination files when it gets an I/O error on the source, >> to avoid erroneous deletion of destination files if the I/O error caused >> them to be omitted from the file list. (This is a very blunt measure >> and

--progress (without file names)

2010-02-25 Thread Henri Shustak
I am wondering if there is an option which is similar to --progress that will not display the file names. A percentage indicator would be fine. There is some related discussion at the following URL : http://lists.samba.org/archive/rsync/2004-March/008998.html Any replies regarding ways to ach

Re: Rsync copies all files, not just changed files

2010-03-01 Thread Henri Shustak
> I have a strange problem where rsync is copying over all files instead of > just the ones that have changed. If you examine a file at either end which is being re-copied are the permission and ownership settings for this destination file the same as the permission and ownership on the remote

Re: --progress (without file names)

2010-03-02 Thread Henri Shustak
>> I am wondering if there is an option which is similar to --progress >> that will not display the file names. A percentage indicator would be >> fine. > > See https://bugzilla.samba.org/show_bug.cgi?id=3784 . Thanks. -- Please use reply-all for most replies to avoid omitting the mailing list.

mkstemp error (only a problem with newer rsync versions)

2010-03-07 Thread Henri Shustak
The setup... Transport is via SSH. BoxA : Ubuntu 8.10 BoxB : Mac OS X 10.4.11 If I use rsync v2 to transfer data from BoxA to BoxB everything works fine. However, if I use rsync v3 to transfer the data, the following error is reported : rsync: mkstemp "

Re: Ignore files gone missing.

2010-03-21 Thread Henri Shustak
> Is there a way to have rsync not treat files that have gone > missing (e.g. Maildir messages that have been removed) as errors > while indicating I/O errors and such? http://www.samba.org/rsync/FAQ.html#10 - This email is pro

Re: osx 10.6 strange rsync errors

2010-04-07 Thread Henri Shustak
> Basically: the problem occurs backing up a directory to a local mounted > network volume. If you are using the -a flag then you may have problems preserving the permissions of files on the mounted network directory. This will greatly depend upon you or your users setup. Unfortunately, I do

Mac OS X "rsync: unpack_smb_acl: sys_acl_get_info(): Unknown error: 0 (0)"

2010-04-08 Thread Henri Shustak
I am a developer on the LBackup project. An LBackup user recently posted a question to the mailing list asking about the following error. > "rsync: unpack_smb_acl: sys_acl_get_info(): Unknown error: 0 (0)" Link to thread :

Re: Mac OS X "rsync: unpack_smb_acl: sys_acl_get_info(): Unknown error: 0 (0)"

2010-04-09 Thread Henri Shustak
> Link to thread : > Looks like the mailing list (maybe just the mail-archive) broke the link. Please find a link below that should work : http://tinyurl.com/lbackup-post-2010-April-10th

Re: Mac OS X "rsync: unpack_smb_acl: sys_acl_get_info(): Unknown error: 0 (0)"

2010-04-09 Thread Henri Shustak
I have further information regarding the version and the way rsync on these systems was compiled. Installation and compilation was performed by using the following instructions : I have reproduced this issue (no file path reported) with rsync 3.0.7. P

Re: Mac OS X "rsync: unpack_smb_acl: sys_acl_get_info(): Unknown error: 0 (0)"

2010-04-11 Thread Henri Shustak
Description of problem : On a Mac OS X system when rsync attempts to preserve ACL's for a user who is not on the system for a file system object, there is no report of which directories/file(s) were unable to have the ACL's preserved. Procedure to reproduce the proble

Re: Mac OS X "rsync: unpack_smb_acl: sys_acl_get_info(): Unknown error: 0 (0)"

2010-04-14 Thread Henri Shustak
>> An LBackup user recently posted a question to the mailing list asking about >> the following error. >> >>> "rsync: unpack_smb_acl: sys_acl_get_info(): Unknown error: 0 (0)" > >> Is it possible to place a feature request to have the error reported >> by rsync also list the path to the problema

Re: include/exclude Problem

2010-04-27 Thread Henri Shustak
> I want to sync /etc /home and /usr/local (and all files/dirs beneath) to > REMOTEHOST:/dest > There are some huge files in /home which I want to exclued > > I have set up an include/exclude file but I still get too much files. Also > the excluded file is synced > > /usr/bin/rsync -av --exclud

Re: Rsync on a single server

2010-04-28 Thread Henri Shustak
>> I seem to have been successful in copying files from one of the domains to >> the other using the following: >> rsync -auvn /path/to/source/directory /path/to/destination/directory >> >> I can only assume everything new/changed was copied as I now need the mysql >> database copied from one doma

Re: Rsync on a single server

2010-04-28 Thread Henri Shustak
>>> I seem to have been successful in copying files from one of the domains to >>> the other using the following: >>> rsync -auvn /path/to/source/directory /path/to/destination/directory >>> >>> I can only assume everything new/changed was copied as I now need the mysql >>> database copied from on

Device not configured (explanation)

2010-04-29 Thread Henri Shustak
I am involved with the development of LBackup Recently there was a post to the lbackup-dicussion mailing list. Within the post they reported the following error: > rsync: read > "/Volumes/Drobo_HD/lbackups/theserver.Ho

Re: Device not configured (explanation)

2010-04-30 Thread Henri Shustak
> As you might have guessed, that error is coming from the filesystem and > is not rsync's fault; copying the file with cp should have similar > chances of incurring the error. The symbolic name for errno 6 is ENXIO, > and the Mac OS X read(2) man page documents two cases in which it > occurs: >

Re: command line to backup my documents to external drive

2010-05-15 Thread Henri Shustak
> I'm really confused with all the examples out there and all different types > of incremental backups. I tried several scripts but cannot reduce the size of > my backup folders. What I want is to backup my documents to my external drive > every month and save as much disk space as possible. >

Re: Simple whole volume copy

2010-05-26 Thread Henri Shustak
> I have a volume at 192.168.0.2 on my local network. I'd like to rsync the > entire volume to a backup volume, skip all files already present on the > backup volume (same name and the same or earlier timestamp) Firstly, I would recommend that on both machines you compile and install a copy of t

Re: Simple whole volume copy

2010-05-26 Thread Henri Shustak
> same name and the same or earlier timestamp Would you please provide some clarification on your desired result in the following situation. file_a : /Volumes/src/file.txt file_b : /Volumes/dst/file.txt If file_b has a newer modification time than file_a will you want file_a to overweight fil

Re: Simple whole volume copy

2010-05-26 Thread Henri Shustak
> Right. That's why I need rsync. I'm really not looking for a utility, but a > command line program which will do incremental backup, and rsync is the only > one I'm aware of that does that in Mac OS. There are also some other options available. Although, I have not tested them on Mac OS X 10.6.

Re: Simple whole volume copy

2010-05-27 Thread Henri Shustak
> Sorry, I'm only going to be doing this a single time. I don't really need a > script, just a simple command I urge to to read this great write up "Cloning Mac OS X disks" by Mike Bombich : If you have access to a test computer system running Mac

Re: Simple whole volume copy

2010-05-27 Thread Henri Shustak
> Sorry, I'm only going to be doing this a single time. I don't really need a > script, just a simple command which will preserve all the flags. Also, another question, what kind of data is on this volume that you are backing up? -- This email is protected by

Re: where is backup-dir rooted?

2010-06-22 Thread Henri Shustak
> [What I am trying to achieve is to backup (part of) my home directory to a > backup server such that > > a) I have a reasonably up to date (within a day if I do it overnight) of my > current state > b) If I have deleted or updated a file the old version of it gets placed into > a special "sn

Re: few questions on rsync

2010-06-22 Thread Henri Shustak
> Reversing --backup logic: > Currently, if --backup is used (and --backup-dir), a copy of existing > file that is replaced on rsync will be placed there. Is there a way to > keep original copy (ie. base) the same, but just place whatever has > changed to a different location? Taking "backup to a

Re: --recursive and -H

2010-06-28 Thread Henri Shustak
> Aaah, thanks for the insight. RSYNC must transfer the file regardless of the > link count, but it also takes note of the missing link. So, it probably > considers an inode with multiple links "resolved" only after it finds a > brother/sister link and deletes the duplicate. You may also be i

Re: Rsync backup issues using relative paths and LVM snapshots

2010-07-15 Thread Henri Shustak
> I really want to put the logic in the script so it is easy to bring another > backup location online easily. If you have shell access to the destination system from your backup script then one option may be to issue 'mkdir -p' via ssh. > Creating the directories manually on the destination s

Re: Rsync backup issues using relative paths and LVM snapshots

2010-07-15 Thread Henri Shustak
> Below is a link to a script (which currently only supporting Mac OS X) which > will synchronize a sparse bundle image to a remote server. Sorry I forgot the link in the previous email. - http://www.lbackup.org/synchronizing_disk_images_between_machines Finally, yes I would be very interes

Re: --compare-dest weirdness

2010-07-19 Thread Henri Shustak
> Hi All, > > I am writing a backup program for my computer. brief outline is as follows. > > Running ubuntu 10.04 > 2 main partitions, / and /home, both ext3. 1 external usb hdd, ext3, > mounted to /backups/main. > once every couple of days, rsync backs up, using following command, > everything

Re: Rsync backup issues using relative paths and LVM snapshots

2010-07-19 Thread Henri Shustak
>> I did think about remotely executing a mkdir before the backup, but one >> blocker is that I will be using Thecus NAS boxes as some off-site locations >> and I don't have shell access. > > You could mkdir the directory locally somewhere (anywhere), and rsync > just that directory to the remot

Re: --compare-dest weirdness

2010-07-19 Thread Henri Shustak
> interestingly, i tried to see if something was wrong with my statments by > doing: > mkdir ~/rsynctest/dir1 > mkdir ~/rsynctest/dir2 > mkdir ~/rsynctest/dir3 > > nano ~/rsynctest/dir1/file1 (wrote the line hello world and saved) > nano ~/rsynctest/dir1/file2 (wrote the line hello and saved) >

Re: Rsync sequence

2010-07-20 Thread Henri Shustak
> Can I just list them one after the other like so in crontab -e You may wish to also consider using a single rsync command : rsync -auv --delete \ /Godfather/Documents \ /Godfather/Setups \ /Godfather/Pictures \ /Godfather/Backups \ /Godfather/Videos \ /Backup # backup destination With this app

Re: --compare-dest weirdness

2010-07-20 Thread Henri Shustak
> the -i shows that most are being copied due to time differences, so in > theory -t should work? This does in fact work on a little test setup > on my work laptop, i will test it properly when i get home tonight. I am glad that the -t option is working with your test. If you decide to use LBa

Re: How to block this fiel name from being transfered via rsync?

2010-07-21 Thread Henri Shustak
>> Are you specifying this lines in an excludes file? >> > yes -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: rsync algorithm

2010-07-22 Thread Henri Shustak
>> Check file size makes sense, but how rsync checks times? If a file is >> copied from one side to another remote side, the time will be >> different, right? > > Sorry wrong question, the copy file should be able to reserve the mtime. If the rsync --times option is used then rsync will attempt

Re: Ignoring "file has vanished" errors?

2010-07-24 Thread Henri Shustak
> Is it possible to have rsync ignore 'file has vanished' errors and not > return an error on exit? > > I have a backup script that utilizes rsync, and based on the return > code determines whether the backup was successful. Postfix queue files > and user maildir files being deleted during the bac

Re: Getting rsync to store timing information in its logs

2010-07-27 Thread Henri Shustak
> Is there a way to know from the rsync logs how long it took to do a backup? > > The only timing info,. I see is this at the end: > > sent 3067328 bytes received 7853035429 bytes 1187888.83 bytes/sec > total size is 1559866450336 speedup is 198.55 The latest alpha release of LBackup support

Re: IO error causing file deletion failure?

2010-08-07 Thread Henri Shustak
> readlink_stat("/home/morgan/.gvfs") > failed: Permission denied (13) I believe the error above is a problem with the rsync user not being able to read the file "/home/morgan/.gvfs". I suggest that you check the permissions on this file and also check that the sudo command is in fact grantin

Re: HDB, a hard drive backup program

2010-08-11 Thread Henri Shustak
> Hey all, I'm writing a tool: > > http://www.subspacefield.org/security/hdb/ This is an interesting approach. I look forward to seeing the project develop. Thanks for the link. -- This email is protected by LBackup http://www.lbackup.org -- Please use repl

Re: backup option

2010-08-11 Thread Henri Shustak
> I am using rsync to backup files. Is it possible to specify an option > not to delete files from backup directory if the files are deleted > from source? In that way, I can always keep something I may or may not > need in the backup disk, but remove it from a work computer. As Alex mentioned the

Re: Scripting rsync against a filesystem with a quota

2010-08-15 Thread Henri Shustak
>> On another note I'm getting an error: >> >> copyfile(.._..v6AxMh,./., COPYFILE_UNPACK) failed:13 >> >> When trying to run with -E. > > Upstream rsync has no such error message. If you're using the > Apple-modified rsync, we don't support it here. You may wish to compile a version of rsync

Re: DO NOT REPLY [Bug 7629] New: Blank filter file option to ignore whole directory

2010-08-18 Thread Henri Shustak
> I know that there are external ways to do this, but I thought it would be > fastest and best as an rsync feature. I've been using rsync for a while now in > some fairly advanced backup schemes and I'm extremely impressed by it. I was > thinking it would be quite helpful if there were an option to

Re: OSX 10.6.4 error with -R option

2010-09-02 Thread Henri Shustak
>> I have had reports of problems with the -R option on OSX 10.6.4. >> >> Just tested it myself and found this odd result: >> >> When I run this >> >> "dtruss -f path/to/rsync -aHAXNR --fileflags --force-change >> --protect-decmpfs --stats -v /Users/astrid/Documents/main.m >> /Users/astrid/

Re: compare a directory with itself -- differences found

2010-09-02 Thread Henri Shustak
> well, when I tell rsync to compare my home directory with itself, it reports > many differences. > > I'm using rsync version 3.0.7 protocol version 30. > > I was hoping to use it to verify my backup. What kind of differences are reported. Also are you using the the --check-sum option for

Re: compare a directory with itself -- differences found

2010-09-02 Thread Henri Shustak
I think an important question is what kind of differences do you need to check with regards integrity of your copy / backup? In addition, I suggest that you actually use rsync to copy the data to a separate directory and then compare two different directories. The reason I suggest this is beca

Re: Options to copy modified files

2010-09-05 Thread Henri Shustak
> We use rsync to copy files and directories from one server to the other. What > options should I give to rsync so that it only copies the modified files? For > example server1 may contain a dir which contains just one file that has been > modified, how do I get rsync to copy just that one fil

Re: Backing up a stand alone system to a usb drive with rsync

2010-09-09 Thread Henri Shustak
> >> I have a stand alone system with two drives / and /home on one and /var >> on the the other. I'd like to backup the complete system to a usb drive. >> I've tried dd however since it copies over everything, even empty space >> it didn't seem very practical since for instance root only has 10Gi

Re: Intermittent rsync Issues

2010-09-15 Thread Henri Shustak
> I posted this to a couple online forums already am am already doubting anyone > will be able to directly help me solve my problems. So I am here to query > the experts directly: > I have a number of rsync clients trying to connect to an rsync server > routinely, and they're intermittently fa

Re: How to mirror only specified directories

2010-09-28 Thread Henri Shustak
> I'm still struggling to get just the directory(ies) that I want... You may find this post to the LBackup mailing list helpful. The example listed (link above) revolves around specifying the root directory as the source and then specifying a

Re: rsync as a deliberately slow copy?

2010-09-29 Thread Henri Shustak
>> I'm looking for a way to deliberately copy a large directory tree >> of files somewhat slowly, rather than as fast as the hardware >> will allow. > Just do it to localhost - that way it's still a network connection, and > you can use "--bwlimit". Also, you could try "nice" to lower the > prior

Re: How to mirror only specified directories

2010-10-01 Thread Henri Shustak
>> I'm still struggling to get just the directory(ies) that I want... > > You may find this post to > the LBackup mailing list helpful. > > The example listed (link above) revolves around specifying the root directory > as the source and then

Re: [Bug 3653] Reduce the need for the "vanished files" warning

2010-10-03 Thread Henri Shustak
> Doing nightly backups from cron is an *extremely* common use-case of rsync, > and > telling each and every user of rsync that they should either A) write their > own > shell script to filter and discard error messages, or B) play a constant game > of whack-a-mole chasing down new --exclude opt

Re: Writing to the wrong directory

2010-11-29 Thread Henri Shustak
Hello, Recording the output (standard error and standard out) to a log file will help with investigating this issue if it is reproducible. Perhaps another person on this list will provide a better suggestion. In addition, perhaps adding some additional debugging information before and after th

Re: Simple Question

2010-12-08 Thread Henri Shustak
> I have been using rsync on my laptop for some time to safeguard an > extensive image collection. > My usage has been: .. rsync -av --delete ~/Pictures /media/disk > I have found this exceptionally fast ... just as advertised! > > I now have set up a new computer system where I want to back up my

Re: Disk image with rsync/rsnapshot

2011-01-18 Thread Henri Shustak
> I want to make a full disk image backup of my disk with rsnapshot/rsync that > I can restore on a new disk. > Part of my /etc/rsnapshot.conf looks like follows: > > exclude /proc > exclude lost+found > exclude /media > exclude /sys > exclude /dev > exclude /tmp > exclude /dev >

Re: Protocol stream error on extended attribute, silent failure to copy all attributes

2011-02-02 Thread Henri Shustak
> I'm using rsync 3.0.7 on Mac OS X 10.6, compiled according to Mike > Bombich's instructions at http://www.bombich.com/rsync.html. Rsync > repeatedly exits with a protocol data stream error when trying to copy > some com.apple.FinderInfo extended attributes. While testing this issue, > I found th

rsync not reporting diskfull error

2011-02-05 Thread Henri Shustak
I am involved with the development of lbackup. This message to the rsync mailing list is related to the following thread on the lbackup-disccussion mailing list : http://tinyurl.com/lbackup-discussion-diskfull Essentially, I am curious to if any one using rsync 3.0.7 on Mac OS (10.6) Server has

Re: rsync not reporting diskfull error

2011-02-09 Thread Henri Shustak
> If pushing data (e.g. a local copy or copy from local to remote), there is a > failure where the receiver can try to report an error, die, and the sender > gets the error trying to write to the receiver before it gets the error > message from "around the horn" (it would have gone to the gener

Re: Incremental backup with only delta into a separate file.

2011-02-09 Thread Henri Shustak
> Is there anyway in which i can have only the delta of the original file be > present at the backup location. > something like > 1. 1st backup is 100M > 2. write 20MB to the original file > 3. do a sync using hardlinks > 4. i have 20MB file at backup location with the delta changes only. Pr

Re: files not moved immediately to final destination from temp location after rsync returns with success

2011-04-20 Thread Henri Shustak
> I am using rsync version 3.0.7 on an arm linux based embedded device. The > device pulls data periodically from a rsync server and stores the files on an > SD card. The partial, temp and final rsync destinations all reside on the SD > card. > > I came across an issue where it seems that the

Re: thank you wayne, andrew, paul and everyone else

2011-04-30 Thread Henri Shustak
+2! :) -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: Being VERY careful while using the --delete option

2011-05-12 Thread Henri Shustak
> On UNIX, I am executing an rsync command, from within a script. The command > goes something like this: > > /usr/bin/rsync --verbose --progress --stats --compress --recursive --times > --perms --links --safe-links source_dir/ > user@target_machine:/parent_path/source_dir > > In other w

Re: Using rsync as an incremental backup

2011-06-26 Thread Henri Shustak
> I'm using rsync to do an incremental backup of my desktop here, to a > remote server as follows: > > #/usr/bin/bash > > old=$(date -d 'now - 1 week' +%Y-%m-%d) > new=$(date +%Y-%m-%d) > > rsync -avP --delete --link-dest=../$dir /home/bakers > bak...@perturb.org:/home/bakers/backup/$new/ > >

Re: Brandysnap -- a new rsync-based snapshot management script

2011-07-03 Thread Henri Shustak
Hi Chris, > https://github.com/StarsoftAnalysis/brandysnap I am involved with the LBackup project. Would you be okay with a link being generated to the Brandyon github page from the LBackup alternatives page? Depending upon the license you release Brandysn

Re: Brandysnap -- a new rsync-based snapshot management script

2011-07-04 Thread Henri Shustak
>> Hi Chris, >> >>> https://github.com/StarsoftAnalysis/brandysnap >> >> I am involved with the LBackup project. Would you be okay with a link being >> generated to the Brandy on github page from the LBackup >> alternatives page? > > Yes, that would be gre

Re: rsync and encryption

2011-09-04 Thread Henri Shustak
>> Which operating system are you running on the system which currently has >> your personal documents? >> > > Ubuntu/Debian Do you know if there is a virtual file system encryption system which breaks the data into bands? I know that Mac OS X has support for breaking an encrypted disk image

Re: [Bug 8456] improve --link-dest bahaviour

2011-09-18 Thread Henri Shustak
> In general - --link-dest works as expected *only*, if the destination > directory > is empty. Going along with this idea of ensuring the destination directory is empty. LBackup is a rsync backup wrapper system which may be of assistance in this regard. ---

Re: [Bug 8450] New: --link-dest seems not to work mounted NTFS file systems

2011-09-18 Thread Henri Shustak
Just to clarify, Is the destination file system NTFS? Also, is this storage directly attached or is it mounted via the network? Finally, you mentioned it is mounted read-only would you please clarify why the drive you are writing to is mounted in this way? Thanks. Henri -

Re: [Bug 8456] improve --link-dest bahaviour

2011-09-18 Thread Henri Shustak
> I'd like to use rsync as an efficient (== do not store the same file twice at > the backup media) backup solution. The backup should be made into N remote > directories (rotating each day) _without_ the need to delete the remote > directory before. This is essentially, what LBackup is doing. Ho

Re: Estimating backup usage with dir-merge filter

2011-10-06 Thread Henri Shustak
>> It sounds like you missed the point of Kevin's message (in the other fork of >> this thread). The point wasn't to use >> `du`, it was that you can run your stats against the backed-up files, not >> the source. Then you're only running stats >> against the results of running the backup using

Re: With rsync --link-dest, is it possible to determine which files are new?

2011-10-23 Thread Henri Shustak
> SHA1 You may also find fingerprint to be a useful tool. However, it will require ruby. --- This email is protected by LBackup http://www.lbackup.org -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: h

Re: rsync connection/transfer error

2011-10-26 Thread Henri Shustak
Hello, Is your output on this problematic network similar to the following : $ telnet mirrors.usc.edu 873 Trying 68.181.195.4... Connected to hpc-mirror.usc.edu. Escape character is '^]'. @RSYNCD: 30.0 Also, what happens if you add -n (--dry-run) to the following command : > rsync -artv rsync:/

Re: rsync connection/transfer error

2011-10-26 Thread Henri Shustak
Hello, It seems that the issue is todo with the network. However, I would suggest you try with a different computer system to be sure. Additional notes follow : -- > server: iperf -s -D -p 873 > (problematic network) client: iperf -c iperf.server.com -L 873 > >

  1   2   >