Re: Bug when using rsync -r --delete -b --backup-dir

2021-01-02 Thread Henri Shustak via rsync
You may wish to take a look at LBackup : http://www.lbackup.orgPlease note as one of the developers I am biased.On 24/11/2020, at 10:33 AM, CRTS via rsync wrote:Consider following directory structure:mkdir -p src/empty tgt bkpwhen making an initial backup withrsync -r src/ tgtthen the empty direct

Re: RAM speedup

2020-07-01 Thread Henri Shustak via rsync
You may need a lot of ram. Take a look at how much RAM ZFS needs to operate well. Henri > On 27/06/2020, at 7:58 AM, Rupert Gallagher via rsync > wrote: > > Hello, > > As disks are slow and rsync reads and writes so much that for the bus this is > the equivalent

Re: RAM speedup

2020-07-01 Thread Henri Shustak via rsync
Not sure if it is useful. Will put a plug in for a rsync hard based backup system primarily focused on macOS. If it is speed you are after, then this is probably not the right / helpful tool. But feel free to pick out what ever is useful for you : http://www.lbackup.org Henri > On 29/06/2

Re: osx permission issue

2020-05-13 Thread Henri Shustak via rsync
If you are talking about SIP, then at present SSH will have full disk access (as much as it can) by default. Take a look at this LBackup page which discusses this in more detail : http://www.lbackup.org/developer/dealing_with_sip Hope that helps. -- Please use reply-all for most replies to

Re: Advanced rsync includes and excludes

2019-10-09 Thread Henri Shustak via rsync
t; + private/var/*** > + home/*** > - * Henri > I'm a happy camper @ rsync (and rsnapshot) since years. Thanks for this major > piece of software. > > In an attempt to reorganize my rsnapshot backups, I stumbled across an issue, > that I'm trying to seeking a m

Re: rsync many processes and slow backup

2019-10-09 Thread Henri Shustak via rsync
://www.lbackup.org There is even a pre-script you can enable (in the example resources) so that the script can run a maximum of once a day / once a month etc (even if you start it many times from cron. Hope you have it all working now :) Henri >> Hi all! :-) >> >> I have a small rsync scri

Re: Huge directory tree: Get files to sync via tools like sysdig

2017-02-09 Thread Henri Shustak
That sounds like it certinally would not hurt! This email is protected by LBackup, an open source backup solution http://www.lbackup.org -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscri

Re: Huge directory tree: Get files to sync via tools like sysdig

2017-02-09 Thread Henri Shustak
As Ben mentioned, ZFS snapshots is one possible approach. Another approach is to have a faster storage system. I have seen considerable speed improvements with rsync on similar data sets by say upgrading the storage sub system.

Re: downloading only specific directories from directory tree

2017-01-22 Thread Henri Shustak
The following URL may also be helpful in terms of another example : http://www.lbackup.org/developer/advanced_excludes_file_examples Hope that link is helpful. HTRAX 2013 Revitalised : EGYPTIAN HUMP HTRAX : Direct URL download

Re: Robustness: sometimes write times after having renamed the temp file

2016-11-30 Thread Henri Shustak
I believe some work on this was happening at one point in rsync (not specific to OS X). In terms of your issues specifically, would the fuzzy option possibly help you? > --fuzzy find similar file for basis if no dest file Could you report if it makes a difference for your use case? --

Re: rsync: connection unexpectedly closed

2016-10-16 Thread Henri Shustak
>> Have you tried performing a copy to a known good local device? If a >> local copy fails, then I would start checking the file system of the >> source and also the hardware of that system. > > That's a good idea. I just tried that and it copied no problem. Do you have another system you could

Re: rsync failure on corrupted source data

2016-06-28 Thread Henri Shustak
+1 for ddrescue :) > https://www.gnu.org/software/ddrescue/ This email is protected by LBackup, an open source backup solution http://www.lbackup.org -- Please use reply-all for most replies to avoid omitting the mailing lis

Re: rsync with overlay tree

2016-04-09 Thread Henri Shustak
If you are looking at overlays specifically have you checked out RADMIND? http://rsug.itd.umich.edu/software/radmind/macosx.html Note : The link above is more specific to the MacOSX release but it is a good starting point Hope that helps!

Re: OS X and rsync: unpack_smb_acl errors and --numeric-ids

2016-04-06 Thread Henri Shustak
at it immediately. Just (A) pinging the bug and (B) wondering how patches are submitted or if there is a patch already in existance? Thanks Henri InstallPKG, an open source installation system. Install multiple apple .pkg and .mpkg fil

Re: Empty directories aren't backed up in backup-dir

2016-03-07 Thread Henri Shustak
Using the link-dest option would be one way to solve this. If you are seeking a backup system which uses hard links (link-dest), then you may wish to take a look at LBackup Hope this helps. This email

Re: Verifying backups

2016-03-07 Thread Henri Shustak
Just chiming in slightly off topic. As a first step if you are going to be backing up files to some media with a computer it would be a really good idea to ensure, that the hardware being used is not faulty. I am not saying that your hardware is faulty. However, it would be worth checking this

Re: Recycling directories and backup performance. Was: Re: rsync --link-dest won't link even if existing file is out of date (fwd)

2015-04-16 Thread Henri Shustak
> How do you handle snapshotting? or do you leave that to the block/fs > virtualization layer? I am guessing this question is directed at me. Firstly, when I used the word snapshot, I was referring to the snapshot in the LBackup context. It is outlined at the following page

Re: Recycling directories and backup performance. Was: Re: rsync --link-dest won't link even if existing file is out of date (fwd)

2015-04-16 Thread Henri Shustak
> Our backup procudures have provision for looking back at previous > directories, but there is not much to be gained with recycled directories. > Without recycling, and after a failure, the latest available backup may not > have much in it. Just wanted to point out that LBackup has a number o

Re: rsync --link-dest won't link even if existing file is out of date

2015-04-14 Thread Henri Shustak
> Ill take a look but I imagine I cant backup the 80 Million files I need > to in under the 5 hours i have for nightly maintenance/backups. Currently > it's possible by recycling directories... To cover that many files in that much time you will require a high speed system. Just another thought. P

Re: rsync --link-dest won't link even if existing file is out of date

2015-04-14 Thread Henri Shustak
Hi Ken, You may wish to take a quick look at LBackup (disclaimer I am a developer on this project) which is a wrapper to rsync ; designed for reliable user data backups. LBackup always starts a new backup snapshot with an empty directory. I have been looking at extending --link-dest options t

Re: rsync to multiple destinations

2015-02-01 Thread Henri Shustak
>> I am looking for a way to start one rsync command with multiple destinations. >> My use case: >> I have one (slow) usb drive which should be synced to two other >> harddrives. It would be great if rsync could read one file which is to >> be copied to both hard drives only once, so the slow usb c

Re: rsync with 8bit file names?

2014-09-18 Thread Henri Shustak
>>> When trying to sync my TV folder to a mirror drive, episodes with non-ASCII >>> characters in them cannot be processed by rsync. Anything I can do about >>> this? >> >> (Q1) What do you mean by a mirror drive? Is this a RAID1 external enclosure >> or some sort of softRAID? Or is it just a c

Re: rsync with 8bit file names?

2014-09-17 Thread Henri Shustak
Hello again, Three further questions : (Q2-1) Have you tried this same setup when booted from another OS (e.g. 10.9)? (Q2-2) Have you tried this using some other hardware? (Q2-3) Have you tried coping this specific file over using the Finder (say to the Desktop) and then using rsync to copy it

Re: rsync with 8bit file names?

2014-09-17 Thread Henri Shustak
> When trying to sync my TV folder to a mirror drive, episodes with non-ASCII > characters in them cannot be processed by rsync. Anything I can do about this? (Q1) What do you mean by a mirror drive? Is this a RAID1 external enclosure or some sort of softRAID? Or is it just a copy of the TV fol

Re: rsync with 8bit file names?

2014-09-11 Thread Henri Shustak
by LBackup, an open source backup solution. http://www.lbackup.org On 12/09/2014, at 12:40 PM, LuKreme wrote: > On 11 Sep 2014, at 16:22 , Henri Shustak wrote: >> Guessing the source drive is formatted HFS+ or HFS+J. > > The source drive is a Drobo. The destination i

Re: rsync with 8bit file names?

2014-09-11 Thread Henri Shustak
Hello, Guessing the source drive is formatted HFS+ or HFS+J. What is the file system on the destination drive? I know that rsync is capable of correctly coping over file and folder names on Mac OS X which contain non-ASCII characters. Hence my question relating to the destination file system?

Re: Backup scripts

2014-09-09 Thread Henri Shustak
Hello, The --link-dest approach is the way LBackup works and this is also what allows the lcd command (part of LBackup) to move you back and forth in time while you remain in the same directory relative directory. This makes finding a particular data quite easy during a partial restore. In par

Re: Backup scripts

2014-09-04 Thread Henri Shustak
Hello, You may want to check out the LBackup source code as a possible starting point if you are looking to create your own customised backup script : http://www.lbackup.org/source Disclaimer : I am involved with the development of LBackup. -

Re: Beating a dead horse

2014-04-03 Thread Henri Shustak
> Every year or two I get stuck on this same problem involving > excluding. This reply assumes that you would like to backup specific directories via the excludes file, which is believe is what you are attempting to accomplish. Take a look at the information at the following URL : http://www.l

Re: silent data corruption with rsync

2014-03-13 Thread Henri Shustak
> Anyway, if "They" care about their data , "They" use checksumming for storing > their data on disk, do "They" ? ;) silent bitrot on disks _does_ happen I totally agree. Storage devices fail and if you need to know if the data is the same then a checksum is your best bet. If you want to do you

Re: Contents of rsync digest

2014-02-18 Thread Henri Shustak
> When I try to run a scheduled backup I get the following error: > > Error in socket I/O (code 10) > > How do I fix this error? Are you connecting to a remote system to pull or push data? If so are you able to ping the remote system or connect to that system on the specified port using telne

Re: Bugg when using Extended Attributes flag -X

2014-02-10 Thread Henri Shustak
ly the initialisation scripts could eventually extend well beyond the scripting subsystem and into other areas in order to simplify the setup monitoring and verification of backups on multiple servers. Hope this helps. Henri This

Re: need help with an rsync patch

2013-08-27 Thread Henri Shustak
> The solution is not to refuse to backup any file that is a hard link. > There are legitimate reasons to have hard links and ignoring them > means you aren't backing up everything. I agree that preserving hard links may be important in some situation. There are certainly legitimate reasons to p

Re: Password from the stdout

2013-06-11 Thread Henri Shustak
> Use an ssh key instead. To get started, the following URL offers introductory information : http://www.lbackup.org/network_backup#creating_ssh_keys_for_testing Hope this helps. - This email is protected by LBackup, an open s

Re: rsync 3.0.9 partial file left after CTRL-C WITHOUT using --partial

2013-04-06 Thread Henri Shustak
9 > (compiled from source) or 2.6.9 (default on 10.8.2). Output from the testing > I performed is below. > > >> >> ╭─henri@mac /tmp/test_rsync_2.6.9_osx/src ‹› 13-04-07 - 0:41:08 >> ╰─$ dd if=/dev/urandom of=source_file bs=10 count=1 >> 1+0 records i

Re: rsync 3.0.9 partial file left after CTRL-C WITHOUT using --partial

2013-04-06 Thread Henri Shustak
Hello, I was unable to reproduce this issue on an OS X system with rsync 3.0.9 (compiled from source) or 2.6.9 (default on 10.8.2). Output from the testing I performed is below. > > ╭─henri@mac /tmp/test_rsync_2.6.9_osx/src ‹› 13-04-07 - 0:41:08 > ╰─$ dd if=/dev/urandom of=sourc

Re: Is there a howto/tutorial on backups/rsync that covers the use of hard and soft links?

2013-01-31 Thread Henri Shustak
You may be interested in having a look at LBackup , an open source (released under the GNU GPL) backup system. Essentially, LBackup is a wrapper for rsync. If you are working on your own script. Feel free to look at how LBackup works (primely written in bash at present)

Re: Time rsYnc Machine (tym)

2012-08-01 Thread Henri Shustak
> Push is when you run your backup program (rsync and whatever script) > on the machine being backed up and you push/upload your data to the > backup system. > > Pull is when you run your backup program on the backup system and > pull/download the data from the machine being backed up. You may al

Re: rsync based on checksum only

2012-07-07 Thread Henri Shustak
> Wow! Thanks for making it so easy. I will try that asap. If you do not have any luck with the patched version of rsync there are various projects which spring to mind which offer this kind of functionality. However, I would suggest that rsync is the most stable project I have ever seen fo

Re: BDsync: Block Device sync

2012-06-29 Thread Henri Shustak
> I'm sure I'm replicating a moment in time like someone pulled the power plug. > I assume that the VM's can recover from that. Maybe... It will depend what you are backing up. Some things may be fine with having the power plug pulled out, while others may not. I would not count on it just be

Re: [Bug 8712] --link-dest doesn't work if target file exists (but needs updating)

2012-05-28 Thread Henri Shustak
> I'm also hit by this issue. Is there any prediction as to whether and, if so, > when something is going to happen? :) Until such time as the situation with --link-dest changes consider syncing into an empty directory (if at all possible). If you are using rsync for backup then you may wish

Re: --link-dest isn't linking

2012-04-22 Thread Henri Shustak
> rsync -Ha --link-dest=/media/4tb/bak/panic-2012-01-01 > /media/2tb/bak/panic-2012-02-01 /media/4tb/bak/ It seems that you may be attempting to hard-link between two file systems. One is mounted as "/media/4tb" the other is mounted as "media/2tb". My understanding is that it is not normally

Re: --link-dest doesn't work if target file exists (but needs updating)

2012-01-22 Thread Henri Shustak
> On 12-01-20 06:01 PM, Kevin Korb wrote: >> Someone has requested it: >> https://bugzilla.samba.org/show_bug.cgi?id=7870 > > I'm not really sure that is the same bug. Maybe it is. Not convinced > though. I guess I can file my own bug and ask 7870's OP to see if it's > the same issue. > >> Bu

Re: securing rsync backup solutions?

2011-12-28 Thread Henri Shustak
> - - laptop-to-server: the laptop tends to roam a lot, network conditions > vary from place to place, and the rsync will be initiated manually, so > it is likely to be a `push' operation, the ssh keys will definitely need > to be encrypted and unlocked manually, but even with that security, I > w

Re: Raise an error if file exists on destination

2011-12-15 Thread Henri Shustak
> I am trying to use rsync to copy files from several origins to a single > destination. I would like to detect when a file gets overwritten because it > is present with the same relative path/name in several origins: > > > Origin1: > foo/bar.txt > > Origin2: > foo/bar.txt > > Destination aft

Re: Mac OS X : "get_xattr_names: llistxattr("some/path/here", 1024) failed" error

2011-12-14 Thread Henri Shustak
> Hi, > > I'm trying to make a small script to get rid of Apple's TimeMachine. The aim > is to backup the files of my company. > I setup a MacMini with a lot of storage attached to it. The MacMini connects > every once in a while to our data server (XServe) through SSH and pulls the > files th

Re: [Bug 8566] Spotlight comments (extended attributes) are not synced

2011-12-03 Thread Henri Shustak
> I downloaded 3.0.9 source + patches, patched in the 2 patches: > patch -p1 patch -p1 And although running with the appropriate arguments (as in the original > report), the comments still do not get synced! > > Help please! I believe this issue has been previously mentioned. I do not remember

Re: Replacing rsync on OSX servers.

2011-11-21 Thread Henri Shustak
> Having built and tested 3.0.7 and ready to send it out into production, can > anybody point me to 'best practices' for updating the binary and man pages > and other issues around upgrading from the dodgy v2.6.9 that ships with > late-10.4-thru-10.7? You could use /usr/local/bin as the instal

Re: Strange bug (buffer overflow) happening only under cron

2011-10-30 Thread Henri Shustak
Hi Pedro, > Mmh, I put uname -a into the cron job and it says: > > core file size (blocks, -c) 0 > data seg size (kbytes, -d) unlimited > file size (blocks, -f) unlimited > max locked memory (kbytes, -l) unlimited > max memory size (kbytes, -m) unli

Re: rsync connection/transfer error

2011-10-26 Thread Henri Shustak
Hello, It seems that the issue is todo with the network. However, I would suggest you try with a different computer system to be sure. Additional notes follow : -- > server: iperf -s -D -p 873 > (problematic network) client: iperf -c iperf.server.com -L 873 > >

Re: rsync connection/transfer error

2011-10-26 Thread Henri Shustak
Hello, Is your output on this problematic network similar to the following : $ telnet mirrors.usc.edu 873 Trying 68.181.195.4... Connected to hpc-mirror.usc.edu. Escape character is '^]'. @RSYNCD: 30.0 Also, what happens if you add -n (--dry-run) to the following command : > rsync -artv rsync:/

Re: With rsync --link-dest, is it possible to determine which files are new?

2011-10-23 Thread Henri Shustak
> SHA1 You may also find fingerprint to be a useful tool. However, it will require ruby. --- This email is protected by LBackup http://www.lbackup.org -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: h

Re: Estimating backup usage with dir-merge filter

2011-10-06 Thread Henri Shustak
>> It sounds like you missed the point of Kevin's message (in the other fork of >> this thread). The point wasn't to use >> `du`, it was that you can run your stats against the backed-up files, not >> the source. Then you're only running stats >> against the results of running the backup using

Re: [Bug 8456] improve --link-dest bahaviour

2011-09-18 Thread Henri Shustak
> I'd like to use rsync as an efficient (== do not store the same file twice at > the backup media) backup solution. The backup should be made into N remote > directories (rotating each day) _without_ the need to delete the remote > directory before. This is essentially, what LBackup is doing. Ho

Re: [Bug 8450] New: --link-dest seems not to work mounted NTFS file systems

2011-09-18 Thread Henri Shustak
Just to clarify, Is the destination file system NTFS? Also, is this storage directly attached or is it mounted via the network? Finally, you mentioned it is mounted read-only would you please clarify why the drive you are writing to is mounted in this way? Thanks. Henri

Re: [Bug 8456] improve --link-dest bahaviour

2011-09-18 Thread Henri Shustak
> In general - --link-dest works as expected *only*, if the destination > directory > is empty. Going along with this idea of ensuring the destination directory is empty. LBackup is a rsync backup wrapper system which may be of assistance in this regard. ---

Re: rsync and encryption

2011-09-04 Thread Henri Shustak
>> Which operating system are you running on the system which currently has >> your personal documents? >> > > Ubuntu/Debian Do you know if there is a virtual file system encryption system which breaks the data into bands? I know that Mac OS X has support for breaking an encrypted disk image

Re: Brandysnap -- a new rsync-based snapshot management script

2011-07-04 Thread Henri Shustak
>> Hi Chris, >> >>> https://github.com/StarsoftAnalysis/brandysnap >> >> I am involved with the LBackup project. Would you be okay with a link being >> generated to the Brandy on github page from the LBackup >> alternatives page? > > Yes, that would be gre

Re: Brandysnap -- a new rsync-based snapshot management script

2011-07-03 Thread Henri Shustak
u release Brandysnap under, perhaps in the future Brandysnap functionality could be incorporated into the LBackup project? Sounds like a good project. Thank you for posting the link and explanation. Keep in touch. Henri - This email is

Re: Using rsync as an incremental backup

2011-06-26 Thread Henri Shustak
> I'm using rsync to do an incremental backup of my desktop here, to a > remote server as follows: > > #/usr/bin/bash > > old=$(date -d 'now - 1 week' +%Y-%m-%d) > new=$(date +%Y-%m-%d) > > rsync -avP --delete --link-dest=../$dir /home/bakers > bak...@perturb.org:/home/bakers/backup/$new/ > >

Re: Being VERY careful while using the --delete option

2011-05-12 Thread Henri Shustak
> On UNIX, I am executing an rsync command, from within a script. The command > goes something like this: > > /usr/bin/rsync --verbose --progress --stats --compress --recursive --times > --perms --links --safe-links source_dir/ > user@target_machine:/parent_path/source_dir > > In other w

Re: thank you wayne, andrew, paul and everyone else

2011-04-30 Thread Henri Shustak
+2! :) -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: files not moved immediately to final destination from temp location after rsync returns with success

2011-04-20 Thread Henri Shustak
> I am using rsync version 3.0.7 on an arm linux based embedded device. The > device pulls data periodically from a rsync server and stores the files on an > SD card. The partial, temp and final rsync destinations all reside on the SD > card. > > I came across an issue where it seems that the

Re: Incremental backup with only delta into a separate file.

2011-02-09 Thread Henri Shustak
> Is there anyway in which i can have only the delta of the original file be > present at the backup location. > something like > 1. 1st backup is 100M > 2. write 20MB to the original file > 3. do a sync using hardlinks > 4. i have 20MB file at backup location with the delta changes only. Pr

Re: rsync not reporting diskfull error

2011-02-09 Thread Henri Shustak
> If pushing data (e.g. a local copy or copy from local to remote), there is a > failure where the receiver can try to report an error, die, and the sender > gets the error trying to write to the receiver before it gets the error > message from "around the horn" (it would have gone to the gener

rsync not reporting diskfull error

2011-02-05 Thread Henri Shustak
I am involved with the development of lbackup. This message to the rsync mailing list is related to the following thread on the lbackup-disccussion mailing list : http://tinyurl.com/lbackup-discussion-diskfull Essentially, I am curious to if any one using rsync 3.0.7 on Mac OS (10.6) Server has

Re: Protocol stream error on extended attribute, silent failure to copy all attributes

2011-02-02 Thread Henri Shustak
> I'm using rsync 3.0.7 on Mac OS X 10.6, compiled according to Mike > Bombich's instructions at http://www.bombich.com/rsync.html. Rsync > repeatedly exits with a protocol data stream error when trying to copy > some com.apple.FinderInfo extended attributes. While testing this issue, > I found th

Re: Disk image with rsync/rsnapshot

2011-01-18 Thread Henri Shustak
> I want to make a full disk image backup of my disk with rsnapshot/rsync that > I can restore on a new disk. > Part of my /etc/rsnapshot.conf looks like follows: > > exclude /proc > exclude lost+found > exclude /media > exclude /sys > exclude /dev > exclude /tmp > exclude /dev >

Re: Simple Question

2010-12-08 Thread Henri Shustak
> I have been using rsync on my laptop for some time to safeguard an > extensive image collection. > My usage has been: .. rsync -av --delete ~/Pictures /media/disk > I have found this exceptionally fast ... just as advertised! > > I now have set up a new computer system where I want to back up my

Re: Writing to the wrong directory

2010-11-29 Thread Henri Shustak
Hello, Recording the output (standard error and standard out) to a log file will help with investigating this issue if it is reproducible. Perhaps another person on this list will provide a better suggestion. In addition, perhaps adding some additional debugging information before and after th

Re: [Bug 3653] Reduce the need for the "vanished files" warning

2010-10-03 Thread Henri Shustak
> Doing nightly backups from cron is an *extremely* common use-case of rsync, > and > telling each and every user of rsync that they should either A) write their > own > shell script to filter and discard error messages, or B) play a constant game > of whack-a-mole chasing down new --exclude opt

Re: How to mirror only specified directories

2010-10-01 Thread Henri Shustak
>> I'm still struggling to get just the directory(ies) that I want... > > You may find this post to > the LBackup mailing list helpful. > > The example listed (link above) revolves around specifying the root directory > as the source and then

Re: rsync as a deliberately slow copy?

2010-09-29 Thread Henri Shustak
>> I'm looking for a way to deliberately copy a large directory tree >> of files somewhat slowly, rather than as fast as the hardware >> will allow. > Just do it to localhost - that way it's still a network connection, and > you can use "--bwlimit". Also, you could try "nice" to lower the > prior

Re: How to mirror only specified directories

2010-09-28 Thread Henri Shustak
> I'm still struggling to get just the directory(ies) that I want... You may find this post to the LBackup mailing list helpful. The example listed (link above) revolves around specifying the root directory as the source and then specifying a

Re: Intermittent rsync Issues

2010-09-15 Thread Henri Shustak
> I posted this to a couple online forums already am am already doubting anyone > will be able to directly help me solve my problems. So I am here to query > the experts directly: > I have a number of rsync clients trying to connect to an rsync server > routinely, and they're intermittently fa

Re: Backing up a stand alone system to a usb drive with rsync

2010-09-09 Thread Henri Shustak
> >> I have a stand alone system with two drives / and /home on one and /var >> on the the other. I'd like to backup the complete system to a usb drive. >> I've tried dd however since it copies over everything, even empty space >> it didn't seem very practical since for instance root only has 10Gi

Re: Options to copy modified files

2010-09-05 Thread Henri Shustak
> We use rsync to copy files and directories from one server to the other. What > options should I give to rsync so that it only copies the modified files? For > example server1 may contain a dir which contains just one file that has been > modified, how do I get rsync to copy just that one fil

Re: compare a directory with itself -- differences found

2010-09-02 Thread Henri Shustak
I think an important question is what kind of differences do you need to check with regards integrity of your copy / backup? In addition, I suggest that you actually use rsync to copy the data to a separate directory and then compare two different directories. The reason I suggest this is beca

Re: compare a directory with itself -- differences found

2010-09-02 Thread Henri Shustak
> well, when I tell rsync to compare my home directory with itself, it reports > many differences. > > I'm using rsync version 3.0.7 protocol version 30. > > I was hoping to use it to verify my backup. What kind of differences are reported. Also are you using the the --check-sum option for

Re: OSX 10.6.4 error with -R option

2010-09-02 Thread Henri Shustak
>> I have had reports of problems with the -R option on OSX 10.6.4. >> >> Just tested it myself and found this odd result: >> >> When I run this >> >> "dtruss -f path/to/rsync -aHAXNR --fileflags --force-change >> --protect-decmpfs --stats -v /Users/astrid/Documents/main.m >> /Users/astrid/

Re: DO NOT REPLY [Bug 7629] New: Blank filter file option to ignore whole directory

2010-08-18 Thread Henri Shustak
> I know that there are external ways to do this, but I thought it would be > fastest and best as an rsync feature. I've been using rsync for a while now in > some fairly advanced backup schemes and I'm extremely impressed by it. I was > thinking it would be quite helpful if there were an option to

Re: Scripting rsync against a filesystem with a quota

2010-08-15 Thread Henri Shustak
>> On another note I'm getting an error: >> >> copyfile(.._..v6AxMh,./., COPYFILE_UNPACK) failed:13 >> >> When trying to run with -E. > > Upstream rsync has no such error message. If you're using the > Apple-modified rsync, we don't support it here. You may wish to compile a version of rsync

Re: backup option

2010-08-11 Thread Henri Shustak
> I am using rsync to backup files. Is it possible to specify an option > not to delete files from backup directory if the files are deleted > from source? In that way, I can always keep something I may or may not > need in the backup disk, but remove it from a work computer. As Alex mentioned the

Re: HDB, a hard drive backup program

2010-08-11 Thread Henri Shustak
> Hey all, I'm writing a tool: > > http://www.subspacefield.org/security/hdb/ This is an interesting approach. I look forward to seeing the project develop. Thanks for the link. -- This email is protected by LBackup http://www.lbackup.org -- Please use repl

Re: IO error causing file deletion failure?

2010-08-07 Thread Henri Shustak
> readlink_stat("/home/morgan/.gvfs") > failed: Permission denied (13) I believe the error above is a problem with the rsync user not being able to read the file "/home/morgan/.gvfs". I suggest that you check the permissions on this file and also check that the sudo command is in fact grantin

Re: Getting rsync to store timing information in its logs

2010-07-27 Thread Henri Shustak
> Is there a way to know from the rsync logs how long it took to do a backup? > > The only timing info,. I see is this at the end: > > sent 3067328 bytes received 7853035429 bytes 1187888.83 bytes/sec > total size is 1559866450336 speedup is 198.55 The latest alpha release of LBackup support

Re: Ignoring "file has vanished" errors?

2010-07-24 Thread Henri Shustak
> Is it possible to have rsync ignore 'file has vanished' errors and not > return an error on exit? > > I have a backup script that utilizes rsync, and based on the return > code determines whether the backup was successful. Postfix queue files > and user maildir files being deleted during the bac

Re: rsync algorithm

2010-07-22 Thread Henri Shustak
>> Check file size makes sense, but how rsync checks times? If a file is >> copied from one side to another remote side, the time will be >> different, right? > > Sorry wrong question, the copy file should be able to reserve the mtime. If the rsync --times option is used then rsync will attempt

Re: How to block this fiel name from being transfered via rsync?

2010-07-21 Thread Henri Shustak
>> Are you specifying this lines in an excludes file? >> > yes -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: --compare-dest weirdness

2010-07-20 Thread Henri Shustak
> the -i shows that most are being copied due to time differences, so in > theory -t should work? This does in fact work on a little test setup > on my work laptop, i will test it properly when i get home tonight. I am glad that the -t option is working with your test. If you decide to use LBa

Re: Rsync sequence

2010-07-20 Thread Henri Shustak
> Can I just list them one after the other like so in crontab -e You may wish to also consider using a single rsync command : rsync -auv --delete \ /Godfather/Documents \ /Godfather/Setups \ /Godfather/Pictures \ /Godfather/Backups \ /Godfather/Videos \ /Backup # backup destination With this app

Re: --compare-dest weirdness

2010-07-19 Thread Henri Shustak
> interestingly, i tried to see if something was wrong with my statments by > doing: > mkdir ~/rsynctest/dir1 > mkdir ~/rsynctest/dir2 > mkdir ~/rsynctest/dir3 > > nano ~/rsynctest/dir1/file1 (wrote the line hello world and saved) > nano ~/rsynctest/dir1/file2 (wrote the line hello and saved) >

Re: Rsync backup issues using relative paths and LVM snapshots

2010-07-19 Thread Henri Shustak
>> I did think about remotely executing a mkdir before the backup, but one >> blocker is that I will be using Thecus NAS boxes as some off-site locations >> and I don't have shell access. > > You could mkdir the directory locally somewhere (anywhere), and rsync > just that directory to the remot

Re: --compare-dest weirdness

2010-07-19 Thread Henri Shustak
> Hi All, > > I am writing a backup program for my computer. brief outline is as follows. > > Running ubuntu 10.04 > 2 main partitions, / and /home, both ext3. 1 external usb hdd, ext3, > mounted to /backups/main. > once every couple of days, rsync backs up, using following command, > everything

Re: Rsync backup issues using relative paths and LVM snapshots

2010-07-15 Thread Henri Shustak
> Below is a link to a script (which currently only supporting Mac OS X) which > will synchronize a sparse bundle image to a remote server. Sorry I forgot the link in the previous email. - http://www.lbackup.org/synchronizing_disk_images_between_machines Finally, yes I would be very interes

Re: Rsync backup issues using relative paths and LVM snapshots

2010-07-15 Thread Henri Shustak
> I really want to put the logic in the script so it is easy to bring another > backup location online easily. If you have shell access to the destination system from your backup script then one option may be to issue 'mkdir -p' via ssh. > Creating the directories manually on the destination s

Re: --recursive and -H

2010-06-28 Thread Henri Shustak
> Aaah, thanks for the insight. RSYNC must transfer the file regardless of the > link count, but it also takes note of the missing link. So, it probably > considers an inode with multiple links "resolved" only after it finds a > brother/sister link and deletes the duplicate. You may also be i

Re: few questions on rsync

2010-06-22 Thread Henri Shustak
> Reversing --backup logic: > Currently, if --backup is used (and --backup-dir), a copy of existing > file that is replaced on rsync will be placed there. Is there a way to > keep original copy (ie. base) the same, but just place whatever has > changed to a different location? Taking "backup to a

Re: where is backup-dir rooted?

2010-06-22 Thread Henri Shustak
> [What I am trying to achieve is to backup (part of) my home directory to a > backup server such that > > a) I have a reasonably up to date (within a day if I do it overnight) of my > current state > b) If I have deleted or updated a file the old version of it gets placed into > a special "sn

Re: Simple whole volume copy

2010-05-27 Thread Henri Shustak
> Sorry, I'm only going to be doing this a single time. I don't really need a > script, just a simple command which will preserve all the flags. Also, another question, what kind of data is on this volume that you are backing up? -- This email is protected by

  1   2   >