Re: RAM speedup

2020-06-30 Thread Matthias Schniedermeyer via rsync
On 30.06.2020 11:52, Rupert Gallagher wrote: > ? Original Message ? > On Sunday 28 June 2020 21:29, Matthias Schniedermeyer wrote: > > > On 28.06.2020 16:46, Rupert Gallagher wrote: > > > > >

Re: RAM speedup

2020-06-28 Thread Matthias Schniedermeyer via rsync
On 28.06.2020 16:46, Rupert Gallagher wrote: > ? Original Message ? > On Sunday 28 June 2020 13:58, Matthias Schniedermeyer wrote: > > destination: > ST5000LM000-2AN1 sata hdd > Writing speed : 74 MB/s > Reading speed : 89 MB

Re: RAM speedup

2020-06-28 Thread Matthias Schniedermeyer via rsync
On 28.06.2020 16:46, Rupert Gallagher wrote: > ? Original Message ? > On Sunday 28 June 2020 13:58, Matthias Schniedermeyer wrote: > > > On 27.06.2020 11:22, Rupert Gallagher via rsync wrote: > > > > > On Friday 26 June 20

Re: RAM speedup

2020-06-28 Thread Matthias Schniedermeyer via rsync
On 27.06.2020 11:22, Rupert Gallagher via rsync wrote: > On Friday 26 June 2020 21:58, Rupert Gallagher via rsync > wrote: > > > Hello, > > > > As disks are slow and rsync reads and writes so much that for the bus this > > is the equivalent of context switching galore, would it be possible to u

Re: There is problem of rsync with options --hard-links --inplace.

2017-02-15 Thread Matthias Schniedermeyer
On 15.02.2017 00:07, Viper wrote: > There is the problem which I discribed here > https://bugs.centos.org/view.php?id=12820. > rsync does not break hard-link into destination if hard-link has be broken > in source with option inplace. > The problem remains in the latest version of rsync? This is d

Re: rsync --delete

2015-04-16 Thread Matthias Schniedermeyer
On 16.04.2015 12:20, ? ?? wrote: > Hi, Rsync. > > find /home/rc-41/data/061/2015-04-01-07-04/ -delete > I know not suitable -mindepth 1 ? That deletes the whole contents, but doesn't delete the folder itself. -- Matthias -- Please use reply-all for most replies to avoid

Re: great feature idea (well, hopefully)

2015-02-12 Thread Matthias Schniedermeyer
On 11.02.2015 14:03, QUBE RUBBIK wrote: > Hello > > I was just thinking about a killer feature for rsync, the ability to detect > files name changes or move within the source and destination. > At this time rsync has to re-transfer a file if it has been renamed or moved > inside a subfolder, wit

Re: [Bug 11067] New: add --min-depth and --max-depth options

2015-01-22 Thread Matthias Schniedermeyer
On 22.01.2015 14:32, Joe wrote: > Maybe a bit off topic. (I don't deal with any data even remotely that > large.) > > How would you use these new options - just as a way to break large tasks > into smaller "batches"? > If rsync "stops in the middle", then the target would be in a sort of > limbo w

Re: Dealing with an unreliable remote

2014-11-25 Thread Matthias Schniedermeyer
On 25.11.2014 15:02, net.rs...@io7m.com wrote: > 'Lo. > > I've run into a frustrating issue when trying to synchronize a > directory hierarchy over a reliable (but slow) connection to an > unreliable remote. Basically, I have the following: > > http://mvn-repository.io7m.com/com/io7m/ > > Thi

Re: Using --fuzzy

2014-11-17 Thread Matthias Schniedermeyer
On 16.11.2014 18:38, Karl O. Pinc wrote: > On 11/16/2014 03:53:12 PM, Joe wrote: > > I have a lot of files (and directories) (up to a few hundred at a > > time) > > that I get from various sources. Some time after I get them (after > > they > > are already backed up), I often have to move them arou

Re: rsync's usage of ssh

2014-04-12 Thread Matthias Schniedermeyer
On 12.04.2014 20:48, a. wrote: > I am trying to understand how rsync uses ssh. From what I understand of > the source, it simply opens a ssh connection and then simply pipes > rsync's data. But somehow my stomach tells me that this is not the whole > story. > > For one, that would mean the whole (

Re: problem with rsync-daemon via ssh

2014-02-14 Thread Matthias Schniedermeyer
On 14.02.2014 13:17, Paul Slootman wrote: > On Fri 14 Feb 2014, Matthias Schniedermeyer wrote: > > > > You mixed the options from "remote shell" with "rsync daemon". > > Rsync is used either as 'rsync over SSH'(/remote shell) OR daemon-mode. >

Re: problem with rsync-daemon via ssh

2014-02-14 Thread Matthias Schniedermeyer
On 13.02.2014 23:38, Carlos Carvalho wrote: > I'm trying to transfer something to another machine launching a > once-only "daemon" through ssh with this command: > > rsync -avv -e "ssh -l user" ./orig/ machine::module/ > > where "module" is the name of a file in the home dir of user with the > fo

Re: Feature Request: don't sync if it would result in more than NUM deletions.

2014-02-05 Thread Matthias Schniedermeyer
On 05.02.2014 13:00, Daniel Mare wrote: > As a safety feature, I would like to see a feature that would prevent rsync > from syncing when the sync, if it were to go ahead, would result in more than > a certain number of files being deleted from the destination. > > A similar feature, --max-delet

Re: Docs: detecting metadata changes

2014-02-04 Thread Matthias Schniedermeyer
On 04.02.2014 12:56, Jori Mantysalo wrote: > I just tested our backup system, that is done with rsync. When I > changed metadata of file --- for example permissions --- rsync > notices change and copies permissions to backup. However, our > archiving does not work. So I can roll back to older conte

Re: Eliminate the temp copy

2014-01-28 Thread Matthias Schniedermeyer
On 28.01.2014 08:35, Juan Pablo Lorier wrote: > Hi, > > I have to sync two directories and one is an ftp mount. I had to set a > different tmp dir as tmp files are not allowed in ftp mounts so I see no > point in copying things to a temp dir if they won't be used for the > transfer. What do you m

Re: [Bug 5124] Parallelize the rsync run using multiple threads and/or connections

2014-01-28 Thread Matthias Schniedermeyer
On 28.01.2014 04:26, L.A. Walsh wrote: > > > Matthias Schniedermeyer wrote: > >On 25.01.2014 21:03, L.A. Walsh wrote: > >>If rsync already hitting over 200MB (even over 100MB)/s I'd agree that using > >>multiple TCP connections would help as they could be pr

Re: Eliminate the temp copy

2014-01-28 Thread Matthias Schniedermeyer
On 28.01.2014 08:35, Juan Pablo Lorier wrote: > Hi, > > I have to sync two directories and one is an ftp mount. I had to set a > different tmp dir as tmp files are not allowed in ftp mounts so I see no > point in copying things to a temp dir if they won't be used for the > transfer. > Is there any

Re: [Bug 5124] Parallelize the rsync run using multiple threads and/or connections

2014-01-26 Thread Matthias Schniedermeyer
On 25.01.2014 21:03, L.A. Walsh wrote: > > If rsync already hitting over 200MB (even over 100MB)/s I'd agree that using > multiple TCP connections would help as they could be processed by different > cpu's on both ends. But since it doesn't even hit 100MB/s locally, the > limit *isn't* TCP connec

Re: rsync -a --update resets status of newer target directories

2014-01-21 Thread Matthias Schniedermeyer
On 21.01.2014 10:07, Linda Walsh wrote: Wow. Your E-Mail is quite an unreadable HTML mess. > Then how does "-u" work with files?  If what you say is true, then > how would you preserve a newer mtime on the files on the target? > That is what "-u" does.  Yet you claim this is impossible because

Re: rsync -a --update resets status of newer target directories

2014-01-15 Thread Matthias Schniedermeyer
On 15.01.2014 22:14, Arvid Requate wrote: > Hi, > > On 15.01.2014 18:18:13, Matthias Schniedermeyer wrote: > > As rsync is a tool for unidirectional(!) synchronization of differences > > between file-trees. I would think: Yes. That is intended behaviour. > > > &g

Re: rsync -a --update resets status of newer target directories

2014-01-15 Thread Matthias Schniedermeyer
On 15.01.2014 17:45, Arvid Requate wrote: > Hi, > > this is a question regarding the behavior of the --update option for the > recursive replication of directories. rsync 3.0.7-2 shows the following > behavior on a Debian squeeze system (ext4): > > After running the following commands the adjus

Re: Making --inplace and --sparse compatible

2013-12-11 Thread Matthias Schniedermeyer
On 10.12.2013 21:05, Perry Hutchison wrote: > It seems to me that it should be possible to make --inplace and > --sparse compatible. > > The manpage says > > -S, --sparse >... Conflicts with --inplace because it's not >possible to overwrite data in a sparse fashion. >

Re: Is it possible to specify the destination filename for every file being synced with rsync

2013-11-02 Thread Matthias Schniedermeyer
On 02.11.2013 11:39, Cary Lewis wrote: > E.g. I have a directory with 10,000 files, and I want to sync them to a > remote server, but I want to map the source filenames to a different set of > filenames on the server. > > Is there a way to create an input file for rsync to use that specifies a > s

Re: rsync -H option yields corrupt replicas (due to non-unique inode ids)

2013-09-05 Thread Matthias Schniedermeyer
On 05.09.2013 16:08, Andrew J. Romero wrote: > Hi, > > Our organization hosts a specialized Linux distribution. > > As is typical with Linux distributions, > the set of files that make up our Linux distro > contains a very complex web of self-referential hard links. > > Several other sites use

Re: Fwd: Re: need help with an rsync patch

2013-08-13 Thread Matthias Schniedermeyer
On 13.08.2013 21:04, Sherin A wrote: > On Tuesday 13 August 2013 08:56 PM, Matthias Schniedermeyer wrote: > >On 13.08.2013 20:44, Sherin A wrote: > >>On Tuesday 13 August 2013 05:50 PM, Paul Slootman wrote: > >>>On Tue 13 Aug 2013, Matthias Schniedermeyer wrote

Re: Fwd: Re: need help with an rsync patch

2013-08-13 Thread Matthias Schniedermeyer
On 13.08.2013 20:44, Sherin A wrote: > On Tuesday 13 August 2013 05:50 PM, Paul Slootman wrote: > >On Tue 13 Aug 2013, Matthias Schniedermeyer wrote: > >>BUT there is no direct vulnerability in that, only processes after that > >>(like backup/rsync) can make a vulnerabil

Re: Fwd: Re: need help with an rsync patch

2013-08-13 Thread Matthias Schniedermeyer
On 13.08.2013 15:51, Paul Slootman wrote: > On Tue 13 Aug 2013, Matthias Schniedermeyer wrote: > > > > I read your sentence differently: > > > > > If he can make a HARD link to the shadow file, then he can already > > > read it - and worse. > >

Re: Fwd: Re: need help with an rsync patch

2013-08-13 Thread Matthias Schniedermeyer
On 13.08.2013 14:20, Paul Slootman wrote: > On Tue 13 Aug 2013, Matthias Schniedermeyer wrote: > > > > BUT there is no direct vulnerability in that, only processes after that > > (like backup/rsync) can make a vulnerability out of it. > > ... which is what I already w

Re: Fwd: Re: need help with an rsync patch

2013-08-13 Thread Matthias Schniedermeyer
On 13.08.2013 14:18, Paul Slootman wrote: > On Tue 13 Aug 2013, Matthias Schniedermeyer wrote: > > > > > > > Hardlinking a file doesn't change it's owner/group/permission > > > > (All Hardlinks have the same user/group/permissions). > > >

Re: Fwd: Re: need help with an rsync patch

2013-08-13 Thread Matthias Schniedermeyer
On 13.08.2013 12:29, Paul Slootman wrote: > On Tue 13 Aug 2013, Matthias Schniedermeyer wrote: > > On 13.08.2013 09:52, Paul Slootman wrote: > > My mistake for assuming that people run current linux kernels... > > /proc/sys/fs/protected_hardlinks (since Linux 3.6) >

Re: Fwd: Re: need help with an rsync patch

2013-08-13 Thread Matthias Schniedermeyer
On 13.08.2013 13:17, Paul Slootman wrote: > On Tue 13 Aug 2013, Matthias Schniedermeyer wrote: > > > That aside that's not what i meant. > > That's the problem with one-word answers, people have to guess what you > mean. > > > > Hardlinking a file

Re: Fwd: Re: need help with an rsync patch

2013-08-13 Thread Matthias Schniedermeyer
On 13.08.2013 12:29, Paul Slootman wrote: > On Tue 13 Aug 2013, Matthias Schniedermeyer wrote: > > On 13.08.2013 09:52, Paul Slootman wrote: > > > On Tue 13 Aug 2013, Sherin A wrote: > > > > > > > But if a user create a > > > > hard link

Re: Fwd: Re: need help with an rsync patch

2013-08-13 Thread Matthias Schniedermeyer
On 13.08.2013 09:52, Paul Slootman wrote: > On Tue 13 Aug 2013, Sherin A wrote: > > > But if a user create a > > hard link to /etc/shadow from his home dir , and he request a restore , > > then he can read the shadow files and decrypt it . > > If he can make a HARD link to the shadow file, then

Re: getting a list of conflicting files

2013-08-01 Thread Matthias Schniedermeyer
On 01.08.2013 08:32, Jonathan Aquilina wrote: > my switches are -ain at this point the problem though is its working but > copying them to the same host. I need to test copying to a remote host > > rsync -ain -e "ssh" "$LOCALDIR" "$REMOTEDIR" rsync -ain "$LOCALDIR" remotehost:"$REMOTEDIR" --

Re: Reversing roles of server and client for uploading sync list

2013-07-29 Thread Matthias Schniedermeyer
On 29.07.2013 17:14, cjand...@gmail.com wrote: > I am searched for an easy answer but I haven't come across one. > Basically the problem is that I have an ADSL network that I use to > remotely backup some files that have changed across and entire OS every > few days. > > The problem I have found i

Any plans for a 3.1.0 release(-date)?

2013-05-19 Thread Matthias Schniedermeyer
Hi If i'm reading git right(git log v3.0.9..) the development branch that will eventually result in 3.1.0 is nearly 5 years "in the making". Personally i'm anticipating the fallocate support, as XFS is great at preallocateing (fallocating even a several gigabyte big file only takes millisecon

Re: exclude a pattern but only in the top level

2013-05-15 Thread Matthias Schniedermeyer
On 15.05.2013 04:13, Brian K. White wrote: > How can I get it to exclude just the top-level directory "/foo/aaa" ? With a '/' at the beginning you pin the pattern to the beginning. You don't use "/" at the end of directory names, so i'm not sure if the correct one is: /aaa or /foo/aaa With a '/'

Re: Direction (rsync manpage)

2013-04-16 Thread Matthias Schniedermeyer
On 15.04.2013 23:19, Kevin Korb wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > I hate to say it but I agree with you to an extent. Since rsync > doesn't upload and download it is ridiculous to differentiate between > the two. Also, since rsync allows either the source or target to b

Re: Delete directories without browsing them

2013-04-07 Thread Matthias Schniedermeyer
On 07.04.2013 11:25, AZ 9901 wrote: > Le 6 avr. 2013 à 17:15, Matthias Schniedermeyer a écrit : > > > On 06.04.2013 16:57, AZ 9901 wrote: > >> > >> Is there a way to tell Rsync to directly delete backup directories at > >> the top of the hierar

Re: Delete directories without browsing them

2013-04-06 Thread Matthias Schniedermeyer
On 06.04.2013 16:57, AZ 9901 wrote: > > Is there a way to tell Rsync to directly delete backup directories at > the top of the hierarchy without browsing them ? No. Deleting a directory-tree has to be done "file by file" and "directory by directory" there is no magic "remove that mountain of fi

Re: rsync not deleting file (which was hard linked)

2013-03-02 Thread Matthias Schniedermeyer
On 02.03.2013 13:14, Eric Shubert wrote: > I have a situation that I think might be a bug, but would like > someone else to have a look at before I create a report. ... > "$source"/* \ As far as i know rsync, this is your error. Ignoring the current-directory you rsync a bunch of files. I

Re: Destination file a lot larger then source (real size)

2013-02-05 Thread Matthias Schniedermeyer
On 05.02.2013 12:32, milos.kau...@gmail.com wrote: > I have a script that syncs my backups to an NFS mount every day > > The script works fine, without any errors, but there is a problem when > it comes to some large files > > Let's take my pst file (8.9 gig) as an example > > Source: > > du -h

Re: rsync with aging

2013-01-31 Thread Matthias Schniedermeyer
On 30.01.2013 19:56, LuKreme wrote: > > On 30 Jan 2013, at 18:16 , Kevin Korb wrote: > > > cd /server ; find . -type f -mtime +30 -print | cpio -pvdm /archive/ > > I *think* > > `rysnc -aRP ...` is working for what I need. Another solution would be a tar-pipe. cd /server ; tar -c --null -T

Re: rsync in conjunction with the --link-dest option does not output deleted files

2013-01-08 Thread Matthias Schniedermeyer
The end-result is identical, if the number of files is large, this can take longer as you have to walk the tree twice instead of only once. If the number of files is small enough to fit into the cache, there shouldn't not be a significat change in total runtime. > --- Original Message

Re: rsync in conjunction with the --link-dest option does not output deleted files

2013-01-08 Thread Matthias Schniedermeyer
On 08.01.2013 12:23, Maik Meier wrote: > Hi, > > I want to use rsync to make daily backups using hard-links in this way: > > rsync -av --delete --link-dest=../backup_old ./source/. ./backup_new > > Does someone know if this a bug, or ist this intended to be or am I > wrong somethere? I would th

Re: I found a buggie

2012-09-27 Thread Matthias Schniedermeyer
On 26.09.2012 23:45, Carlos Morel Gómez La Roque wrote: > Hello, people. Sorry but I found that when you do rsync to a not created > destination it makes a mkdir in order to accomplish the work. The problem > comes when there are some uncreated parents in the destination directories. > That's just

Re: Destination file is larger than source file

2012-08-29 Thread Matthias Schniedermeyer
On 29.08.2012 10:06, Dariusz Dolecki wrote: > We are using the standard -av switch. And both filesystems are the same - > UFS. > > > /opt/rsync/bin/rsync -av -e "ssh -l root" --delete > --exclude-from=/var/scripts/exclude > --password-file=/var/scripts/transfer.passwd @ host>::/ / > > > Sourc

Re: local -> local file copy question

2012-08-19 Thread Matthias Schniedermeyer
On 19.08.2012 10:06, Linda Walsh wrote: > Justin T Pryzby wrote: > >Note that --whole-file "is the default when both the source and > >destination are specified as local paths", and implies that the file > >is copied without the "delta transfer" algorithm. > --- > > I am using the 'whole-file' cop

Re: Checksum filter rule

2012-07-29 Thread Matthias Schniedermeyer
On 29.07.2012 11:19, teramide wrote: > Well, I wanted to keep the old timestamps so that the encrypted > volume looks like a file that's never used (this is the reason why > Truecrypt does this). But I guess there's a tradeoff to be made > here, so I will implement it the way you suggested. You do

Re: Checksum filter rule

2012-07-28 Thread Matthias Schniedermeyer
On 28.07.2012 10:36, teramide wrote: > Hello, > > I'm using rsync to make backups. In my dataset, however, there are a > few encrypted Truecrypt volumes. When these files are modified, the > content changes but the timestamps are not updated. Thus, rsync will > not sync these files by default. I w

Re: rsync based on checksum only

2012-07-05 Thread Matthias Schniedermeyer
On 05.07.2012 09:26, Yan Seiner wrote: > Is it possible to tell rsync *not* to use file names, date stamps, etc and > only use the checksum for deciding if a file is the same? > > the remote machine "normalizes" a set of file names to remove all > punctuation marks and forces all file names to low

Re: Rsync pairing

2012-06-26 Thread Matthias Schniedermeyer
On 26.06.2012 14:18, András Porjesz wrote: > Hi all, > I have an rsyncd installed on a host and I want to use it from a lot of > clients. This rsync is not invoked directly but there is a shell script > wrapper co set up parameters and environment. > My problem is that I do not want to allow any

Re: Using rsync to mirror directories where root owns file, using non-root user to initiate session

2012-06-22 Thread Matthias Schniedermeyer
On 20.06.2012 22:26, PEOPLES, MICHAEL P wrote: > I have spent a day researching and attempting to debug this issue. I am > hoping someone can tell me how (or disabuse me of the delusion that it's > possible) to do the following: ... If running a command as root via sudo is acceptable. I had the

Re: rsync files from subfolders on source to root of a folder on destination

2012-04-23 Thread Matthias Schniedermeyer
On 23.04.2012 16:50, James Robertson wrote: > I wish to sync a bunch of flac files that reside in various subfolders > to the root of a folder on a destination. > > An example of the directory structure on the source is: ... I think hard-links are the easiest solution. mkdir hardlinks find Musi

Re: Rsync takes long time to finish

2012-04-12 Thread Matthias Schniedermeyer
On 12.04.2012 23:59, vijay patel wrote: > > Hi Friends, > > I am using rsync to copy data from Production File Server to Disaster > Recovery file server. I have 100Mbps link setup between these two servers. > Folder structure is very deep. It is having path like > /reports/folder1/date/folder

Re: Settings file times only

2012-04-11 Thread Matthias Schniedermeyer
On 11.04.2012 11:14, James Moe wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > Hello, > I restored a filesystem by using rsync to copy directories and files > from a backup volume to the newly recreated volume. All of the > re-created files were given the current date and time rathe

Re: securing rsync backup solutions?

2011-12-28 Thread Matthias Schniedermeyer
On 27.12.2011 19:26, Daniel Pocock wrote: > > > For full system backup, rsync obviously needs to run as root on the > machine being backed up > > - is there any possibility for the rsync process on the backup server to > keep the destination files within a tar file (or some virtual filesystem >

Re: Ignoring /boot

2011-09-12 Thread Matthias Schniedermeyer
On 12.09.2011 11:03, Ben Short wrote: > Hi, > > I have the following script that I'm writing to backup my gentoo linux > system. > > ... > > I would expect boot to have files in it? What is going wrong? The culprit should be: --one-file-system Bis denn -- Real Programmers consider "what you

Re: Feature request, or HowTo? State-full resume rsync transfer

2011-07-15 Thread Matthias Schniedermeyer
On 15.07.2011 13:10, Donald Pearson wrote: > > Matthias, > > A vpn tunnel is an interesting idea. Do you know how long you're able to > keep rsync in limbo before it will give up? I haven't really tried. But it was about 15 Minutes the one time it didn't reconnect in time. > The issue I think

Re: Feature request, or HowTo? State-full resume rsync transfer

2011-07-12 Thread Matthias Schniedermeyer
On 12.07.2011 11:10, Donald Pearson wrote: ... A 'trick' i personally use for an unreliable connection is an OpenSSH-Tunnel. Altough any VPN-solution should to the trick. That way the connection between the two rsync-halvs isn't directly tied to the internet-connection. In my case that means

Re: Feature request, or HowTo? State-full resume rsync transfer

2011-07-12 Thread Matthias Schniedermeyer
On 11.07.2011 16:01, Donald Pearson wrote: > I am looking to do state-full resume of rsync transfers. > > My network environment is is an unreliable and slow satellite > infrastructure, and the files I need to send are approaching 10 gigs in > size. In this network environment often times links c

Re: copy /backup/current/home/???user>/Maildir -> /home/???user>/Maildir ?

2011-07-09 Thread Matthias Schniedermeyer
On 09.07.2011 11:23, Emilien Kenler wrote: > Louis-David Mitterrand apartia.org> writes: > > > > > Hi, > > > > How can I copy each /backup/current/home/???user>/Maildir into > > /home/???user>/Maildir ? > > > > Thanks, > > > Hi, > > you can try this > > for i in /backup/current/home/ ; do

Re: restoring system

2011-04-24 Thread Matthias Schniedermeyer
On 24.04.2011 10:51, Robert Holtzman wrote: > I have restored my home directory in the past using rsync but never the > entire system. If I rsync / (on my usb drive containing the backup) to / > on the computer with a fresh install of the OS, what problems will I run > into? What about links? I am

Re: --delete-during acts like --delete-before

2010-09-09 Thread Matthias Schniedermeyer
On 08.09.2010 23:07, Craig Bell wrote: > > Hello, I use rsync v3.0.7 with "--delete-during", but it appears to > act more like "--delete-before". I've checked the docs and list > archives, but I am still discovering some of the subtleties of > rsync, and I can't see where I'm going wro

Re: First Time Using Rsync

2010-07-23 Thread Matthias Schniedermeyer
On 24.07.2010 06:29, Alex Ferrara wrote: > > > On 23/07/2010, at 10:42 PM, Carlos Mennens wrote: > > > I did a search on the web and there are so many different methods / > > variations of using this powerful tool. My question for you guys is > > very simple and I would like to hear from people

Re: rsync to iSCSI over WAN

2010-07-23 Thread Matthias Schniedermeyer
On 23.07.2010 10:29, Tom Christensen wrote: > > > > > Date: Fri, 23 Jul 2010 10:02:26 +0200 > > From: m...@citd.de > > To: pav...@live.com > > CC: rsync@lists.samba.org > > Subject: Re: rsync to iSCSI over WAN > > > > On 23.07.2010 00:30, Tom Christensen wrote: > > > > > > I am running rsync i

Re: rsync to iSCSI over WAN

2010-07-23 Thread Matthias Schniedermeyer
On 23.07.2010 00:30, Tom Christensen wrote: > > I am running rsync in cygwin on windows. I am attempting to backup a > somewhat large data store (750GB) to a remote site. As its windows > and preserving permissions exactly is important, I have an iSCSI drive > mounted on the local system acro

Re: --compare-dest weirdness

2010-07-21 Thread Matthias Schniedermeyer
On 21.07.2010 10:22, Kevin Murray wrote: > Hi Henri > > Thanks very much. LBackup looks good, but i need a solution which only > copies files which have changed, and does not link the others, as the > folder is destined for a tar archive. Also, the copied files must be > fully functional, i.e. mus

Re: Linux, rsync files excluding open/busy files

2010-07-14 Thread Matthias Schniedermeyer
On 14.07.2010 12:06, bvidinli wrote: > Hi, > > I read many posts about this, faq, googled, and finally got to write here. > > The scenario/question is this: > I want to transfer files from Server B -> Server C > the problem is that, files that are to be transfered may be open/busy, > meaing they

Re: log format question

2010-06-28 Thread Matthias Schniedermeyer
On 28.06.2010 09:38, McGraw, Robert P wrote: > > USING: rsync version 3.0.6 protocol version 30 on a Sun Solaris 10 x86. > This is a precompiled version from opencsw. > > > /opt/csw/bin/rsync -n -axzH -v --delete-after > --log-file=$RSYNCOUTPUT/export_-${DAILYDT}X --rsync-path=/opt/csw/bin/r

Re: --recursive and -H

2010-06-27 Thread Matthias Schniedermeyer
> Big props to those who code RSYNC, this stuff gets crazy ;) Definitly. ;-) > - "Matthias Schniedermeyer" wrote: > > > On 26.06.2010 09:01, Rob Thompson wrote: > > > > > > Hello, > > > > > > I have a question regarding using the --rec

Re: --recursive and -H

2010-06-26 Thread Matthias Schniedermeyer
On 26.06.2010 09:01, Rob Thompson wrote: > > Hello, > > I have a question regarding using the --recursive option when > preserving hard link with -H. How is it, that these two options are > compatible when used together? I would think that RSYNC would need to > see all files/inodes before tr

Re: feature request: lzma compresion (7zip)

2010-06-21 Thread Matthias Schniedermeyer
On 21.06.2010 10:53, Matthias Schniedermeyer wrote: > On 17.06.2010 15:37, super master wrote: > > Hello, > > many linux SW is starting to implement new lzma compresson instrad of old > > zlib (gzip) od bzip2. > > > > lzma is default comrpession in very go

Re: feature request: lzma compresion (7zip)

2010-06-21 Thread Matthias Schniedermeyer
On 17.06.2010 15:37, super master wrote: > Hello, > many linux SW is starting to implement new lzma compresson instrad of old > zlib (gzip) od bzip2. > > lzma is default comrpession in very good compression SW 7-zip, which is > faster and have higher compression ratio then bzip2 or rar. > > Cur

Re: rsync over ssh - existing files are not updated?

2010-05-16 Thread Matthias Schniedermeyer
On 16.05.2010 12:23, Sjon Hortensius wrote: > Hi, > > I am using rsync to backup various machines to a central server (all > archlinux, rsync 3.0.7 on ext4). Yesterday I needed one of those > backups, and I found out it is useless since a lot of files never got > updated. Even when I enable c

Re: Sync different copies of a filesystem

2010-05-13 Thread Matthias Schniedermeyer
On 13.05.2010 13:24, N. Yaakov Ziskind wrote: > I have 5 or 6 :-( different copies of a filesystem on various Linux > boxen, all backups taken at different times, with different exclusions, > and squirreled away. Now's the time to clean up my attic. I'd like to > merge them all into one big filesys

Re: Ignoring parts of stat(2)

2010-01-05 Thread Matthias Schniedermeyer
On 05.01.2010 05:36, grarpamp wrote: > > That option can be easily missed it's: --size-only > > That seems like at least part of what would be useful :) > Certainly it covers the most common case of modtimes. > > However, it doesn't seem to work :( > > cp -p /etc/passwd a > cp -p /etc/passwd b

Re: Ignoring parts of stat(2)

2010-01-05 Thread Matthias Schniedermeyer
On 05.01.2010 02:33, grarpamp wrote: > How do I make rsync ignore and not report or update certain parts > of the [l]stat(2) struct or checksum when selecting which items to > report or update in a hierarchy? > > For example, I want to run: > rsync -Haxi --delete /hier1/ /hier2/ > and have it NOT

Re: [Bug] having parentheses in filenames causes failure

2009-12-29 Thread Matthias Schniedermeyer
On 29.12.2009 11:51, Geralt wrote: > Hi, > > I don't know how to exactly describe the bug, but the following > test-case reproduces the bug in 3.0.6 > > mkdir rsync-test > cd rsync-test > mkdir -p "src/directory (name)" > touch "src/directory (name)/somefile" > mkdir dest > rsync --archive --dry-

Re: How do I make rsync ignore unreadable files (damaged sectors)?

2009-12-22 Thread Matthias Schniedermeyer
lution. But then it is not sure whether the OS does the reading >>> retries >>> or whether the optical disk drive itself retries reading. >> >> On 22.12.2009 at 19:10 Matthias Schniedermeyer wrote: >> >> Get some Old, cheap and as small as possible USB-Sticks

Re: How do I make rsync ignore unreadable files (damaged sectors)?

2009-12-22 Thread Matthias Schniedermeyer
On 22.12.2009 16:39, Stefan Nowak wrote: > The only low-budget test ideas I have: > > The CD scratching a la Tomas Gustavsson seems the only easily achievable > solution. But then it is not sure whether the OS does the reading retries > or whether the optical disk drive itself retries reading. G

Re: multiuser rsync environment

2009-12-10 Thread Matthias Schniedermeyer
On 10.12.2009 11:54, Angel Spassov wrote: > > Dear List, > > I am looking for a solution of the following issue. > > We are two users managing our homepage through subversion > in order to synchronize each others work. > We upload everything to the server via the following command in rsync: >

Re: Parallel rsync's for better Performance.

2009-10-28 Thread Matthias Schniedermeyer
On 28.10.2009 18:27, Matt McCutchen wrote: > On Wed, 2009-10-28 at 17:24 +0100, Matthias Schniedermeyer wrote: > > On 28.10.2009 10:35, Matt McCutchen wrote: > > > On Wed, 2009-10-28 at 10:01 +0100, Matthias Schniedermeyer wrote: > > > > Otherwise parallel rsyncs comp

Re: Parallel rsync's for better Performance.

2009-10-28 Thread Matthias Schniedermeyer
On 28.10.2009 10:35, Matt McCutchen wrote: > On Wed, 2009-10-28 at 10:01 +0100, Matthias Schniedermeyer wrote: > > On 28.10.2009 09:05, Satish Shukla wrote: > > > We have huge data to sync usually everyday and I wish rsync could > > > guarantee performance. > > &

Re: Parallel rsync's for better Performance.

2009-10-28 Thread Matthias Schniedermeyer
On 28.10.2009 09:05, Satish Shukla wrote: > > > Hi , > > We have huge data to sync usually everyday and I wish rsync could guarantee > performance. > > I thought of spliting the directories and run parallel rsyncs on them. It may > cost me some network, but I can control that from the MAX_RS

Re: gnu --target-dir, how to fake with rsync?

2009-10-10 Thread Matthias Schniedermeyer
On 10.10.2009 17:43, Andrew Gideon wrote: > On Sat, 10 Oct 2009 15:54:25 +0200, Matthias Schniedermeyer wrote: > > > It makes a tremendous difference if you have to fork/exec one program > > per file for, say, 100,000 files. Or (-t here) about 10 instances doing > > 10,00

Re: gnu --target-dir, how to fake with rsync?

2009-10-10 Thread Matthias Schniedermeyer
On 10.10.2009 13:33, Andrew Gideon wrote: > On Sat, 10 Oct 2009 00:22:11 -0400, Sam wrote: > > > As far as I know it's still there > > That's what I thought. So what is the point behind --target-dir? > > Sorry for the puzzlement... Performance. It makes a tremendous difference if you have to

Re: rsync exclude files based on filesize

2009-09-30 Thread Matthias Schniedermeyer
On 30.09.2009 08:00, Rahul Nabar wrote: > On Wed, Sep 30, 2009 at 4:41 AM, Paul Slootman wrote: > > On Tue 29 Sep 2009, Rahul Nabar wrote: > > > >> Is there a way to set rsync excludes by filesize? I already do > > > > Did you look in the manpage? > > > > "man rsync", search for "size" and the 5th

Re: time variable throttling rsync traffic

2009-09-15 Thread Matthias Schniedermeyer
On 15.09.2009 12:11, Eric S. Johansson wrote: > On 9/14/2009 3:55 PM, Andrew Gideon wrote: > >>> If there is one or more bottleneck link in the network (places where >>> traffic feeds from one or more links with aggregate larger capacity >>> into a link with smaller capacity) then it makes sense th

Re: how to use rsync installed on network

2009-09-08 Thread Matthias Schniedermeyer
On 08.09.2009 13:42, e-letter wrote: > On 07/09/2009, Matt McCutchen wrote: > > On Mon, 2009-09-07 at 23:22 +0100, e-letter wrote: > >> Scenario: file.txt on local machine, to be transferred to remote host. > >> Remote host has rsync installed. Reading the manual I the examples > >> describe scena

Re: rsync algorithm for large files

2009-09-04 Thread Matthias Schniedermeyer
On 04.09.2009 18:00, ehar...@lyricsemiconductors.com wrote: > > Why does it take longer the 3rd time I run it? Shouldn?t the performance > always be **at least** as good as the initial sync? Not per se. First you have to determine THAT the file has changed, then the file is synced if there was

Re: Rsync completed successfully, but files are not identical

2009-08-16 Thread Matthias Schniedermeyer
ns that would make huge differences in this scenario. > Thanks, > Oren Mark > > -Original Message- > From: Mark, Oren > Sent: Sunday, August 16, 2009 1:01 PM > To: Matthias Schniedermeyer > Cc: rsync@lists.samba.org; Mark, Oren > Subject: RE: Rsync completed s

Re: Rsync completed successfully, but files are not identical

2009-08-16 Thread Matthias Schniedermeyer
times" correctly you can only change both atime & mtime together. So IF the backup-program blindly resets the values (doesn't check mtime again) then an mtime change would be reverted by it. > -Original Message- > From: Matthias Schniedermeyer [mailto:m...@citd.de]

Re: Rsync completed successfully, but files are not identical

2009-08-16 Thread Matthias Schniedermeyer
On 16.08.2009 11:38, Mark, Oren wrote: > Hi All, > > I came into a strange issue running rsync on directory with ~500,000 files. > Some of the file, although with same time stamps and size on source and > destination, were different on the destination. > The destination is just a mirrored area, a

Re: Handling spaces in filenames

2009-08-12 Thread Matthias Schniedermeyer
On 11.08.2009 21:04, Larry Alkoff wrote: > Man rsync says that > "If you need to transfer a filename that contains whitespace, > you'll need to either escape the whitespace in a way that the remote > shell will understand, or use wildcards in place of the spaces.". > > I am regularly do

Re: Possibly bug in rsync-3.0.6 when spaces are there in destination path

2009-07-28 Thread Matthias Schniedermeyer
On 28.07.2009 16:46, paresh masani wrote: > ... > let me know if I am missing something obvious. Option "-s" a.k.a. "--protect-args" is exactly for this. see 'man rsync' Bis denn -- Real Programmers consider "what you see is what you get" to be just as bad a concept in Text Editors as it

Re: --delete-before doesn't seem to actually be deleting before transfer

2009-07-14 Thread Matthias Schniedermeyer
On 14.07.2009 13:01, Tim Edwards wrote: > I have a script transferring some backup files onto a USB stick, which > has limited space. I use rsync 3.0.5 with the following command: > rsync -av --delete-before /local/backups/dir/backup1_todaysdate > /local/backups/dir/backup2_todaysdate > /local/back

Re: Rsync with spaces in source or destination path

2009-07-04 Thread Matthias Schniedermeyer
On 05.07.2009 02:29, paresh masani wrote: > Hi, I am trying to transfer a file that has spaces in its name. The rsync > gives me below error. Am I doing anything wrong? What you are looking for is "-s" a.k.a. "--protect-args' - man rsync - -s, --protect-args no space-splitting; w

Re: Listing Changed Files Without Two Copies?

2009-07-03 Thread Matthias Schniedermeyer
On 03.07.2009 18:06, Jon Watson wrote: > Hi All, > > I am aware that rsync can be run to just list the files that have > changed between the source and destination. I would like to capitalize > on that feature to monitor some development that is going on in order to > get a complete list of f

  1   2   >