Re: Why is my rsync transfer slow?

2016-02-06 Thread dbonde+forum+rsync . lists . samba . org
Den 2016-01-26 kl. 09:06, skrev Simon Hobson: >>> >>The other option is >>> >> >>> >>HD <--FW800--> Computer <--USB2 or Ethernet 1000Mbit --> NAS >> > >> >If you use a network connection then you've still got that network layer. > Just thinking a bit more about that ... > > Is your normal setup

Re: Why is my rsync transfer slow?

2016-02-06 Thread dbonde+forum+rsync . lists . samba . org
I scrapped all my previous progress and started over with a different "connection setup", now the NAS is connected to the computer using 1 Gbit wired ethernet, while the source disk is still using FW800. On bigger files I now typically get 20-30 MB/s so that was a substantial improvement. It s

Re: Why is my rsync transfer slow?

2016-01-25 Thread dbonde+forum+rsync . lists . samba . org
On 2016-01-25 01:13, Selva Nair wrote: On Sun, Jan 24, 2016 at 4:48 PM, mailto:dbonde+forum+rsync.lists.samba@gmail.com>> wrote: That doesn't make sense. Both the source and destination path contains simple alphanumeric characters, no more no less. Why would it matter whether the

Re: Why is my rsync transfer slow?

2016-01-25 Thread dbonde+forum+rsync . lists . samba . org
Thank you. I will try your suggestions. First I will connect the NAS directly to the computer (Do you recommend USB2 or 1 Gb Ethernet? Or should I daisy chain external HD and NAS? Then it would look like this: Computer <--FW800--> HD <--USB2--> NAS The other option is HD <--FW800--> Computer

Re: Why is my rsync transfer slow?

2016-01-24 Thread dbonde+forum+rsync . lists . samba . org
On 2016-01-24 20:39, Selva Nair wrote: Sorry for butting in, but hope this helps: The command line you posted earlier reads % rsync -HzvhErlptgoDW --stats --progress --out-format="%t %f %b" /source/ /destination/ I think Kevin is asking you write out that /source/ and /destination exactly a

Re: Why is my rsync transfer slow?

2016-01-24 Thread dbonde+forum+rsync . lists . samba . org
On 2016-01-24 03:51, Kevin Korb wrote: Are you rsyncing from one to the other? Both of them to somewhere else? One at a time to somewhere else? Why won't you just show your actual command line and an ls -li of the correct source and incorrect target? Are you trolling me? All the information

Re: Why is my rsync transfer slow?

2016-01-23 Thread dbonde+forum+rsync . lists . samba . org
On 2016-01-23 23:24, Kevin Korb wrote: I need to know what the paths were so I know how they relate to the file names you listed. I posted the relevant parts of the path in a previous message /Volumes/A/Backups.backupdb/mm/2011-06-23-040258/path/DSCF0748.JPG /Volumes/B/Backups.backupdb/mm/2011

Re: Why is my rsync transfer slow?

2016-01-23 Thread dbonde+forum+rsync . lists . samba . org
On 2016-01-23 22:59, Kevin Korb wrote: > I want to know what your whole command line was so I can understand > your results. % rsync -HzvhErlptgoDW --stats --progress --out-format="%t %f %b" /source/ /destination/ (and after the interruption I removed z) -- Please use reply-all for most replies

Re: Why is my rsync transfer slow?

2016-01-23 Thread dbonde+forum+rsync . lists . samba . org
On 2016-01-23 22:02, Kevin Korb wrote: What was your rsync source and target that made those? What do you mean? Filesystem is HFS (Mac OS X). Rsync version is 3.1.2 from MacPorts. Source is a regular directory/folder on an external HD, destination is a disk image. -- Please use reply-all fo

Re: Why is my rsync transfer slow?

2016-01-23 Thread dbonde+forum+rsync . lists . samba . org
On 2016-01-23 21:16, Kevin Korb wrote: > As long as it still sees both links it is fine. > > Essentially, the way it works is that whenever rsync -H (on the > source) sees a file with a link count >1 it remembers the > inode#>filename pair. If it finds another instance of that inode it > then lin

Re: Why is my rsync transfer slow?

2016-01-23 Thread dbonde+forum+rsync . lists . samba . org
On 2016-01-23 17:50, Kevin Korb wrote: It will, assuming it sees both links in the same rsync run. How does one handle interrupted transfers if one wants to preserve hard links? Would --partial and --append-verify work? -- Please use reply-all for most replies to avoid omitting the mailing l

Re: Why is my rsync transfer slow?

2016-01-23 Thread dbonde+forum+rsync . lists . samba . org
On 2016-01-21 09:20, dbonde+forum+rsync.lists.samba@gmail.com wrote: I run a rsync job transferring about 45 million files/approximately 1.8 TB data (a Mac OS X Time Machine backup) over a 100 MBit connection. I use rsync 3.1.1 from MacPorts (I first tried the built in rsync, version 2.6.9,

Re: Why is my rsync transfer slow?

2016-01-21 Thread dbonde+forum+rsync . lists . samba . org
On 2016-01-21 15:00, Kevin Korb wrote: > First, don't use -z on a local copy. It will only make rsync slower > for no reason at all. Thanks. Hadn't thought about that. I just copied most from the spelled out "archive" list of switches. But is rsync so "stupid" that it really considers z for a

Why is my rsync transfer slow?

2016-01-21 Thread dbonde+forum+rsync . lists . samba . org
I run a rsync job transferring about 45 million files/approximately 1.8 TB data (a Mac OS X Time Machine backup) over a 100 MBit connection. I use rsync 3.1.1 from MacPorts (I first tried the built in rsync, version 2.6.9, since it has a Mac OS X specific cache parameter, but it ran out of mem

Possible Bug or limitation in Cygwin 1.7 and Rsync and file number limit

2009-06-18 Thread Kyles Mailing Lists
I'm not sure if this is a bug or a limitation that can be worked around with a setting somewhere, but I have found a problem with cygwin 1.7 while using rsync. I have been using rsync and cygwin v1.5 for quite some time. I recently started testing cygwin v1.7 and I ran into a problem with an a

Possible Bug or limitation in Cygwin 1.7 and Rsync and file number limit

2009-06-18 Thread Kyles Mailing Lists
I'm not sure if this is a bug or a limitation that can be worked around with a setting somewhere, but I have found a problem with cygwin 1.7 while using rsync. I have been using rsync and cygwin v1.5 for quite some time. I recently started testing cygwin v1.7 and I ran into a problem with an a

Possible Bug or limitation in Cygwin 1.7 and Rsync and file number limit

2009-06-18 Thread lists
I'm not sure if this is a bug or a limitation that can be worked around with a setting somewhere, but I have found a problem with cygwin 1.7 while using rsync. I have been using rsync and cygwin v1.5 for quite some time. I recently started testing cygwin v1.7 and I ran into a problem with an a

Possible Bug or limitation in Cygwin 1.7 and Rsync and file number limit

2009-06-18 Thread lists
I'm not sure if this is a bug or a limitation that can be worked around with a setting somewhere, but I have found a problem with cygwin 1.7 while using rsync. I have been using rsync and cygwin v1.5 for quite some time. I recently started testing cygwin v1.7 and I ran into a problem with an a

Re: Partial Transfer Problem

2008-08-21 Thread lists
< The receiving rsync first creates a temporary file in the destination directory with a name in the format ".foo.XX", where "foo" < represents the name of the source file. Only when rsync is interrupted does it convert the temporary file to a partial file named exactly "foo" < and placed in

Partial Transfer Problem

2008-08-21 Thread lists
I am using the command options listed below. If I set --partial or --partial-dir, I see the partial file appear as expected. However, even with --partial-dir set as you see below, the .rsync-partial directory is never created. Instead the partial file just appears in the directory. The bigge

File Locking

2008-08-18 Thread lists
On Mon 18 Aug 2008, [EMAIL PROTECTED] wrote: > > >> The way I solved this problem for a data-mirroring system was to use a > >> small wrapper script that ensures only one invocation of rsync is ever > >> running at one time. This proved to be a robust solution for our situation. > > >> --Kyle >

File Locking

2008-08-18 Thread lists
> A different Kyle wrote: > I have a situation that requires the files that rsync is > uploading/downloading to be locked. The reason is because it is possible > to have more than one copy of rsync running and without file locking, > the additional copies simply retry to upload/download a file tha

File Locking

2008-08-18 Thread lists
First let me say that rsync is a wonderful program and thank you all for the hard work that went into it's creation. On to my question. I have a situation that requires the files that rsync is uploading/downloading to be locked. The reason is because it is possible to have more than one copy

Re: Rsync fails to rename on Windoze2003

2006-06-24 Thread Corey Wirun - Lists
27; at the beginning.  But why does this only occur at random, not for every file?  Note the 'false alarms' above - does that mean anything?   Does anyone have any further notion why I get these rename errors?   Thanks in Advance! Corey.   - Original Message - From: Co

Rsync fails to rename on Windoze2003

2006-06-24 Thread Corey Wirun - Lists
Hi All,   I've seen several variations on this topic, but nothing exactly the same:   I have two Windows 2003 servers that I want to use rsync (2.6.8) to mirror.  These machines are separated by a WAN.   Initial attempts to get rsync working between them have not been successful.  The firs

Re: Update: Re: Help with synchronizing two directories on remoteservers

2005-10-14 Thread symbulos - ethical services (external mailing lists)
Here are answers to all you questions, I hope. The platforms are: 1)administration desktop (pc here) Mandriva LE2005 2)servera Debian 3.0 3)serverb Fedora Core 3 ssh from servera to serverb (in a remote ssh shell from "pc here") is working ssh from serverb to severa (in a remote ssh shell fr

Update: Re: Help with synchronizing two directories on remote servers

2005-10-10 Thread symbulos - ethical services (external mailing lists)
los - ethical services (external mailing lists) wrote: > > What I do is to go to one of the server (server a) as > > root using ssh, navigate to the directory, and write > > > > rsync -avz [EMAIL PROTECTED]:directory/ ./ > > > > This is the error we get >

Re: Help with synchronizing two directories on remote servers

2005-10-10 Thread symbulos - ethical services (external mailing lists)
The fact is, we can login as username on this server. Instead of giving an error should then ask me for password, I think. Corrado On Monday 10 Oct 2005 17:44, Paul Slootman wrote: > On Mon 10 Oct 2005, symbulos - ethical services (external mailing lists) wrote: > > What I do is to

Re: Help with synchronizing two directories on remote servers

2005-10-10 Thread symbulos - ethical services (external mailing lists)
I apologise for the incongruous posting. We have two webservers, a and b, both of them with rsync installed. We would like to rsync one directory on one server with another directory on another server. What I do is to go to one of the server (server a) as root using ssh, navigate to the direc

Help with sincronizing two directories on remote servers

2005-10-10 Thread symbulos - ethical services (external mailing lists)
Dear friends, a newbie here. we have two webservers, a and b, both of them with rsync installed. We would like to rsync one directory on one server with another directpory on another server. What I do is to go to one of the server (server a) as root using ssh, navigate to the directory, and

Incremental Backups

2005-02-16 Thread lists
I read the following hint at: http://www.mikerubel.org/computers/rsync_snapshots/#Incremental mv backup.0 backup.1 rsync -a --delete --link-dest=../backup.1 source_directory/ backup.0/ I simply want to maintain a dated backup of a server so that I could always go back to a certain date. I would

Timestamp backups

2005-02-07 Thread lists
I'm running an linux server and needing to back it up each day to a Mac OS X Server. The sync works fine, however a dated backup is not working for some reason. I'm trying to use the following to create those backups, could someone please point out why this is not working or why it there is a Mac

Re: Deleting a remote file when deleted locally...

2003-11-11 Thread Net Virtual Mailing Lists
Yeah, that does not work because it only seems to operate on an entire directory not an individual file.. - Greg -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Fwd: fink rsync --daemon failure

2003-02-19 Thread lists
Begin forwarded message: From: Bill Bumgarner <[EMAIL PROTECTED]> Date: Wed Feb 19, 2003 9:31:24 AM US/Eastern To: "George D.Plymale" <[EMAIL PROTECTED]> Subject: Re: fink rsync --daemon failure On Wednesday, Feb 19, 2003, at 08:14 US/Eastern, George D.Plymale wrote: It would seem that OS X

Re: MacOS X Rsync Server

2003-02-19 Thread lists
Wednesday, February 19, 2003, at 07:37 AM, jw schultz wrote: On Wed, Feb 19, 2003 at 06:50:59AM -0500, lists wrote: The first two lines are the daemon stopping/starting: Feb 19 06:48:11 x rsyncd[25661]: rsync error: received SIGUSR1 or SIGINT (code 20) at rsync.c(280) Feb 19 06:48:18 x rsyncd[2951

Re: MacOS X Rsync Server

2003-02-19 Thread lists
: Invalid argument On Wednesday, February 19, 2003, at 06:39 AM, jw schultz wrote: On Wed, Feb 19, 2003 at 12:28:58AM -0500, lists wrote: I am trying to set up a MacOS X rsync server and am not having much success at the moment. I'm able to see the "share" alright, but here is wh

MacOS X Rsync Server

2003-02-19 Thread lists
I am trying to set up a MacOS X rsync server and am not having much success at the moment. I'm able to see the "share" alright, but here is what I get when I actually try to copy anything to the server: #rsync -vz /Users/myhome localhost::backup @ERROR: setgroups failed rsync: connection unexpe

Write failed flushing stdout buffer.

2002-01-27 Thread lists
3 100%0.00kB/s0:00:00 wrote 30496 bytes read 327051 bytes 14593.76 bytes/sec total size is 419896352 speedup is 1174.38 Write failed flushing stdout buffer. write stdout: Broken pipe time /usr/local/bin/rsync -avzP host: /bkup-zone --delete this is the command which is bein