Re: rsync through multiple ssh hops with password authentication prompt

2005-10-19 Thread Matt McCutchen
On Thu, 2005-10-20 at 01:15 +0100, Manuel López-Ibáñez wrote: > [...] There is a FAQ section (which I linked in my first message) explaining > how to do this using keys. That is not the point. For example, isn't it > possible for the root of middle (or some attacker) to get my keys and > use the

Re: rsync through multiple ssh hops with password authentication prompt

2005-10-19 Thread Manuel López-Ibáñez
Matt McCutchen wrote: Martin Schröder's suggestion of ssh-agent might be better in the long term or if the X business doesn't work, but I got the impression you didn't want to set up any kind of special SSH authentication. Yes, that is precisely the point. There is a FAQ section (which I l

Re: rsync through multiple ssh hops with password authentication prompt

2005-10-19 Thread Manuel López-Ibáñez
Matt McCutchen wrote: On Thu, 2005-10-20 at 00:05 +0100, Manuel López-Ibáñez wrote: I understand completely that it's not rsync's job to handle ssh password prompts, however, isn't it the first password prompt handled by rsync? Why the other password prompts cannot be handled in a similar w

Re: rsync through multiple ssh hops with password authentication prompt

2005-10-19 Thread Martin Schröder
On 2005-10-19 17:36:55 +0100, Manuel López-Ibáñez wrote: > source $ ssh middle > middle's password: pass_middle > middle $ ssh target > target's password: pass_target > target $ Use keys and ssh-agent. :-) [...] > Now, I want to transfer files from source to target. Check out ssh's forwarding o

Re: rsync through multiple ssh hops with password authentication prompt

2005-10-19 Thread Manuel López-Ibáñez
Wow! Dude! This is the most comprehensive, user-friendly, nice, knowledgeable answer I have ever received. Thanks very much! That answers everything. I understand completely that it's not rsync's job to handle ssh password prompts, however, isn't it the first password prompt handled by rsync?

Re: rsync through multiple ssh hops with password authentication prompt

2005-10-19 Thread Matt McCutchen
On Wed, 2005-10-19 at 22:22 +0100, Manuel López-Ibáñez wrote: > Thanks very much. However, for several reasons, I cannot apply that > "trick" in my case. Apart from those reasons, there is no X server on > middle or target at all. [...] And what should I put in $DISPLAY? Graphical programs find

Re: **MY** wildcard in recursive rsync

2005-10-19 Thread Wayne Davison
On Tue, Oct 18, 2005 at 04:05:18PM +0200, stoil valchkov wrote: > Obviously I would like to get all files & directories which has in path > **MY** The only solution rsync provides is to scan all directories, like this: --include='*/' --include='*MY*/*' --include='*MY*' --exclude='*' That creates

Re: Help needed with filtering rules - how to copy named director ies only

2005-10-19 Thread Wayne Davison
On Wed, Oct 19, 2005 at 03:41:16PM +0100, CARTER-HITCHIN, David, FM wrote: > What would be really nice, and I imagine quite easy from a coding > perspective would be to allow the user to apply a regex match on the > full pathname of the files being transferred. It's already possible to match on th

Re: Two questions; Synchronious Scanning and Home Directories

2005-10-19 Thread Wayne Davison
On Sun, Oct 16, 2005 at 09:17:24PM -0400, Jason Hoover wrote: > The first is, would scanning on the destination or client side while > receiving the file list be possible? The best solution is to switch over to a more incremental protocol that would allow us to avoid the pre-scan of an entire hier

Re: Vanished Files issue/enhancement

2005-10-19 Thread Wayne Davison
On Wed, Oct 12, 2005 at 03:59:51PM -0400, Bill Crowell wrote: > I request an option flag '--ignore-vanished' to be added. This flag > would disable exit 24. This is easy to code up using a shell-script wrapper, and one such wrapper has even been posted to the mailing list before. ..wayne.. -- T

Re: Rsync over SSH-tunnel A->B->C using daemon on C

2005-10-19 Thread Wayne Davison
On Wed, Oct 12, 2005 at 12:45:09PM +0200, Stefaan Lhermitte wrote: > ssh HOST_B ssh HOST_C rsync --daemon What you should check is: (1) was the daemon actually started? Or did it complain (in the log file) and die? (2) Is the daemon configured to listen on port 8873 instead of 873? (You can f

Re: rsync through multiple ssh hops with password authentication prompt

2005-10-19 Thread Manuel López-Ibáñez
Matt, Thanks very much. However, for several reasons, I cannot apply that "trick" in my case. Apart from those reasons, there is no X server on middle or target at all. Moreover, which password-prompting program should I use? middle is an OpenBSD machine. And what should I put in $DISPLAY?

Re: rsync through multiple ssh hops with password authentication prompt

2005-10-19 Thread Matt McCutchen
Manuel, The trouble in all three cases is that rsync expects to have the SSH data stream to "middle" all to itself, but you need to slip a password into this stream first so that the connection to "target" can be made. Here's what I think would be easiest. If ssh's input is not a terminal, but $

rsync through multiple ssh hops with password authentication prompt

2005-10-19 Thread Manuel López-Ibáñez
Hi, I have searched the whole internet and mailing list and I was unable to find a clear answer to this. The method described in the FAQ [1] are not useful for me. Three machines source, middle, target. ssh into middle from source requires password pass_middle. ssh into target from middle req

RE: Help needed with filtering rules - how to copy named director ies only

2005-10-19 Thread CARTER-HITCHIN, David, FM
Hi Wayne, What would be really nice, and I imagine quite easy from a coding perspective would be to allow the user to apply a regex match on the full pathname of the files being transferred. Anyway, thanks for your confirmation - I have worked around this problem. Cheers, David Carter-Hitchin.

rsync and o_direct

2005-10-19 Thread Simon Hargrave
Hi We currently use rsync for various jobs at our company. We are now looking at using it to create an offsite synchonised copy of an Oracle 10g RAC archive logs area. The source area is on Oracle OCFS filesystem. The OCFS filesystem requires all reads/writes to be performed with the O_DIRECT o

RE: Initialising a mirror

2005-10-19 Thread Tony
"slow rsync"    limited by bandwidth (or whatever) compared to FAST (LAN), SLOW (Internet), FAST (LAN)  from "pointA" to "pointB"   100Gb of data    -- how much/many of what is changing? How many files?  How big? (ranges)  where changed? How many (major) directories? What kind of wi

Re: rsync --compare-dest creates all dirs and symlinks

2005-10-19 Thread Dirk Schenkewitz
Hi Wayne, Wayne Davison wrote: On Tue, Oct 18, 2005 at 08:07:56PM +0200, Dirk Schenkewitz wrote: What happens is that rsync creates the whole tree of directories below /data/A/gany.1/lib and also created all symlinks within that tree. Yes, that's the way rsync currently works. I'm consider

RE: Initialising a mirror

2005-10-19 Thread Cyrille Bollu
Hi, thank you for your answer. But what do you mean by "slow rsync"? Do you mean limiting bandwith? I think this will not be an option with 100Gb of data to synchronise... However, I like your idea with the LAN: I think I will bring my mirror to the remote site :-) Just for the record, I didn

Initialising a mirror

2005-10-19 Thread Cyrille Bollu
Dears, I would like to mirror data from 2 servers connected together via VPN over ADSL lines (dwn 2Mbps/Upld 512Kbps). I'm sure rsync is one of the best tool to keep these data in sync but how should I use it to initialise the mirror? I'm currently testing the solution with 10Gb of data to kee