Wayne:
Thank you for responding.
On Thu, Mar 13, 2014 at 8:37 PM, Wayne Davison wrote:
> On Tue, Mar 11, 2014 at 3:11 PM, Doug Robinson > wrote:
>
>> I was wondering what folks thought of a proposal to enhance rsync to be
>> able to create and maintain a cache of {f
fication by reseting the 64-bit mtime (a
trick noted in https://lists.samba.org/archive/rsync/2011-August/026676.html
).
That last URL was a find by one of my co-workers. Now I need to go track
the "db.diff" patch that Wayne notes and see if I can tweak it to do the
64-bit
stuff and so o
AND doing the necessary CPU
intensive checksum computation. It would be a huge win.
Thank you.
Doug
>On 03/11/2014 06:11 PM, Doug Robinson wrote:
>> Folks:
>>
>> When using rsync to copy huge amounts of data I've found that a
>> significant amount of time is spent
Ah, forgot to mention that we can't preserve time-stamps and matching byte
counts are false negatives so we really need to use file checksums as
comparisons.
Thanks again.
Doug
--
WANdisco // *Non-Stop Data*
t. 925-396-1125
e. doug.robin...@wandisco.com
--
Join us in New York an
letely invalidated (or re-created)
if the file system became corrupt. That could be handled via an "rm -rf"
of the cache.
Thoughts?
Thank you.
Doug
--
WANdisco // *Non-Stop Data*
t. 925-396-1125
e. doug.robin...@wandisco.com
--
Join us in New York and San Francisco f
On Mon, 18 Oct 2010, Steven Levine wrote:
on 10/18/10 at 01:41 PM, d...@safeport.com said:
Hi Doug,
If I change link-dest=../../201009/myserver/home/ it starts a new base.
Via google and RTFM it seems that naming schemes keep the name of the
link-dest directory constant. Is this a
I have this working [almost] perfectly. Progress to this point would have not
been possible without the kind help received here, so many thanks to the list for
its advice and forbearance. And yet here I am again :)
I set up a naming structure of mm for monthly backups. With 201003 being the
I asked a question about not link-dest not creating hardlinks and got ideas and
hints that led to the solution which is the link-dest dir must/should be
relative to the destination and/or the destination must be empty. I did both and
that works fine.
My question is what would cause rsync to co
On Tue, 5 Jan 2010, Wayne Davison wrote:
On Mon, Jan 4, 2010 at 12:33 PM, wrote:
rsync -vaxH --numeric-ids --delete --exclude=/home/apache/logs \
--link-dest=/mnt/200912/newharbor/home -e ssh
newharbor.safeport.com:/home \
201001/newharbor/home/
Is that newharbor/home/
The command below was run on FreeBSD 7.2 with rsync-3.0.3.
The command works but copies all files, i.e. no hard links created.
rsync -vaxH --numeric-ids --delete --exclude=/home/apache/logs \
--link-dest=/mnt/200912/newharbor/home -e ssh newharbor.safeport.com:/home \
201001/newharbor/ho
Not trying to sound harsh or anything but this issue has been discussed at
length in the list over the past 3 years. PLEASE search through the
archives. When searching try searching on the word ROBOCOPY as that is an
often suggested means of handling windows ACL's.
2009/6/25 dir_teh
> hi Srini
My experience working with a Windows client with a Windows Server has not
been all that great. In most cases it is not the client itself it is just
the typical pain that you experience when trying to run an open source
product on Windows. Our biggest issues with using the windows client and
serve
That is what we did albeit a little differently and then I wrote a
Perl script to parse it and give me what I want.
On Feb 6, 2008 3:54 PM, Matt McCutchen <[EMAIL PROTECTED]> wrote:
> On Wed, 2008-02-06 at 21:34 +0100, Mojca Miklavec wrote:
> > we're running an rsync on a server and would like to
You are correct and I am out of the loop. Evidently the client
developer used this approach to solve our Vista problem but I either
forgot or was not informed. Probably the former =)
On Jan 30, 2008 1:45 PM, Matt McCutchen <[EMAIL PROTECTED]> wrote:
> On Wed, 2008-01-30 at 13:09 -0
We have hit the same problem and what we found out was that Vista
changed something and either rsync or cygwin can't determine the
permissions and so nothing (or null) is sent across and this seems to
cause the directory to be created this way. We have only seen this on
Vista and have since backed
More often than not it is a permissions issue. The private-key that
you use must have permissions set to 600. Try separat8ng the problem
by just using ssh (no rsync). try this:
ssh -vvv -i your-private-key -l your-username 192.168.x.x (or whatever
the host is)
Look at the verbose output and se
Nevermind. I figured it out after some trial and error. Basically I have
my forced ssh command script intercepting the rsync call and setting the
parameters myself.
Thanks all of for your help. I still may have more questions but so far it
is looking good!
Doug
On Dec 7, 2007 2:29 PM, Doug
Matt,
Questions for you based on your earlier response
>
> Anyway, it's easy do a secure rsync daemon setup with ssh connections
> and authentication. Make a separate daemon configuration file for each
> user listing only the modules he/she is allowed to access. Then set
> each user's forced co
i am seeing:
rsync --server -vlogDtpr --log-format=%o
Is there a way to keep these from appearing or should I just append the same
options on the end with different values to override these?
Thanks
Doug
--
What profits a man if he gains the whole world yet loses his soul?
--
To unsubscribe
On Dec 6, 2007 12:52 AM, Matt McCutchen <[EMAIL PROTECTED]> wrote:
> On Wed, 2007-12-05 at 23:21 -0500, Doug Lochart wrote:
> > Now I am having another issue and that is passing a log format in the
> > rsync-path. I can see it is coming over but for some reason a defauly
&
On Dec 5, 2007 9:59 PM, Matt McCutchen <[EMAIL PROTECTED]> wrote:
> On Tue, 2007-12-04 at 15:59 -0500, Doug Lochart wrote:
> > Greetings all. Due to security concerns we are switching our backup
> > processes from "SSH tunnel to rsync daemon" to "Running rsync
commands executed without having
a daemon running?
thanks
Doug
--
What profits a man if he gains the whole world yet loses his soul?
--
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
We were trying to introduce a better client side log format so that we could get timestamps and module names etc. In the rsync documentationit looks like you can use --log-format for the client ... there is even a sentence saying that this format would not interfere with the rsybc daemons
format.
Yes this is another connection reset issue but all I am asking is some pointers on how I can possibly determine what and why this is happening. Its easy to say its a network issue but the bosses and clients want to know how to fix this said "network issue."
I have read the rsync issues list. Some
ey are set properly
i.e 100BaseT, 1000BaseT.Any other ideas?If I did not mention this before, it is not consistent and we have not been able to reproduce it at will.thanksDoug
On 5/10/06, Wayne Davison <[EMAIL PROTECTED]> wrote:
On Wed, May 10, 2006 at 02:35:47PM +, Doug Lochart wrote:> C
rite 87 bytes: phase "unknown" [generator]: Broke\n pipe (32)2006/05/09 05:58:41 [15403] rsync error: error in rsync protocol data stream (code 12) at
io.c(1126) [generator]Doug-- What profits a man if he gains the whole world yet loses his soul?
--
To unsubscribe or change options: h
I have looked through the archives for this error and found some instance of it but no solutions. I have an idea for a workaround but I would like to get some clarification.1) Unix has as a limit 256 for the length of a file name. Does this limit also apply to a fully qualified path?
2) The pat
ed and the contexts lost. So what I mean in atomicity is if a client starts a session can I trust the log lines to provide a context or will everything be intertwined?
We are using rsync in daemon modethanks Doug-- What profits a man if he gains the whole world yet loses his soul?
--
To unsubscribe
I saw in the rsync.d documentation that there is a perl script to parse the default log format for tranferred files.Is there a utility out there that will handle the server/client log files even if you chaneg the format around?
thanksDoug-- What profits a man if he gains the whole world yet loses h
Thank you for your insight. It has been very beneficial!On 3/2/06, Tevfik Karagülle <[EMAIL PROTECTED]> wrote:
> Hi all, we are just beginning to dive into rsync. I have> limited experience with just playing around with the examples
> and reading all the docs that I can. I just read an> interest
On 3/1/06, Peter <[EMAIL PROTECTED]> wrote:
>
> --- Doug Lochart <[EMAIL PROTECTED]> wrote:
>
> > Windows (cw)Rsync Client --> Linux Rsync server
> >
> > 1) Should we abandon cwrsync for cygwin + rsync?
> > Have the
> > disparities between
ch in advance
Doug Lochart
--
What profits a man if he gains the whole world yet loses his soul?
--
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
The "--blocking-io" option fixed the problem. Thanks to jw for the solution.
Thanks also to Wayne Davison for his response.
Doug
-Original Message-
From: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] On Behalf Of jw schultz
Sent: Tuesday, December 30, 2003 12:45 PM
To: [EMAIL
;s the rsync command I've been using:
rsync -lrpogtz --delete --rsh=rsh --rsync-path=/usr/local/bin/rsync /home dest:/
I've been all over the net looking for help and am about to give up. Can anyone
out there provide some suggestions?
Regards,
Doug
--
To unsubscribe or change options:
. The only downside I see is that I
wouldn’t be able to delete files that are brand new, I’d have to
wait x minutes before I could delete a newly created file, but to me this is
not nearly as big of a deal as the original problem.
Anyone have any experience with this?
Thanks.
- Doug
Can anyone tell me how to send an HUP
signal?
- Doug
-Original Message-
From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED]]
On Behalf Of Doug Schasteen
Sent: Friday, September 06, 2002 10:19 AM
To: [EMAIL PROTECTED]
Subject: RE: error starting client-server protocol (code 5)
Ok, I played aro
/uucpd uucpd
#nntp stream tcp nowait usenet /usr/libexec/nntpd nntpd
# Added by Doug
rsync stream tcp nowait root/usr/local/bin/rsync --daemon
#
As you can see, the rest of the inetd lines have a name or something
after the path/command. The man pages didnt say to put
anyone seen a message like this before? Does it mean
that I set something up wrong? I can post my rsyncd.conf contents if necessary.
- Doug
my
root password is wrong when I know that it is right?
For reference: the command I’m using is
rsync –rv /www/ 10.0.0.9:/tmp/www/
Thanks
Doug
Is it possible that the destination directory is filling up? I believe
rsync saves deletes until the end, so that it knows there are no IO error
conditions that would cause it to exit without deleting. Filling up the
destination filesystem is probably one of those error conditions. Another
poss
#x27;ve told rsync not to sync "c", so it would have no
reason to delete it at the destination directory. Try using "." instead of
"*" to get more reliable results.
Doug
-Original Message-
From: g dm [mailto:[EMAIL PROTECTED]]
Sent: Tuesday, July 23, 2002 1
sday, June 27, 2002 11:46 AM
> To: Granzow, Doug (NCI); '[EMAIL PROTECTED]'
> Subject: RE: Largest file system being synced
>
>
> What are you moving to?
>
> -Original Message-
> From: Granzow, Doug (NCI) [mailto:[EMAIL PROTECTED]]
> Sent: Thursday, J
I am currently syncing 1.3 terabytes of files using rsync. This is spread
across about 12 filesystems all on the same server. Unfortunately we are
planning to move away from rsync because it is taking too long to run and it
takes up too much memory (some of the rsync processes take up 1.5 GB of
duce memory usage, since there will be fewer (but larger)
blocks of data, and therefore fewer checksums to store?
You suggested setting ARENA_SIZE to 0... I guess this would be done like
this?
% ARENA_SIZE=0 ./configure
Doug
David Bolen [mailto:[EMAIL PROTECTED]] writes:
> Granzow, Doug (NCI)
akes up? I only
ask because I would certainly prefer it used 218 MB instead of 646. :)
Doug
--
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
this -- I
suppose I could patch together something in Perl that would accomplish it,
but I wanted to check here first to see if such a thing has already been
written.
Thanks,
Doug
--
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http
port files over 2GB. 3) I didn't find a way to do this,
but I no longer have any need to.
Thanks,
Doug
> -Original Message-
> From: Dave Dykstra [mailto:[EMAIL PROTECTED]]
> Sent: Tuesday, February 12, 2002 11:54 AM
> To: Granzow, Doug (NCI)
> Cc: '[EMAIL PROTECTE
I just ran this again and got this error:
leelab/NCBI_Data_old/GenBank/htg
write failed on leelab/NCBI_Data_old/GenBank/htg : Error 0
rsync error: error in file IO (code 11) at receiver.c(243)
Received signal 16. (no core)
rsync error: received SIGUSR1 or SIGINT (code 20) at rsync.c(229)
The co
ta stream (code 12) at io.c(140)
> -Original Message-
> From: Granzow, Doug (NCI)
> Sent: Monday, February 11, 2002 11:08 AM
> To: '[EMAIL PROTECTED]'
> Subject: error in rsync protocol on large file
>
>
> I'm trying to rsync a filesystem from a Solaris 7 server
s run both directories look like the source server.
If I were to switch these around it works fine.
What I am doing wrong???
Doug
ctly. if anyone would
be willing to take a look and see what they think is happening, i'd
be grateful. other comments/nitpicks also welcome.
i've attached the output of 'diff -c origsrcdir mysrcdir'. thanks for
any help.
-- doug
diff -c orig/rsync-2.4.6/options.c rsync-2.
e files to this remote machine and then chown them to
'doug', no matter who owns them here on the local machine".
i need this, so i added this feature in my local tree. seems to work
ok on Solaris and Mac OS X. the code was good and easy to modify (yay).
the relevant usage
52 matches
Mail list logo
