Problems with Rsync

[Linux]

Sorry if this problem has been covered previously.
I'm having a problem with Rsync. I have created a script to put in cron
but that is besides the point.

Here is the script that i'm using.

#!/bin/sh
HOST=`/bin/hostname`

   
   
echo "--" >>/var/log/rsync.xxx.pulls.xxx
date >>/var/log/rsync.xxx.pulls.xxx
echo "BEGIN NEW ENTRY FOR $HOST" >> /var/log/rsync.xxx.pulls.xxx
rsync -crzvv --password-file /etc/rsync.passwd --bwlimit=120
rsync://[EMAIL PROTECTED]/pub/critical_full_daily/*.* /STOR-1/ >>
/var/log/rsync.xxx.pulls.xxx 2>&1
echo "--- END NEW ENTRY " >> /var/log/rsync.xxx.pulls.xxx
echo "" >>/var/log/rsync.xxx.pulls.xxx
   
   

Notice that *.* is used , i did this so that i can get all the files in
the directory. I have also tried *  as the variable.

IT will not transfer any of the files in the folder but it does check
the checksum of each file. well sort of, the log output is below.


--
Thu Apr  1 11:02:02 EST 2004
BEGIN NEW ENTRY FOR xxx.xxx.net
opening tcp connection to xxx.xxx.inet port 873
receiving file list ...
done
delta transmission enabled
B2D000254.bkf is uptodate
B2D000256.bkf is uptodate
B2D000260.bkf is uptodate
rsync: connection unexpectedly closed (553 bytes read so far)
rsync error: error in rsync protocol data stream (code 12) at io.c(165)
B2D000262.bkf is uptodate
B2D000263.bkf is uptodate
B2D000266.bkf is uptodate
B2D000267.bkf is uptodate
B2D000268.bkf is uptodate
B2D000271.bkf is uptodate
B2D000303.bkf is uptodate
rsync: connection unexpectedly closed (553 bytes read so far)
rsync error: error in rsync protocol data stream (code 12) at io.c(165)
--- END NEW ENTRY 

In addition both location are running the most current RPM version of
rsync from rsync.samba.org

Hopefully i have drawn a good picture of the problem

Thanks in advance
Edward
   
 

-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: Problems with Rsync

[Linux]

I gave you recommended a try but it doesn't seem to fix the issue.
Still recieving :

rsync: connection unexpectedly closed (584 bytes read so far)
rsync error: error in rsync protocol data stream (code 12) at io.c(165)

I've checked to make sure it's not a network issue and everything seems
to be fine. no packets dropping dns resolutions are working.

TIA
Edward


On Fri, 2004-04-02 at 02:49, Francis Montagnac wrote:
> > rsync -crzvv --password-file /etc/rsync.passwd --bwlimit=120
> > rsync://[EMAIL PROTECTED]/pub/critical_full_daily/*.* /STOR-1/ >>
> > /var/log/rsync.xxx.pulls.xxx 2>&1
> ...
> > Notice that *.* is used , i did this so that i can get all the files in
> > the directory. I have also tried *  as the variable.
> 
> Then, simply suppress *.* in your command, ie:
> 
>   rsync -crzvv --password-file /etc/rsync.passwd --bwlimit=120 \
>   rsync://[EMAIL PROTECTED]/pub/critical_full_daily/ /STOR-1/ >> \
>   /var/log/rsync.xxx.pulls.xxx 2>&1
> 
> Using such wilcard may fail by generating a too long argument list.

-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: Problems with Rsync

[Linux]

I added the option that you mentioned and it actually got worse :(
Doesn't even appear to have checked the files.


--
Fri Apr  2 16:20:19 EST 2004
BEGIN NEW ENTRY FOR xxx.xxx.net
opening tcp connection to xxx.xxx.net port 873
receiving file list ...
done
delta transmission enabled
rsync: connection unexpectedly closed (584 bytes read so far)
rsync error: error in rsync protocol data stream (code 12) at io.c(165)
rsync: connection unexpectedly closed (584 bytes read so far)
rsync error: error in rsync protocol data stream (code 12) at io.c(165)
--- END NEW ENTRY 


Thanks again

Edward

On Fri, 2004-04-02 at 13:45, Tim Moore wrote:
>  > Notice that *.* is used , i did this so that i can get all the files in
>  > the directory. I have also tried *  as the variable.
> 
> What does this do?  'n' is test run, shows actions, moves nothing.
> 
> rsync -crzvvn --password-file /etc/rsync.passwd --bwlimit=120
> rsync://[EMAIL PROTECTED]/pub/critical_full_daily/ /STOR-1/

-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Transfer Problems

[Linux]

Rsync has been a roller coaster ride for me..
One day it works fine the next day it doesn't.

The error i'm recieving is :

rsync: connection unexpectedly closed (399 bytes read so far)
rsync error: error in rsync protocol data stream (code 12) at io.c(165)


What does this mean and or hint to as the problem?

Also is there a Limit on the size of files Rsync can successfully
handle?

Thanks
Edward

-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: error in rsync protocol data stream (code 12) at io.c(165)

[Linux]

I get the same error even after taking the advise from the subsequent
posts to this message and other message stateing "error in rsync
protocol data stream (code 12) at io.c(165)" . 

The one thing that i have noticed is that is only errors when the size
of the directory on the remote machine exceeds 65GB. if it's 66GB the
transfer will fail half way through. The files i'm transfering are BKF
files from veritas backup exec and they range from 2-4GB each. In
addition my --timeout period is set to "4000"


So with that said if i keep the folder under 65GB i have no problems
what so ever. Also both machines taking part in this process are 2.4ghz
and have 512mb or pc-3200.


Thanks
Edward




On Mon, 2004-06-21 at 13:47, Nick Sylvester wrote:
> I am recieving a connection unexpectedly closed error while trying to 
> sync a directory on two machines.  Rsync is in my path on both 
> machines.  I am using ssh and I can connect to the server fine through 
> ssh.  I am using a vpn but have no problems connecting to any of the 
> servers with it.  This is the full error message I get:
> 
> Remote Machine: Connection refused
> rsync: connection unexpectedly closed (0 bytes read so far)
> rsync error: error in rsync protocol data stream (code 12) at io.c(165)
> 
> Here is the command I am using
> 
> 
> rsync -r --timeout=600 [EMAIL PROTECTED] machine:/opt/u91/scripts/sqlpath/* 
> /home/oracle/sqlpath
> 
> I am a new user to rsync and any suggestions or help would be much 
> appreciated.
> 
> Thanks
> Nick Sylvester

-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Rsync * files only changed/created in the last 7 days .

[Linux]

Hola,

I've been looking but seem to come to a dead end. 

I'm trying to rsync an entire dir yet i only i want just what was
created or changed in the past 7 days. I'm sure there is a way but i am
just a bit unclear on the syntax that would make that happen.
I would also like to delete on the client side what is over 14 days old
but i think i can get that with a simple cron job. 


If anyone could shed some light i would be very appreciative.
Thanks
Edward


-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Rsync : symlink issue

[Linux]

Hello all . 

I think i'm missing something.. 

I've made a folder on the rsync server called symlinks. 
With in that folder is monday,tuesday,etc...

Those folders contain symlinks to the backup files for that day. 

I want to transfer the files to a remote backup server. 

I must use the Folder where the symlinks are for security reasons. 

What would be the proper syntax to rsync the files that are on the other
end of those symlinks. 
I've tried the man pages and google but i'm stuck. 

Thanks
Edward


-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: Rsync : symlink issue

[Linux]

On Tue, 2004-07-20 at 16:01, Wayne Davison wrote:
> On Tue, Jul 20, 2004 at 03:49:10PM -0400, Linux wrote:
> > What would be the proper syntax to rsync the files that are on the
> > other end of those symlinks. 
> 
> Use --copy-links (-L).  If that fails then rsync probably doesn't have
> permissions to follow the symlink.
> 
> ..wayne.
Hola, 

Here is the rsync line i am currently trying to use that yeilds the
results in the log's listed below.

rsync -czvvL --password-file /etc/rsync.passwd --bwlimit=175
--timeout= rsync://[EMAIL PROTECTED]/critical/*
/STOR-1/backups/critical/ >> /var/log/rsync.vail.pulls.vegas.critical
2>&1
echo "--- END NEW ENTRY " >>
/var/log/rsync.vail.pulls.vegas.critical




Tried the -L option and i get this :

"opening tcp connection to vegas.scg.inet port 873
client: nothing to do: perhaps you need to specify some filenames or the
--recursive option?"

i then add --recursive as well and now i get :

"opening tcp connection to vegas.scg.inet port 873
receiving file list ...
done
delta transmission enabled
wrote 134 bytes  read 113 bytes  98.80 bytes/sec
total size is 0  speedup is 0.00
rsync error: some files could not be transferred (code 23) at
main.c(1045)"

*_*All Files/folders/symlinks are 777 so it's not a permissions issue i
don't believe. 

Please advise 

Thanks
Edward








-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

n00b needing help with rsync + win 9x

[Linux Geek]

hi,

my first post here.

i have knoppix linux 3.1 jan 01 release in iso format

i want to update it to jan 20th release.

i installed rsync for win 9x minimalist approach

http://optics.ph.unimelb.edu.au/help/rsync/rsync_pc1.html

command i used was :

rsync246 -e ssh -avP
rsync://ftp.gwdg.de/pub/linux/knoppix/KNOPPIX_V3.1-2003-01-20-EN.iso
KNOPPIX_V3.1-2003-01-01-EN.iso

i was able to connect to server, downloaded the
filelist, and it started to update the ISO.

the speed was extremly slow compared to jigdo...it was
taking the same amount of time as to download the
whole cd again.

can anyone plz throw some light on this !!! am i doing
anything wrong ???

also, the size it shows while updating the file is in
bytes or kilobytes ??


__
Do you Yahoo!?
Yahoo! Mail Plus - Powerful. Affordable. Sign up now.
http://mailplus.yahoo.com
-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html

newbie (no flames plz)

[Linux Geek]

i tried lots of things on my mandrake desktop. here is
what happens & what i tried.



i renamed the slackware.8.1.iso to slackware.9.0.iso

$rsync --stats -P --rsh=/usr/local/bin/ssh
ftp.somethng.com::/pub/slackware/slackware.9.* .

but rsync doesnt work & download the entire file !!

please help me !!

i have been trying to rsync - but everything else
seems to fail.

ps : if i dont include --rsh i get connection refused !!

__
Do you Yahoo!?
Yahoo! Platinum - Watch CBS' NCAA March Madness, live on your desktop!
http://platinum.yahoo.com
-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html

Re: Rsync behaviour on harddisc crash

[Linux Expert]

Yes, it'll sync the source directory (now empty) to Server B, deleting
everything due to the --delete option.

One solution I use is to place a check for the existence of a subdirectory
just before the rsync command in the script.  This was you can make rsync
contingent on the existence of that subdirectory, possibly notifying you via
email when it is not there.

So if you had a subdirectory named "data" directly in the folder you're
syncing, your script (bash) would have something like the following:

*rsync --list server::folder/data 1>/dev/null 2>/dev/null
if [ $? eq 0 ]
  then
rsync -a –delete server::folder  /folder
  else
mutt -nx -s "rsync skipped due to missing directory!" 
fi
*
The idea is that you first tell rsync to list all files under the
folder/data directory.  If that directory doesn't exist, the command will
fail with a non-zero exit value.  This is precisely what you check in the if
conditional.  Now your rsync will either sync properly with the assurance
that the source folder is still there, or notify you via email.

These commands, exit values, etc should all be tested on your server.  You
may not even have mutt installed, or an MTA (ie: Postfix) configured.
Testing is key.

On Thu, Mar 18, 2010 at 8:46 AM, Christian Röder wrote:

> I was just pondering:
>
>
>
> Lets look at Server A with one extra harddisc hdb, where hdb1 is mounted at
> /mnt/folder.
>
> /mnt/folder is the folder which should be mirrored on Server B.
>
> So Server B rsyncs
>
>
>
> rsynch -a –delete server::folder  /folder
>
>
>
> from Server A and gets all the new files and deletes all the files, which
> doesn't exist on Server A's /mnt/folder anymore.
>
>
>
> What would happen, if the harddisc hdb would fail?
>
> Will this happen?:
>
>
>
> harddisc hdb failes
>
> hdb1 is not automatically mounted at /mnt/folder
>
> Server B rsyncs from Server A, but /mnt/folder is empty, so rsync deletes
> every file in the mirror folder on Server B?
>
>
>
> Are my assumptions correct?
>
>
>
> Thanks in advance,
>
>
>
> Christian
>
>
>
> --
> Please use reply-all for most replies to avoid omitting the mailing list.
> To unsubscribe or change options:
> https://lists.samba.org/mailman/listinfo/rsync
> Before posting, read: 
> http://www.catb.org/~esr/faqs/smart-questions.html
>
-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: Rsync behaviour on harddisc crash

[Linux Expert]

On Thu, Mar 18, 2010 at 9:48 AM, Mac User FR  wrote:

> Wouldn't it be better to use conditional expressions from sh with a smaller
> footprint than rsync --list to check if the directory exists?
> I think on something like:
>
> -d file
> True if file exists and is a directory.
>
> (source: man sh)
>
>
>
It would if the remote file system was mounted locally - that's how I do
it.  However in this case rsync needs to connect to the remote filesystem
via an rsync daemon running on the remote server.

I first thought of recommending to run rsync --list server::module , but
that would be much more overhead as it would list every file under the
top-level directory.  Listing a sub-directory will have less files to list
so will be faster.

The selection of which sub-directory to use is important here.  You'd want
to choose a sub-directory that is not likely to be deleted or renamed.
Although if it is and you setup the  notification command properly, you'll
know about it the first time rsync tries to run.  But this will not delete
the files as before, so is a good solution.  The other factor in the
selection of the sub-directory to list is how many files it contains.
Ideally it would be a small subdirectory with not many files.
-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Store the log files

[Linux Hack]

Hi Folks,

I have configured rsync share server using xinetd and I am syncing the
files regularly.

I want to store list of files that transferred or deleted on remote host
into the rsync server itself and as well I want to log the stat information
to on the rsync server itself for every remote host in separate file.

Would it be possible?
-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Binaries for SCO 5.0.5

[Cameron Young (Linux)]

Hi all,

Having trouble just getting Amanda onto the system and compiled.
Does anyone have a copy of binaries for a SCO 5.0.5 System.

Thanks,  Cam

-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html