Hi.
On Sun, 31 Dec 2023 20:28:21 +0100 Roland via rsync wrote:
> apparently, rsync sorts the list of files provided to "--files-from".
> how can i avoid sorting of that list ?
According to the man, this is not possible. See: SORTED TRANSFER ORDER
that suggest also the --delay‐updates option.
I want to copy a list of files in specific order
Why ?
because i want to serialize files on disk so they are stored on disk in
the order being accessed regularly
i built that list for --files-from via output from fatrace tool.
i now did use tar to transfer the files
i will add an RFE to bu
hello,
apparently, rsync sorts the list of files provided to "--files-from".
how can i avoid sorting of that list ?
I want to copy a list of files in specific order
regards
Roland
--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options
https://bugzilla.samba.org/show_bug.cgi?id=11152
--- Comment #1 from Andre Bruce ---
I believe that I can get our company to make a donation/contribution, using
paypal, to have this feature (or, if you prefer, we may contribute with server
hardware which is not in use anymore). If there is any de
https://bugzilla.samba.org/show_bug.cgi?id=11152
Bug ID: 11152
Summary: Feature Request: Cache Filelist
Product: rsync
Version: 3.1.1
Hardware: All
OS: All
Status: NEW
Severity: normal
Priority
https://bugzilla.samba.org/show_bug.cgi?id=3491
a...@haveland.com changed:
What|Removed |Added
CC||a...@haveland.com
--- Comment #4
https://bugzilla.samba.org/show_bug.cgi?id=3491
--- Comment #3 from [EMAIL PROTECTED] 2008-10-16 14:09 CST ---
I'd like to have this feature for the reasons others already stated, too, and,
looking at the patch, it even doesn't seem to be hard to implement. What's
holding it up?
--
https://bugzilla.samba.org/show_bug.cgi?id=3491
[EMAIL PROTECTED] changed:
What|Removed |Added
CC||[EMAIL PROTECTED]
--- Comment #2
https://bugzilla.samba.org/show_bug.cgi?id=3491
--- Comment #1 from [EMAIL PROTECTED] 2006-02-08 02:22 MST ---
I like this idea. I, too, have seen degradation in response times when rsync
starts on a large hierarchy. Using nice didn't help (much).
Wouldn't it be better to count up
https://bugzilla.samba.org/show_bug.cgi?id=3491
Summary: throttle disk IO during filelist/directory parsing
Product: rsync
Version: 2.6.4
Platform: All
URL: http://vilius.multiply.com/video/item/10
OS/Version: Linux
On Mon, May 23, 2005 at 03:24:07PM +0200, Edwin Eefting wrote:
> My idea is to create a patch for something like a --cache option that
> will use a cached version of the filelist:
Something like that would be fairly easy to write, but only if there are
no conflicts between the cache and th
On Monday 23 May 2005 16:09, Christoph Biedl wrote:
> > -What are the most likely problems i would run into when i try to
> > implement this?
>
> You can expect a feature request that allows to manipulate certain parts
> of the cache only (re-scan or delete a subtree). This would turn the
> cache i
On Monday 23 May 2005 16:29, Carson Gaspar wrote:
> --On Monday, May 23, 2005 03:24:07 PM +0200 Edwin Eefting <[EMAIL PROTECTED]>
>
> wrote:
> > My idea is to create a patch for something like a --cache option that
> > will use a cached version of the filelist: T
--On Monday, May 23, 2005 03:24:07 PM +0200 Edwin Eefting <[EMAIL PROTECTED]>
wrote:
My idea is to create a patch for something like a --cache option that
will use a cached version of the filelist: This way instead of creating
the filelist every time (100.000's of system calls, d
Edwin Eefting wrote...
> -What are the opinions of other people on this list?
Sounds like a great idea for me but I'm just an rsync user.
> -Would it be easy to implement, or would it give too much trouble?
Without looking into the sources I think it should not be that difficult
to dump the l
Hi,
As a gentoo-user i frequently run the emerge sync command, which in turn does
a rsync with the mainserver. The 'problem' is that the portage directory tree
contains about 19.000 directories and 96.000 files. So building the filelist
takes a pretty long time, because of the
On Tue, Sep 07, 2004 at 02:54:07PM -0400, Christophe Kalt wrote:
> i do see the funky read/write logic in report(), but this only seems
> to be used for the two line stats summary
I guess I was assuming that we'd only want this statistic from the
sender, but that may not be a true assumption. So,
On Sep 07, Wayne Davison wrote:
| On Fri, Sep 03, 2004 at 10:34:09AM -0400, Christophe Kalt wrote:
| > The attached diff causes rsync to show how much time it spends
| > on building and sending its filelist.
|
| Your patch doesn't take into account that the statistics are sometimes
|
On Fri, Sep 03, 2004 at 10:34:09AM -0400, Christophe Kalt wrote:
> The attached diff causes rsync to show how much time it spends
> on building and sending its filelist.
Your patch doesn't take into account that the statistics are sometimes
sent at the end of the transfer if the sender
The attached diff causes rsync to show how much time it spends
on building and sending its filelist. I'd appreciate if you
could consider this change for inclusion in a future release.
diff -ru rsync-2.6.3pre1/flist.c rsync-2.6.3pre1+tykhe/flist.c
--- rsync-2.6.3pre1/flist.c 2004-08-12
Hello,
I wrote this report one and a half weeks ago. There is a bug in the
"flist"-module, which can consistently reproduced on at most two
Unix-Platforms: Solaris 9 and MacOS X.
Can anybody help me with the email-address of the developer of the
flist-module, so I can contact him/her directly?
I have found a nasty bug when a file, which is in some of many sources,
shall be copied to a target.
The linux-Version works well but rsync 2.5.{2|5|6} under solaris9 (gcc
2.95.3) and darwin (gcc 3.1) do not. The decision which file (out of which
src) shall be copied depends on the number of sr
Hi Rogier,
On Sat, Feb 15, 2003 at 05:05:16PM +0100, Rogier van Eeten wrote:
> On Wed, Feb 12, 2003 at 05:18:11PM -0500, Andrew J. Schorr wrote:
> > On Wed, Feb 12, 2003 at 10:51:19AM -0500, Andrew J. Schorr wrote:
> > > > I was wondering... is there a way to cache that
On Wed, Feb 12, 2003 at 05:18:11PM -0500, Andrew J. Schorr wrote:
> On Wed, Feb 12, 2003 at 10:51:19AM -0500, Andrew J. Schorr wrote:
> > > I was wondering... is there a way to cache that filelist? Our mirrors
> > > are updated once, or twice a day, it could speed up download
On Wed, Feb 12, 2003 at 10:51:19AM -0500, Andrew J. Schorr wrote:
> > I've noticed every time someone does an rsync-request on my ftp-site
> > (which also provides rsync as mirror method), rsyncd creates a filelist.
> > This is a quite IO and CPU intensive procedure
On Wed, Feb 12, 2003 at 10:51:19AM -0500, Andrew J. Schorr wrote:
> Please take a look at the --files-from feature that is now in the CVS tree,
> courtesy of Wayne Davison. That should do what you want.
This is probably a silly question, but which tree? I've built the tree I
got when I did a 'c
Hi Rogier,
> I've noticed every time someone does an rsync-request on my ftp-site
> (which also provides rsync as mirror method), rsyncd creates a filelist.
> This is a quite IO and CPU intensive procedure, especially for things
> mirrors like FreeBSD with lots of little
I too think this would be an interesting feature.
--- Rogier van Eeten <[EMAIL PROTECTED]> skrev: >
Hi,
>
> I've noticed every time someone does an
> rsync-request on my ftp-site
> (which also provides rsync as mirror method), rsyncd
> creates a filelist.
> This
Hi,
I've noticed every time someone does an rsync-request on my ftp-site
(which also provides rsync as mirror method), rsyncd creates a filelist.
This is a quite IO and CPU intensive procedure, especially for things
mirrors like FreeBSD with lots of little files.
I was wondering... is th
I do not think there would be a problem using ssh as the shell. The cat
trick or using - is basically the same thing as specifying the file
names manually.
On Wed, 2003-01-08 at 03:42, Lorenzo Bettini wrote:
> jw schultz wrote:
> > On Tue, Jan 07, 2003 at 07:15:27PM +0100, Lorenzo Bettini wrote:
On Wed, Jan 08, 2003 at 09:42:39AM +0100, Lorenzo Bettini wrote:
> jw schultz wrote:
> >On Tue, Jan 07, 2003 at 07:15:27PM +0100, Lorenzo Bettini wrote:
> >
> >>Aaron Morris wrote:
> >>
> >>>You did not specifically mention it: compression (-z) would probably
> >>>help more than anything. Otherw
jw schultz wrote:
On Tue, Jan 07, 2003 at 07:15:27PM +0100, Lorenzo Bettini wrote:
Aaron Morris wrote:
You did not specifically mention it: compression (-z) would probably
help more than anything. Otherwise, you could do something like:
Have a file (ie filelist.txt) that contains the filen
We've been calling this option --files-from rather than --file-list,
to be like the GNU tar option.
On Sun, Jan 05, 2003 at 09:55:50AM -0800, Wayne Davison wrote:
> On Sat, Jan 04, 2003 at 05:03:02PM -0800, jw schultz wrote:
> > that would produce destloc/srcdir/
> > when you might want a copy
On Tue, Jan 07, 2003 at 07:15:27PM +0100, Lorenzo Bettini wrote:
> Aaron Morris wrote:
> >You did not specifically mention it: compression (-z) would probably
> >help more than anything. Otherwise, you could do something like:
> >
> >Have a file (ie filelist.txt) that contains the filename (with
Aaron Morris wrote:
You did not specifically mention it: compression (-z) would probably
help more than anything. Otherwise, you could do something like:
Have a file (ie filelist.txt) that contains the filename (with relative
paths), one file per line.
rsync -rRWz `cat filelist.txt` user@hos
On Sun, Jan 05, 2003 at 12:44:32PM -0800, Wayne Davison wrote:
> On Sun, Jan 05, 2003 at 11:55:22AM -0800, jw schultz wrote:
> > The first problem is this would flatten things unless you used
> > relative and forced the user's CWD. That would cause considerable
> > confusion.
>
> Really? This is
On Sun, Jan 05, 2003 at 11:55:22AM -0800, jw schultz wrote:
> The first problem is this would flatten things unless you used
> relative and forced the user's CWD. That would cause considerable
> confusion.
Really? This is exactly how rsync works now with multiple file names on
the command-line,
On Sun, Jan 05, 2003 at 09:55:50AM -0800, Wayne Davison wrote:
> On Sat, Jan 04, 2003 at 05:03:02PM -0800, jw schultz wrote:
> > that would produce destloc/srcdir/
> > when you might want a copy of srcdir at destloc instead of
> > in destloc.
>
> Ah yes, I _was_ missing something. However, I
On Sat, Jan 04, 2003 at 05:03:02PM -0800, jw schultz wrote:
> that would produce destloc/srcdir/
> when you might want a copy of srcdir at destloc instead of
> in destloc.
Ah yes, I _was_ missing something. However, I still don't think we need
to clutter rsync with two types of --file-list op
only happen if the --relative option is set.
> Otherwise all 3 files should go directly into "dest".
I don't think so. --relative would create
dest/src/file1
dest/src/file2
dest/src/dir1
dest/src/dir1/file3
Would it not?
The point here is to tell rs
On Sat, Jan 04, 2003 at 12:40:05PM -0800, jw schultz wrote:
> One specifying subpaths and the other for those having a shared
> prefix.
I don't see why this is needed. For instance, your example of a shared
prefix:
> find srcdir | myfilter | rsync --file-list - srcdir destloc
would be eas
Please bear in mind that I am quickly approacing areas where I have
little expertise.
Commenting on the recursion issue:
I thought rsync already takes intermediate directories into account. If
you specify -p, does not rsync create the intermediate directories with
the same perms as the source
On Sat, Jan 04, 2003 at 08:00:20PM +0100, wim delvaux wrote:
> On Saturday 04 January 2003 19:49, Aaron Morris wrote:
> > It has already been suggested in this list, as well as by myself in the
> > rsync wishlist for a new option to specify a file that has a list of
> > files to be transferred.
>
I usually use rsync 2.5.4 on AIX and compression is not enabled by
default. 2.5.5 may be different.
Another important option would be to use "-u" since it would only
transfer a file if it has changed (even if it is in the file list).
wim delvaux wrote:
On Saturday 04 January 2003 19:49, Aaron
On Saturday 04 January 2003 19:49, Aaron Morris wrote:
> You did not specifically mention it: compression (-z) would probably
> help more than anything. Otherwise, you could do something like:
I thought it was on by default ?
>
> Have a file (ie filelist.txt) that contains the filename
question for VERY low bandwith networks
Suppose I know the list of files that are changed
What is the most efficient way to make rsync sync this list.
Currently I use --include-from --exclude to generate a 'filelist' but I
suspect that client and/or server exchange the list of files in the
HI all,
efficiency question for VERY low bandwith networks
Suppose I know the list of files that are changed
What is the most efficient way to make rsync sync this list.
Currently I use --include-from --exclude to generate a 'filelist' but I
suspect that client and/or server exchang
On Tue, Nov 12, 2002 at 03:27:03PM +0200, Mozzi wrote:
> [root@ais-mail01 root]# time rsync -pogrve ssh /var/spool/mail
> [EMAIL PROTECTED]:/var/spool/mail/
FYI, this command puts the "mail" dir inside /var/spool/mail on the
destination. You should add a trailing slash to the source path to
avoi
s now building the filelist
I recon there are about 80 000 files in that directory totaling 50Gig
I was wondering is it beacause of the many files that it takes so long
or is it beacause the files continually change that maybe it has a
problem verifying the files ?
Is there a way that I can bypass thi
chines got
>their filelists and start to replicate :-(
>
> possible solutions (except upgrading the cache memory of the HDD controller)???
> has somebody a idea?
> can we precompile the filelist and hold it somewhere?
> what else can we do?
Upgrading the HDD cache won't buy m
controller)???
has somebody a idea?
can we precompile the filelist and hold it somewhere?
what else can we do?
i have no idea anymore but:
i would like to thank you already for helpfull hints and tips!!
greetings from germany
Stephan
<>
Hi,
I want to make rsync compare a local filesystem with a previously
generated file containing the required informations about each file von
the remote filesystem.
a) Is this possible?
b) How can I generate the required filelist?
Thx,
Daniel
ice for the conceptually simple but pragmatically
inefficient RPC-per-file approach to organizing the traffic. rsync
does not suffer from this problem.
> If you could drop that filelist from memory to a configurable
> place (like /tmp/rsync.filelist), and gave it a configurable
> time-out (like 10 minutes), I would be very happy!
That's been proposed. It has not yet been implemented.
-Bennett
PGP signature
well, and the repetition rate I've seen hasn't been enough to
> drive me to FAQ.
Thanks. I guess I did enough due diligence in looking for the FAQ before I posted to
the list. :-)
> > Where does rsync store the filelist that it builds?
>
> I wouldn't call this one
54 matches
Mail list logo
