Joe Auty wrote:
Thanks for this!
Another problem I'm running into is that if a file is deleted on
the source before it is sent, the sync fails and spews out an
error message. This is a problem with data such as email where an
email message might be deleted in real time, or perhaps a log file
turned over or something. I don't see a way to force the sync job
to continue on these sorts of errors, but I thought I would double
check first?
Sorry, this may not have been clear...
What I meant here is if the file is deleted on the source *during
the sync* process, i.e. prior to actually sending the file from the
source to destination, a fatal error is generated.
Michal Ludvig wrote:
Hi Joe,
currently it isn't possible to skip checksums comparison.
If all your log files are in the same directory or have some
common name pattern, e.g. *.log, you can exclude them with
--exclude \*.log or some other variant of
--exclude-from/--rexclude/--rexclude-from.
In the future there will be an option to not compare the
checksums on sync, but I'm not sure if it's a good idea to skip
comparing them on upload...
Michal
On 11/13/2010 11:26 AM, Joe Auty wrote:
Hello,
Is there a way to get s3cmd to not fuss over matching
checksums on live log files and files that are constantly
being written to? I realize that I can exclude them, but there
are many of them that are dynamically created, I'd rather not
list them individually.
What I'm finding is that because more information is being
written to the source file by the time the upload is complete,
I get stuck in an endless loop of uploading the file over and
over again until checksums match. If giving up after x number
of failures is a possibility and just accepting what has been
uploaded that is cool too, but what would be awesome is to
perhaps skip the comparison of final checksums for certain
directories.
Has anybody else run into this problem? Any suggestions for
techniques for working around this sort of problem?
--
Joe Auty, NetMusician
 NetMusician helps musicians, bands and
artists create beautiful, professional, custom designed,
career-essential websites that are easy to maintain and to
integrate with popular social networks.
www.netmusician.org
j...@netmusician.org
------------------------------------------------------------------------------
Centralized Desktop Delivery: Dell and VMware Reference Architecture
Simplifying enterprise desktop deployment and management using
Dell EqualLogic storage and VMware View: A highly scalable, end-to-end
client virtualization framework. Read more!
http://p.sf.net/sfu/dell-eql-dev2dev
_______________________________________________
S3tools-general mailing list
S3tools-general@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/s3tools-general
--
Joe Auty, NetMusician
 NetMusician
helps musicians, bands and artists create beautiful,
professional, custom designed, career-essential websites that
are easy to maintain and to integrate with popular social
networks.
www.netmusician.org
j...@netmusician.org
------------------------------------------------------------------------------
Centralized Desktop Delivery: Dell and VMware Reference Architecture
Simplifying enterprise desktop deployment and management using
Dell EqualLogic storage and VMware View: A highly scalable, end-to-end
client virtualization framework. Read more!
http://p.sf.net/sfu/dell-eql-dev2dev
_______________________________________________
S3tools-general mailing list
S3tools-general@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/s3tools-general
--
Joe Auty, NetMusician
 NetMusician
helps musicians, bands and artists create beautiful,
professional, custom designed, career-essential websites that are
easy
to maintain and to integrate with popular social networks.
www.netmusician.org
j...@netmusician.org
|
------------------------------------------------------------------------------
Centralized Desktop Delivery: Dell and VMware Reference Architecture
Simplifying enterprise desktop deployment and management using
Dell EqualLogic storage and VMware View: A highly scalable, end-to-end
client virtualization framework. Read more!
http://p.sf.net/sfu/dell-eql-dev2dev
_______________________________________________
S3tools-general mailing list
S3tools-general@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/s3tools-general
