Thanks for this!
Another problem I'm running into is that if a file is deleted on the
source before it is sent, the sync fails and spews out an error
message. This is a problem with data such as email where an email
message might be deleted in real time, or perhaps a log file turned
over or something. I don't see a way to force the sync job to
continue on these sorts of errors, but I thought I would double
check first?
Michal Ludvig wrote:
Hi Joe,
currently it isn't possible to skip checksums comparison.
If all your log files are in the same directory or have some
common name pattern, e.g. *.log, you can exclude them with
--exclude \*.log or some other variant of
--exclude-from/--rexclude/--rexclude-from.
In the future there will be an option to not compare the checksums
on sync, but I'm not sure if it's a good idea to skip comparing
them on upload...
Michal
On 11/13/2010 11:26 AM, Joe Auty wrote:
Hello,
Is there a way to get s3cmd to not fuss over matching checksums
on live log files and files that are constantly being written
to? I realize that I can exclude them, but there are many of
them that are dynamically created, I'd rather not list them
individually.
What I'm finding is that because more information is being
written to the source file by the time the upload is complete, I
get stuck in an endless loop of uploading the file over and over
again until checksums match. If giving up after x number of
failures is a possibility and just accepting what has been
uploaded that is cool too, but what would be awesome is to
perhaps skip the comparison of final checksums for certain
directories.
Has anybody else run into this problem? Any suggestions for
techniques for working around this sort of problem?
--
Joe Auty, NetMusician
 NetMusician helps musicians, bands and artists
create beautiful, professional, custom designed,
career-essential websites that are easy to maintain and to
integrate with popular social networks.
www.netmusician.org
j...@netmusician.org
------------------------------------------------------------------------------
Centralized Desktop Delivery: Dell and VMware Reference Architecture
Simplifying enterprise desktop deployment and management using
Dell EqualLogic storage and VMware View: A highly scalable, end-to-end
client virtualization framework. Read more!
http://p.sf.net/sfu/dell-eql-dev2dev
_______________________________________________
S3tools-general mailing list
S3tools-general@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/s3tools-general
------------------------------------------------------------------------------
Centralized Desktop Delivery: Dell and VMware Reference Architecture
Simplifying enterprise desktop deployment and management using
Dell EqualLogic storage and VMware View: A highly scalable, end-to-end
client virtualization framework. Read more!
http://p.sf.net/sfu/dell-eql-dev2dev
_______________________________________________
S3tools-general mailing list
S3tools-general@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/s3tools-general
--
Joe Auty, NetMusician
 NetMusician
helps musicians, bands and artists create beautiful,
professional, custom designed, career-essential websites that are
easy
to maintain and to integrate with popular social networks.
www.netmusician.org
j...@netmusician.org
|
------------------------------------------------------------------------------
Centralized Desktop Delivery: Dell and VMware Reference Architecture
Simplifying enterprise desktop deployment and management using
Dell EqualLogic storage and VMware View: A highly scalable, end-to-end
client virtualization framework. Read more!
http://p.sf.net/sfu/dell-eql-dev2dev
_______________________________________________
S3tools-general mailing list
S3tools-general@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/s3tools-general