[S3tools-general] s3cmd v2.3.0

ke IMDSv2 optional Carlos Laviola (1): treat 0 byte cache files as nonexistent Daniil Tararukhin (1): fix os walk when excluding directories Florent Viard (13): Update CI test.yml to run on PR Fixes #1261 - Always read a conn after a request to be able to reuse it Fi

[S3tools-general] s3cmd v2.3.0

ke IMDSv2 optional Carlos Laviola (1): treat 0 byte cache files as nonexistent Daniil Tararukhin (1): fix os walk when excluding directories Florent Viard (13): Update CI test.yml to run on PR Fixes #1261 - Always read a conn after a request to be able to reuse it Fi

Re: [S3tools-general] Can s3cmd preserve the original Linux file time stamp on restore?

Hi David, Yes, the "sync" command will preserve users, creation and modification dates if you use the following flag: -p, --preserve Take care that you need to use it both when uploading to the server and downloading. And any way, it would be better for you to give a try with test files. Florent

Re: [S3tools-general] s3cmd sync issue

Hi, Indeed there is no worry to have with this warning. To be smart, s3cmd identify files that have the same content, and in that case try to upload it only once and do remote copies to create the other files more efficiently. But some servers do not support remote copies, so, in that case there

Re: [S3tools-general] Delete files in S3 bcukets

Hi Sharadha, Maybe it is because you just have this single file in folder1/folder2? In s3 you don't have the concept of 'files' and 'folders'. There are just files with a filename that can contains '/'. So we give the illusion of a file hierarchy based on the filename prefix but the folders in th

Re: [S3tools-general] When Is The Next Release

Hi Frank, Sorry for the long delay of my reply. First, thank you for keeping the package up to date for the Fedora and EPEL distributions. I'm still working on a few things, and so I plan to be able to do the next release in 1 or 2 weeks maximum. In general the git repo version is somehow stable

Re: [S3tools-general] newbie, how to estimate s3 --requester-pays costs

There are some third parties online estimator on internet, but in your case, the calculus should not be too hard. In the following page, you have all the fees for all the cases: https://aws.amazon.com/fr/s3/pricing/ Basically, there are only 2 kind of fees that will be charged to you for this ope

[S3tools-general] s3cmd v2.1.0

size during iteration' error on Python 3 with --cache-file (Issue #945) Test cases added for --cache-file EC2 Default User (1): .gitignore: add s3cmd.egg-info Florent Viard (36): Fixes #987 - Fixes using IAM with python3. Config options should be unicode. Fixes #987

Re: [S3tools-general] s3cmd sync data transfer issue

Hi, I would suggest that you open on issue on s3cmd github so that it will be more easy to investigate. Also, you can try to run s3cmd with the "-v" (or more verbose "-d") flags, and so you can have an idea of what is happening. Regards, Florent On Wed, Mar 27, 2019 at 3:22 PM kuldeep surendra

Re: [S3tools-general] s3cmd : get doesn't restore permissions

Hi Kiran, I think that it is because you are using the "get" command instead of the "sync" command. The "get" command is just like a simple "download" / get this command. It is only the "sync" command that also take care to download only what is needed and restore permissions. Regards, Florent

Re: [S3tools-general] How to uninstall old version of s3cmd

Hi Jason, Normally it should be easy. Step 1) You should find where are located your python installed packages. Most of the time it is something like: /usr/lib/python2.X (or python3.X)/site-packages or dist-packages. There, you should find a "S3" folder or s3cmd egg that you can simply delete.

[S3tools-general] s3cmd v2.0.2

ues (like acl_public) Florent Viard (18): Fixes sourceforge mailing list addr in RELEASE_INSTRUCTIONS file. Update version to 2.0.1+ for MASTER dev. Fixes #929 - strip namespace well even without xml declaration Fixes #933 Fix dst copy when the destination file was modified F

[S3tools-general] s3cmd v2.0.1

887) Shortlog below. Thanks, Florent Florent Viard (35): Changed version to 2.0.0+ for github nightly versions Fixes #887 - Invalid code inside cf __str__ breaking cf invalidation. Fixes #889 - info output cosmetic fix. Fixes #885 - Specific error message when getting

[S3tools-general] s3cmd v2.0.0

This is my first release and so I would like to thanks Matt Domsch for his support and all the contributors, the testers and the issue reporters. s3cmd-2.0.0 - 2017-06-26 === * Added support for Python 3 (Shaform, Florent Viard) * Added getlifecycle command (Daniel Gryniewicz) *

Re: [S3tools-general] Memory leak in s3cmd?

Hi Christian, It is not a leak but a current limitation of s3cmd. To perform the put / sync, s3cmd get the complete list of files of source and destination in memory dict before being to merge them in new dicts holding the operations that will have to be done "transfer", "copy", "delete". So, at

Re: [S3tools-general] question s3cmd to support openstack (SWIFT)

= normal > > *use_https = True* > > use_mime_magic = True > > verbosity = WARNING > > website_endpoint = http://%(bucket)s.s3-website-%(location) > s.amazonaws.com/ > <https://urldefense.proofpoint.com/v2/url?u=http-3A__s.amazonaws.com_&d=CwMFaQ&c=IGDlg0lD0b-nebmJJ

Re: [S3tools-general] question s3cmd to support openstack (SWIFT)

Hi Kirubakaran, There is no need for your patch, you just need to edit your s3cfg config file and modify the following 2 keys: host_base host_bucket In both of them, your will have to remove the "%(bucket)" tag, and then s3cmd will use the "path based" format that works right with swift3. I'm used

Re: [S3tools-general] Different profiles

Hi Cherish, You can use the -c option (or --config). Ex.: ... -c my_s3config ... As for most of your other questions, you can have a look at the help of s3cmd that list all the options and command that are available: ./s3cmd --help Regards, -- Florent On Thu, Nov 5, 20

Re: [S3tools-general] s3cmd 1.5.2 error get from fanckfurt

Hi Puchparoch, You can try to run s3cmd with the "-v -d" options to have more details about the reason why your operation is failing. Regards, -- Florent On Fri, Feb 20, 2015 at 3:35 PM, Puchparoch Vladimir wrote: > Hello, > > When i try to download from franckfurt i have this problem : > >

Re: [S3tools-general] [S3tools-bugs] s3cmd now with eu-central-1 (Frankfurt) support

so, when using quote_plus and wanting to also preserve "/" : urllib.quote(param, safe='~/') -- Florent Viard Software Development Engineer ... florent.vi...@seagate.com www.seagate.com On Fri, Dec 19, 2014 at 4:23 AM, Matt Domsch wro

Re: [S3tools-general] [S3tools-bugs] s3cmd now with eu-central-1 (Frankfurt) support

er to have most of the quoting that are done inside sign_v4 functions moved earlier in the function stack, as the quoting that is done in the signature code, should certainly be also done for the http request parameters. What do you think? Thank you, -- Florent Viard On Wed, Dec 17,