[ls] doesn't honor the --files-from option. [ls] simply asks S3 for all
the files in a bucket, possibly recursively, starting from a given prefix.
Jeremy is correct that it doesn't matter if a request returns 0 bytes or a
list of 1000 objects, it's counted as one request. Most operations have a
limit as to the number of items they can operate on (e.g. list bucket and
multiple object delete have a limit of 1000 objects for each
operation/request). If though, given a list of 1000 objects, we do a
metadata HEAD request for each object, then you'll have made 1001
requests. (we don't get metadata for every object anymore though, only
when we need it).
On Sun, Mar 22, 2015 at 3:58 PM, Russell Gadd <rust...@gmail.com> wrote:
> I'm wondering if someone could help explain:
>
> 1. Can you tell me if --files-from is an available option for the ls
> command? I've experimented to find out but without success. (Example: s3cmd
> -r --files-from=testlist.txt ls s3://xyztestbucket). Probably not but I
> just wanted to check. It's not clear in the documentation although I
> suspect most people probably haven't got a use for it. So please confirm
> that --files-from doesn't apply to ls or else tell me how to specify the
> command and the list of files (i.e. is s3//bucket-name required at the
> front of each file). In my proposed usage it would be useful as it would
> verify the existence of specific files. If not available I will have to
> issue one command per file unless I list the whole lot since I'm not using
> folders.
>
> 2. I'm not sure of the meaning of "requests" in the pricing of get or list
> requests, which for EU-West is $.004 / 1000 requests.
> Does this mean $.004 for a request which returns 1000 file names or
> literally 1000 lists each of which could return any number of filenames?
> Actually it's probably small beer for my usage but it would be nice to know.
>
> Russell
>
>
> ------------------------------------------------------------------------------
> Dive into the World of Parallel Programming The Go Parallel Website,
> sponsored
> by Intel and developed in partnership with Slashdot Media, is your hub for
> all
> things parallel software development, from weekly thought leadership blogs
> to
> news, videos, case studies, tutorials and more. Take a look and join the
> conversation now. http://goparallel.sourceforge.net/
> _______________________________________________
> S3tools-general mailing list
> S3tools-general@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/s3tools-general
>
>
------------------------------------------------------------------------------
Dive into the World of Parallel Programming The Go Parallel Website, sponsored
by Intel and developed in partnership with Slashdot Media, is your hub for all
things parallel software development, from weekly thought leadership blogs to
news, videos, case studies, tutorials and more. Take a look and join the
conversation now. http://goparallel.sourceforge.net/
_______________________________________________
S3tools-general mailing list
S3tools-general@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/s3tools-general
