Re: [S3tools-general] Argument list in text file

2010-11-10 Thread dani
aths in the inputargs.txt file to > the > > destination bucket. > > > > When using something like --keep-local-paths, the user would have to be > sure > > to be in the correct dir before launching the command (or add a cd to > their > > shell script) and be s

Re: [S3tools-general] Argument list in text file

2010-11-10 Thread Michal Ludvig
ir input file. > > SJ > > > From: dani [mailto:dani...@rogers.com] > Sent: Monday, November 08, 2010 8:20 PM > To: s3tools-general@lists.sourceforge.net > Subject: Re: [S3tools-general] Argument list in text file > > Yes, but each line is a new shell process and opens and close

Re: [S3tools-general] Argument list in text file

2010-11-09 Thread Steve Jenkins
8:20 PM To: s3tools-general@lists.sourceforge.net Subject: Re: [S3tools-general] Argument list in text file Yes, but each line is a new shell process and opens and closes the connection to the server.   I'm hoping for something like the wget parameter -i, which reuses open connections.   Th

Re: [S3tools-general] Argument list in text file

2010-11-08 Thread dani
Yes, but each line is a new shell process and opens and closes the connection to the server. I'm hoping for something like the wget parameter -i, which reuses open connections. Thanks Dani On Mon, Nov 8, 2010 at 9:19 PM, Jobe Bittman wrote: > I generally take my file list and feed it into xar

Re: [S3tools-general] Argument list in text file

2010-11-08 Thread Jobe Bittman
I generally take my file list and feed it into xargs. Then I cut the file into chunks and copy across a few servers to run in parallel. files: /images/10/100.jpg /images/10/101.jpg /images/10/102.jpg cat files | xargs -I XXX echo ./s3cmd cp --acl-public XXX s3://mybucketXXX >> outfile1 split -l 1

[S3tools-general] Argument list in text file

2010-11-08 Thread dani
I haven't found this in the documentation: Is there way to supply the list of files to upload in a text file? I've been doing this with a while loop, but each line starts a new process, so it's not very efficient. Thanks Dani --