Re: What to do if $TMPDIR runs full?

2013-12-01 Thread Ole Tange
On Sun, Dec 1, 2013 at 7:25 AM, George Marselis wrote: >> Maybe it would be possible to append a byte to the tmp files before >> printing them. If ftell stays the same then the append did not work >> and a warning should be written. If it worked, seek back 1 byte and >> truncate. This, however, m

Re: What to do if $TMPDIR runs full?

2013-12-01 Thread Ole Tange
On Sun, Dec 1, 2013 at 12:56 AM, Ole Tange wrote: > Disk full is not the only situation where this could happen: If a file > system has a file size limit this could also cause STDOUT/STDERR to be > truncated. Another situation: The disk is fills up, but just before Parallel is printing some othe

Re: What to do if $TMPDIR runs full?

2013-12-01 Thread George Marselis
> > I am not sure I understand this at all. If your input is part of a > name of a compressed file and the output is the uncompressed, I do not > see a way for GNU Parallel to figure out how much space the > uncompressed will take. > > True. that is what i get for touching the keyboard before I ha

Re: What to do if $TMPDIR runs full?

2013-12-01 Thread Ole Tange
On Sun, Dec 1, 2013 at 12:56 AM, Ole Tange wrote: > Maybe it would be possible to append a byte to the tmp files before > printing them. If ftell stays the same then the append did not work > and a warning should be written. If it worked, seek back 1 byte and > truncate. This, however, might slow

sshloginfile in GNU parallel

2013-12-01 Thread yacob sen
Dear All, I am trying to implement gnu parallel on a cluster with several nodes and each node has up to 12 cores. Here "file_name" name contains two parameters that is fed to my script "program.sh". My script needs two parameters to run.  While "login_server_names" contains the address to each

Re: sshloginfile in GNU parallel

2013-12-01 Thread Ole Tange
On Sun, Dec 1, 2013 at 10:31 PM, yacob sen wrote: > Here is my understanding of the gnu parallel implementations on a single > node: > > cat $file_name | parallel -u -j 12 --sshloginfile $login_server_name > --colsep ' ' program.sh {1} {2} > My idea is for the above command is to distribut

Re: sshloginfile in GNU parallel

2013-12-01 Thread yacob sen
Dear ole, Thank you for your reply. I am not really forcing GNU parallel to send specific job to a specific core of on a specific node. I merely showing the  distribution of the job that GNU parallel supposed to do. I do not care which job goes to which core. I only need that a single task goes