"open files" with --files --pipe

2013-02-28 Thread Thomas Sattler
Hi there ... I tried to use the --pipe and --files options and found that parallel sometimes stops working. It seems as if this is somehow related to ulimit's "open files". I can reproduce it with the following commands: $ ulimit -n 500; yes | parallel --files --pipe true | nl | tail -n3 488

Re: "open files" with --files --pipe

2013-02-28 Thread Ole Tange
On Thu, Feb 28, 2013 at 11:57 AM, Thomas Sattler wrote: > I tried to use the --pipe and --files options and found > that parallel sometimes stops working. It seems as if > this is somehow related to ulimit's "open files". I > can reproduce it with the following commands: I never envisioned --pip

Re: "open files" with --files --pipe

2013-02-28 Thread Thomas Sattler
> I never envisioned --pipe should work with --files, so I never tested that. OK, I understand, but then: Who wrote parallel's manpage? $ man parallel | grep -C1 -e 'files.*pipe' -e 'pipe.*files' --files is often used with --pipe. -- cat bigfile | parallel --pipe --files