Hi there ...
I tried to use the --pipe and --files options and found
that parallel sometimes stops working. It seems as if
this is somehow related to ulimit's "open files". I
can reproduce it with the following commands:
$ ulimit -n 500; yes | parallel --files --pipe true | nl | tail -n3
488
On Thu, Feb 28, 2013 at 11:57 AM, Thomas Sattler
wrote:
> I tried to use the --pipe and --files options and found
> that parallel sometimes stops working. It seems as if
> this is somehow related to ulimit's "open files". I
> can reproduce it with the following commands:
I never envisioned --pip
> I never envisioned --pipe should work with --files, so I never tested that.
OK, I understand, but then: Who wrote parallel's manpage?
$ man parallel | grep -C1 -e 'files.*pipe' -e 'pipe.*files'
--files is often used with --pipe.
--
cat bigfile | parallel --pipe --files