Re: [OMPI users] Odd pipe error

2015-11-12 Thread Ralph Castain
Wow - glad you were able to dig that one out!! > On Nov 12, 2015, at 9:47 AM, Ray Sheppard wrote: > > Hi All, > I thought I would follow up with a solution. It turns out there is a bug > in glibc that is now exposed in old versions (pre 1.8) of OpenMPI on Cray XE > systems. Thanks to Justi

Re: [OMPI users] Odd pipe error

2015-11-12 Thread Ray Sheppard
Hi All, I thought I would follow up with a solution. It turns out there is a bug in glibc that is now exposed in old versions (pre 1.8) of OpenMPI on Cray XE systems. Thanks to Justin Davis of Cray for figuring it out. The simple solution is to remount /dev/pts with the gid=5 option turned

Re: [OMPI users] Odd pipe error

2015-10-17 Thread Ray Sheppard
Thanks Ralph, I was afraid that there wasn't a "oh we started..." For what it is worth, everything up to and including 1.7.x shows the same sort of failure. The trouble with Jaguar is that they actually embed their own version of everything inside their code. I once took on the task of s

Re: [OMPI users] Odd pipe error

2015-10-17 Thread Ralph Castain
I’m not sure there is a way to do it - that’s a pretty old version, and the RTE in it is completely different. So entirely possible that something in the update exposed a problem that no longer works. Out of curiosity: I’m unaware of any changes in the MPI definitions (there were extensions, bu

[OMPI users] Odd pipe error

2015-10-17 Thread Ray Sheppard
Hi All, We run a Cray XE/XT-7. For normal (ESM) use, Cray supplies integrated MPI libraries. However, for cluster compatibility mode, we build OpenMPI to use. Generally we use 1.8.4 but some old packages, like Jaguar, are tied to an old version (1.4.5). At the last maint, they all starte