Hi Ralph,

There is no OMPI in system space and PATH and LD_LIBRARY_PATH look good.
Any suggestion on how to get more relevant debugging info above the table?

Thanks

Mark


> On 25 Mar 2015, at 16:33 , Ralph Castain <r...@open-mpi.org> wrote:
> 
> Hey Mark
> 
> Your original error flag indicates that you are picking up a connection from 
> some proc built against a different OMPI installation. It’s a very low-level 
> check that looks for matching version numbers. Not sure who is trying to 
> connect, but that is the problem.
> 
> Check you LD_LIBRARY_PATH
> 
>> On Mar 25, 2015, at 7:46 AM, Howard Pritchard <hpprit...@gmail.com> wrote:
>> 
>> turn off the disable getpwuid.
>> 
>> On Mar 25, 2015 8:14 AM, "Mark Santcroos" <mark.santcr...@rutgers.edu> wrote:
>> Hi Howard,
>> 
>> > On 25 Mar 2015, at 14:58 , Howard Pritchard <hpprit...@gmail.com> wrote:
>> > How are you building ompi?
>> 
>> My configure is rather straightforward:
>> ./configure --prefix=$OMPI_PREFIX --disable-getpwuid
>> 
>> Maybe I got spoiled on Hopper/Edison and I need more explicit configuration 
>> on BW ...
>> 
>> >  Also what happens if you use. aprun.
>> 
>> Not sure if you meant in combination with mpirun or not, so I'll provide 
>> both:
>> 
>> > aprun -n2 ./a.out
>> Hello from rank 1, thread 0, on nid16869. (core affinity = 0)
>> Hello from rank 0, thread 0, on nid16868. (core affinity = 0)
>> After sleep from rank 1, thread 0, on nid16869. (core affinity = 0)
>> After sleep from rank 0, thread 0, on nid16868. (core affinity = 0)
>> Application 23791589 resources: utime ~0s, stime ~2s, Rss ~27304, inblocks 
>> ~13229, outblocks ~66
>> 
>> > aprun -n2 mpirun ./a.out
>> apstat: error opening /ufs/alps_shared/reservations: No such file or 
>> directory
>> apstat: error opening /ufs/alps_shared/reservations: No such file or 
>> directory
>> [nid16868:17876] [[699,0],0] ORTE_ERROR_LOG: File open failure in file 
>> ../../../../../orte/mca/ras/tm/ras_tm_module.c at line 159
>> [nid16868:17876] [[699,0],0] ORTE_ERROR_LOG: File open failure in file 
>> ../../../../../orte/mca/ras/tm/ras_tm_module.c at line 85
>> [nid16868:17876] [[699,0],0] ORTE_ERROR_LOG: File open failure in file 
>> ../../../../orte/mca/ras/base/ras_base_allocate.c at line 190
>> [nid16869:17034] [[9344,0],0] ORTE_ERROR_LOG: File open failure in file 
>> ../../../../../orte/mca/ras/tm/ras_tm_module.c at line 159
>> [nid16869:17034] [[9344,0],0] ORTE_ERROR_LOG: File open failure in file 
>> ../../../../../orte/mca/ras/tm/ras_tm_module.c at line 85
>> [nid16869:17034] [[9344,0],0] ORTE_ERROR_LOG: File open failure in file 
>> ../../../../orte/mca/ras/base/ras_base_allocate.c at line 190
>> Application 23791590 exit codes: 1
>> Application 23791590 resources: utime ~0s, stime ~2s, Rss ~27304, inblocks 
>> ~9596, outblocks ~478
>> 
>> > I work with ompi on the nersc edison and hopper daily.
>> 
>> I use Edison and Hopper too, and there it works for me indeed.
>> 
>> > typically i use aprun though.
>> 
>> I want to use orte-submit and friends, so I "explicitly" don't want to use 
>> aprun.
>> 
>> > you definitely dont need to use ccm.
>> > and shouldnt.
>> 
>> Depends on the use-case, but happy to leave that out of scope for now :-)
>> 
>> Thanks!
>> 
>> Mark
>> 
>> 
>> >
>> > On Mar 25, 2015 6:00 AM, "Mark Santcroos" <mark.santcr...@rutgers.edu> 
>> > wrote:
>> > Hi,
>> >
>> > Any users of Open MPI on Blue Waters here?
>> > And then I specifically mean in "native" mode, not inside CCM.
>> >
>> > After configuring and building as I do on other Cray's, mpirun gives me 
>> > the following:
>> > [nid25263:31700] [[23896,0],0] ORTE_ERROR_LOG: Authentication failed in 
>> > file ../../../../../orte/mca/oob/tcp/oob_tcp_connection.c at line 803
>> > [nid25263:31700] [[23896,0],0] ORTE_ERROR_LOG: Authentication failed in 
>> > file ../../../../../orte/mca/oob/tcp/oob_tcp_connection.c at line 803
>> >
>> > Version is the latest and greatest from git.
>> >
>> > So I'm interested to hear whether people have been successful on Blue 
>> > Waters and/or whether the error rings a bell for people.
>> >
>> > Thanks!
>> >
>> > Mark
>> > _______________________________________________
>> > users mailing list
>> > us...@open-mpi.org
>> > Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users
>> > Link to this post: 
>> > http://www.open-mpi.org/community/lists/users/2015/03/26505.php
>> > _______________________________________________
>> > users mailing list
>> > us...@open-mpi.org
>> > Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users
>> > Link to this post: 
>> > http://www.open-mpi.org/community/lists/users/2015/03/26506.php
>> 
>> _______________________________________________
>> users mailing list
>> us...@open-mpi.org
>> Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users
>> Link to this post: 
>> http://www.open-mpi.org/community/lists/users/2015/03/26507.php
>> _______________________________________________
>> users mailing list
>> us...@open-mpi.org
>> Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users
>> Link to this post: 
>> http://www.open-mpi.org/community/lists/users/2015/03/26508.php
> 
> _______________________________________________
> users mailing list
> us...@open-mpi.org
> Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users
> Link to this post: 
> http://www.open-mpi.org/community/lists/users/2015/03/26510.php

Reply via email to