I’m not that familiar with LSF, though we do have some IBM folks on the list who may be better able to help. What you need to do is have LSF bind the job to some specified number of cores on each node - we will detect that envelope and stay inside it, which will provide the desired separation.
Your other option is to just specify “-bind-to none”, and we won’t bind to anything and thus the cores will be okay. > On Jan 15, 2016, at 9:07 AM, Tom Wurgler <twu...@goodyear.com> wrote: > > Yes Ralph, that is correct. > > ________________________________________ > From: users <users-boun...@open-mpi.org> on behalf of Ralph Castain > <r...@open-mpi.org> > Sent: Friday, January 15, 2016 11:32 AM > To: Open MPI Users > Subject: [EXT] Re: [OMPI users] Openmpi 1.8.8 and affinty > > Let me first check to see if I understand the question. You are running lsf > and launching more than 1 job on the same node. You want the jobs to restrict > themselves to a set of cores that have been assigned to them by lsf so they > avoid overloading procs onto the same cores. > > Is that an accurate statement? > >> On Jan 15, 2016, at 6:53 AM, twu...@goodyear.com wrote: >> >> In the past (v 1.6.4-) we used mpirun args of >> >> --mca mpi_paffinity_alone 1 --mca btl openib,tcp,sm,self >> >> with lsf 7.0.6, and this was enough to make cores not be oversubscribed when >> submitting 2 or more jobs to the same node. >> >> Now I am using 1.8.8 and thus far don't have the right combination of args to >> make sure cores don't oversubscribe. >> >> I am currently using: >> >> -report-bindings --map-by core --bind-to core --nooversubscribe --mca btl >> openib,tcp,sm,self >> >> Do I have the incorrect options or am I missing an option? >> >> Thanks for any info >> >> tom >> _______________________________________________ >> users mailing list >> us...@open-mpi.org >> Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users >> Link to this post: >> http://www.open-mpi.org/community/lists/users/2016/01/28288.php > > _______________________________________________ > users mailing list > us...@open-mpi.org > Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users > Link to this post: > http://www.open-mpi.org/community/lists/users/2016/01/28293.php > _______________________________________________ > users mailing list > us...@open-mpi.org > Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users > Link to this post: > http://www.open-mpi.org/community/lists/users/2016/01/28297.php
