Hi Gilles, Ah, of course - I forgot about that.
Thanks, Ben -----Original Message----- From: users [mailto:users-boun...@lists.open-mpi.org] On Behalf Of Gilles Gouaillardet Sent: Tuesday, 16 August 2016 4:07 PM To: Open MPI Users <users@lists.open-mpi.org> Subject: Re: [OMPI users] Mapping by hwthreads without fully populating sockets Ben, in my case (two sockets, 6 cores per socket, 2 threads per core) and with Open MPI master $ cat rf rank 0=n0 slot=0 rank 1=n0 slot=12 rank 2=n0 slot=6 rank 3=n0 slot=18 $ mpirun -np 4 --rankfile rf --mca rmaps_rank_file_physical 1 --bind-to hwthread --report-bindings true [n0:38430] MCW rank 0 bound to socket 0[core 0[hwt 0]]: [B./../../../../..][../../../../../..] [n0:38430] MCW rank 1 bound to socket 0[core 0[hwt 1]]: [.B/../../../../..][../../../../../..] [n0:38430] MCW rank 2 bound to socket 1[core 6[hwt 0]]: [../../../../../..][B./../../../../..] [n0:38430] MCW rank 3 bound to socket 1[core 6[hwt 1]]: [../../../../../..][.B/../../../../..] Cheers, Gilles On 8/16/2016 12:40 PM, Ben Menadue wrote: > Hi, > > I'm trying to map by hwthread but only partially populating sockets. For > example, I'm looking to create arrangements like this: > > Rank 0: [B./../../../../../../..][../../../../../../../..] > Rank 1: [.B/../../../../../../..][../../../../../../../..] > Rank 2: [../../../../../../../..][B./../../../../../../..] > Rank 3: [../../../../../../../..][.B/../../../../../../..] > > Problem is, I can't work out a --map-by that will give this to me, short of > binding two to each core and using a wrapper around the binary to further > bind each to its hwthread. I thought of using a rankfile, but can't work out > how to specify hwthreads in that. > > Any suggestions? Or is such a wrapper the only way to do it for now? > > Yes, it's very strange, and almost certainly won't perform very well, but > I'd like to include it for completeness - I'm comparing several systems, > including KNL (where SMT is important to get good performance in most > cases). > > Thanks, > Ben > > > > _______________________________________________ > users mailing list > users@lists.open-mpi.org > https://rfd.newmexicoconsortium.org/mailman/listinfo/users > _______________________________________________ users mailing list users@lists.open-mpi.org https://rfd.newmexicoconsortium.org/mailman/listinfo/users _______________________________________________ users mailing list users@lists.open-mpi.org https://rfd.newmexicoconsortium.org/mailman/listinfo/users
