Re: [OMPI users] /dev/shm

2008/11/20 Ray Muno > J >> >> >> >> > OK, what should I be seeing when I run "ipcs -p"? > > Looks like I don't know my System V from my POSIX. I know what to do.

Re: [OMPI users] infiniband problem

BTW - after you get more comfortable with your new-to-you cluster, I recommend you upgrade your Open MPI installation. v1.2.8 has a lot of bugfixes relative to v1.2.2. Also, Open MPI 1.3 should be available "next month"... so watch for an announcement on that front. On Thu, Nov 20, 2008 at 3:16

Re: [OMPI users] /dev/shm

John Hearns wrote: 2008/11/19 Ray Muno Thought I would revisit this one. We are still having issues with this. It is not clear to me what is leaving the user files behind in /dev/shm. This is not something users are doing directly, they are just compiling their code directly with mpif90 (fro

Re: [OMPI users] infiniband problem

Hi Ralph, that was indeed a typo, the command is of course /usr/mpi/gcc4/openmpi-1.2.2-1/bin/mpirun -np 4 -hostfile /home/sysgen/infiniband-mpi-test/machine /usr/mpi/gcc4/openmpi-1.2.2-1/tests/IMB-2.3/IMB-MPI1 with a blank behind /machine. Anyway, your suggested options -mca btl openi

Re: [OMPI users] infiniband problem

Your command line may have just come across with a typo, but something isn't right: -hostfile /home/sysgen/infiniband-mpi-test/machine/usr/mpi/gcc4/ openmpi-1.2.2-1/tests/IMB-2.3/IMB-MPI1 That looks more like a path to a binary than a path to a hostfile. Is there a missing space or filenam

[OMPI users] infiniband problem

Hi all, I have "inherited" a small cluster with a head node and four compute nodes which I have to administer. The nodes are connected via infiniband (OFED), but the head is not. I am a complete novice to the infiniband stuff and here is my problem: The infiniband configuration seems to be OK

Re: [OMPI users] Hybrid program

At the very least, you would have to call these functions -after- MPI_Init so they could override what OMPI did. On Nov 20, 2008, at 8:03 AM, Gabriele Fatigati wrote: And in the hybrid program MPi+OpenMP? Are these considerations still good? 2008/11/20 Edgar Gabriel : I don't think that the

Re: [OMPI users] Hybrid program

And in the hybrid program MPi+OpenMP? Are these considerations still good? 2008/11/20 Edgar Gabriel : > I don't think that they conflict with our paffinity module and setting. My > understanding is that if you set a new affinity mask, it simply overwrites > the previous setting. So in the worst ca

Re: [OMPI users] Hybrid program

I don't think that they conflict with our paffinity module and setting. My understanding is that if you set a new affinity mask, it simply overwrites the previous setting. So in the worst case it voids the setting made by Open MPI, but I don't think that it should cause 'problems'. Admittedly,

Re: [OMPI users] Hybrid program

I would guess that you can, if the library is installed, and as far as I know it is part of most recent Linux distributions... Thanks Edgar Gabriele Fatigati wrote: Thanks Edgar, but can i use these libraries also in a not NUMA machines? 2008/11/20 Edgar Gabriel : if you look at recent versi

Re: [OMPI users] Hybrid program

Interesting - learn something new every day! :-) How does this interact with OMPI's paffinity/maffinity assignments? With the rank/slot mapping and binding system? Should users -not- set paffinity if they include these numa calls in their code? Can we detect any potential conflict in OMPI

Re: [OMPI users] Hybrid program

Thanks Edgar, but can i use these libraries also in a not NUMA machines? 2008/11/20 Edgar Gabriel : > if you look at recent versions of libnuma, there are two functions called > numa_run_on_node() and numa_run_on_node_mask(), which allow thread-based > assignments to CPUs > > Thanks > Edgar >

Re: [OMPI users] Hybrid program

if you look at recent versions of libnuma, there are two functions called numa_run_on_node() and numa_run_on_node_mask(), which allow thread-based assignments to CPUs Thanks Edgar Gabriele Fatigati wrote: Is there a way to assign one thread to one core? Also from code, not necessary with

Re: [OMPI users] switch between ethernet and infiniband

"btl" = bit transport layer Yes, you can do so (assuming you configured/built support for both transports into OMPI), but you probably don't want to specify things that tightly. Usually, people do: -mca btl tcp,sm,self or -mca btl openib,sm,self This also selects the shared memory subsys

Re: [OMPI users] Hybrid program

Not in Linux, I'm afraid - you can assign one process to a set of cores, but Linux doesn't track individual threads. If you look at OMPI 1.3's man page for mpirun, you'll see some info on the rank-file mapping. Most of what was done is aimed at the use of hostfiles where you specify the soc

[OMPI users] switch between ethernet and infiniband

Hi, am I right in assuming that I as a user can choose between ethernet and infiniband by issuing mpirun --mca btl tcp my_job or mpirun --mca btl openib my_job respectivly ? What does "btl" stand for? Isaac _ Vorstand: Ertu U

Re: [OMPI users] Hybrid program

Is there a way to assign one thread to one core? Also from code, not necessary with OpenMPI option. Thanks. 2008/11/19 Stephen Wornom : > Gabriele Fatigati wrote: >> >> Ok, >> but in Ompi 1.3 how can i enable it? >> > > This may not be relevant, but I could not get a hybrid mpi+OpenMP code to > w