Re: [OMPI users] Shared memory optimizations in OMPI

2011-11-22 Thread Jeff Squyres
All the shared memory code is in the "sm" BTL (byte transfer layer) component: ompi/mca/btl/sm. All the TCP MPI code is in the "tcp" BTL component: ompi/mca/btl/tcp. Think of "ob1" as the MPI engine that is the bottom of MPI_SEND, MPI_RECV, and friends. It takes a message to be sent, determin

Re: [OMPI users] Shared memory optimizations in OMPI

2011-11-22 Thread Shamik Ganguly
Thanks a lot Jeff. PIN is a dynamic binary instrumentation tool from Intel. It runs on top of the Binary in the MPI node. When its given function calls to instrument, it will insert trappings before/after that funtion call in the binary of the program you are instrumenting and you can insert your

Re: [OMPI users] Shared memory optimizations in OMPI

2011-11-22 Thread Jeff Squyres
On Nov 22, 2011, at 1:09 AM, Shamik Ganguly wrote: > I want to trace when the MPI library prevents an MPI_Send from going to the > socket and makes it access shared memory because the target node is on the > same chip (CMP). I want to use PIN to trace this. Can you please give me some > pointe

[OMPI users] Shared memory optimizations in OMPI

2011-11-22 Thread Shamik Ganguly
Hi, I want to trace when the MPI library prevents an MPI_Send from going to the socket and makes it access shared memory because the target node is on the same chip (CMP). I want to use PIN to trace this. Can you please give me some pointers about which functions are taking this decision so that