[OMPI users] How to configure the message size in openMPI (over RDMA)?

2017-07-18 Thread Juncheng Gu
Hi, I am trying to setup openMPI over RDMA cross machines. I call MPI_AllReduce() with a 240MB data buffer. But, it seems openMPI chunks data into small fragments (1MB ~ 15MB), and then sends them out through RDMA. Which mca parameters can affect the message size in openMPI? How to configure "mca

Re: [OMPI users] How to configure the message size in openMPI (over RDMA)?

2017-07-18 Thread Gilles Gouaillardet
Hi, i cannot comment for the openib specific part. the coll/tuned collective module is very likely to split messages in order to use a more efficient algorithm. an other way to put it is you probably do not want to use large messages. but if this is really what you want, then one option