[OMPI users] knem support in ompi

2013-09-04 Thread Alina Sklarevich
Hi, I am building ompi v1.6 with knem support and I see that when knem is enabed from the command line it is used for all message sizes in SM btl. There is no threshold for when to start using knem - starting which message size. This makes the performance of small messages worse since it also uses

Re: [OMPI users] knem support in ompi

2013-09-04 Thread George Bosilca
Small messages, i.e. their length is under btl_sm_eager_limit, always use normal SM. KNEM usage is restricted only for messages over either the eager size or the btl_sm_knem_dma_min (if KNEM supports DMA). George. On Sep 4, 2013, at 12:47 , Alina Sklarevich wrote: > Hi, > > I am building

[OMPI users] Changing directory from /tmp

2013-09-04 Thread Lee-Ping Wang
Hi there, On a few clusters I am running into an issue where a temporary directory cannot be created due to the root filesystem being full, causing mpirun to crash. Would it be possible to change the location where this directory is being created? [compute-109-4.local:12055] opal_os_dirpath_c

Re: [OMPI users] Changing directory from /tmp

2013-09-04 Thread Ralph Castain
you can specify it with OMPI_TMPDIR in your environment, or "-mca orte_tmpdir_base " on your cmd line On Sep 4, 2013, at 10:13 AM, Lee-Ping Wang wrote: > Hi there, > > On a few clusters I am running into an issue where a temporary directory > cannot be created due to the root filesystem bein

Re: [OMPI users] Changing directory from /tmp

2013-09-04 Thread Gus Correa
On 09/04/2013 01:13 PM, Lee-Ping Wang wrote: Hi there, On a few clusters I am running into an issue where a temporary directory cannot be created due to the root filesystem being full, causing mpirun to crash. Would it be possible to change the location where this directory is being created?

Re: [OMPI users] Changing directory from /tmp

2013-09-04 Thread Reuti
Hi, Am 04.09.2013 um 19:21 schrieb Ralph Castain: > you can specify it with OMPI_TMPDIR in your environment, or "-mca > orte_tmpdir_base " on your cmd line Wouldn't --tmpdir=... do the same with `mpirun` for way the latter you mentioned? -- Reuti > On Sep 4, 2013, at 10:13 AM, Lee-Ping Wang

Re: [OMPI users] Changing directory from /tmp

2013-09-04 Thread Ralph Castain
Yep - sure would. Lots of ways to specify it :-) On Sep 4, 2013, at 10:24 AM, Reuti wrote: > Hi, > > Am 04.09.2013 um 19:21 schrieb Ralph Castain: > >> you can specify it with OMPI_TMPDIR in your environment, or "-mca >> orte_tmpdir_base " on your cmd line > > Wouldn't --tmpdir=... do the s

Re: [OMPI users] Changing directory from /tmp

2013-09-04 Thread John Hearns
Also should be able to define $TMPDIR with your batch system. This can be on a much bigger disk.

Re: [OMPI users] Changing directory from /tmp

2013-09-04 Thread Lee-Ping Wang
Hi everyone, Thanks for the help! As Gus pointed out, I could also have found the answer from the FAQ but it might have taken me longer to find. - Lee-Ping On 09/04/2013 10:29 AM, Ralph Castain wrote: Yep - sure would. Lots of ways to specify it :-) On Sep 4, 2013, at 10:24 AM, Reuti wro