Re: [OMPI users] memory limits on remote nodes

2010-10-07 Thread David Turner
Hi Ralph, There is an MCA param that tells the orted to set its usage limits to the hard limit: MCA opal: parameter "opal_set_max_sys_limits" (current value:<0>, data source: default value) Set to non-zero to automatically set any system-imposed li

Re: [OMPI users] memory limits on remote nodes

2010-10-07 Thread Reuti
Am 07.10.2010 um 01:55 schrieb David Turner: > Hi, > > We would like to set process memory limits (vmemoryuse, in csh > terms) on remote processes. Our batch system is torque/moab. Isn't it possible to set this up in torque/moab directly? In SGE I would simply define h_vmem and it's per slot t

[OMPI users] Pros and cons of --enable-heterogeneous

2010-10-07 Thread David Ronis
I have various boxes that run openmpi and I can't seem to use all of them at once because they have different CPU's (e.g., pentiums, athlons (both 32 bit) vs Intel I7 (64 bit)). I'm about the build 1.4.3 and was wondering if I should add --enable-heterogenous to the configure flags. Any advice as

Re: [OMPI users] Pros and cons of --enable-heterogeneous

2010-10-07 Thread Durga Choudhury
I'd like to add to this question the following: If I compile with --enable-heterogenous flag for different *architectures* (I have a mix of old 32 bit x86, newer x86_64 and some Cell BE based boxes (PS3)), would I be able to form a MPD ring between all these different machines? Best regards Durga

Re: [OMPI users] Pros and cons of --enable-heterogeneous

2010-10-07 Thread Ralph Castain
Hetero operations tend to lose a little performance due to the need to convert data, but otherwise there is no real negative. We don't do it by default solely because the majority of installations don't need to, and there is no reason to lose even a little performance if it isn't necessary. If you

Re: [OMPI users] Pros and cons of --enable-heterogeneous

2010-10-07 Thread Ralph Castain
The short answer is "yes". It should work. On Thu, Oct 7, 2010 at 1:53 PM, Durga Choudhury wrote: > I'd like to add to this question the following: > > If I compile with --enable-heterogenous flag for different > *architectures* (I have a mix of old 32 bit x86, newer x86_64 and some > Cell BE b

[OMPI users] Pros and cons of --enable-heterogeneous

2010-10-07 Thread David Ronis
I have various boxes that run openmpi and I can't seem to use all of them at once because they have different CPU's (e.g., pentiums, athlons (both 32 bit) vs Intel I7 (64 bit)). I'm about the build 1.4.3 and was wondering if I should add --enable-heterogenous to the configure flags. Any advice as

Re: [OMPI users] Pros and cons of --enable-heterogeneous

2010-10-07 Thread David Ronis
Ralph, thanks for the reply. If I build with enable-heterogeneous and then decide to run on a homogeneous set of nodes, does the additional "overhead" go away or become completely negligible; i.e., if no conversion is necessary. David On Thu, 2010-10-07 at 15:17 -0600, Ralph Castain wrote: >

Re: [OMPI users] memory limits on remote nodes

2010-10-07 Thread Ralph Castain
On Oct 7, 2010, at 2:55 AM, Reuti wrote: > Am 07.10.2010 um 01:55 schrieb David Turner: > >> Hi, >> >> We would like to set process memory limits (vmemoryuse, in csh >> terms) on remote processes. Our batch system is torque/moab. > > Isn't it possible to set this up in torque/moab directly? I

Re: [OMPI users] memory limits on remote nodes

2010-10-07 Thread Ralph Castain
On Oct 6, 2010, at 11:25 PM, David Turner wrote: > Hi Ralph, > >> There is an MCA param that tells the orted to set its usage limits to the >> hard limit: >> >> MCA opal: parameter "opal_set_max_sys_limits" (current >> value:<0>, data source: default value) >>

Re: [OMPI users] Pros and cons of --enable-heterogeneous

2010-10-07 Thread Eugene Loh
David Ronis wrote: Ralph, thanks for the reply. If I build with enable-heterogeneous and then decide to run on a homogeneous set of nodes, does the additional "overhead" go away or become completely negligible; i.e., if no conversion is necessary. I'm no expert, but I think the overhead d