[OMPI users] problem configuring with torque

2009-08-11 Thread Craig Plaisance
I am building openmpi on a cluster running rocks. When I build using ./configure --with-tm=/share/apps/torque --prefix=/share/apps/openmpi/intel I receive the warning configure: WARNING: Unrecognized options: --with-tm, --enable-ltdl-convenience After running make and make install, I run ompi-i

[OMPI users] very bad parallel scaling of vasp using openmpi

2009-08-17 Thread Craig Plaisance
Hi - I have compiled vasp 4.6.34 using the Intel fortran compiler 11.1 with openmpi 1.3.3 on a cluster of 104 nodes running Rocks 5.2 with two quad core opterons connected by a Gbit ethernet. Running in parallel on one node (8 cores) runs very well, faster than any other cluster I have run it

Re: [OMPI users] very bad parallel scaling of vasp using openmpi

2009-08-18 Thread Craig Plaisance
I ran a test of tcp using NetPIPE and got throughput of 850 Mb/s at message sizes of 128 Kb. The latency was 50 us. At message sizes above 1000 Kb, the throughput oscillated wildly between 850 Mb/s and values as low as 200 Mb/s. This test was done with no other network traffic. I then ran f

Re: [OMPI users] very bad parallel scaling of vasp using openmpi

2009-08-18 Thread Craig Plaisance
The switch we are using (Dell Powerconnect 6248) has a switching fabric capacity of 184 Gb/s, which should be more than adequate for the 48 ports. Is this the same as backplane bandwidth?

Re: [OMPI users] very bad parallel scaling of vasp using openmpi

2009-08-18 Thread Craig Plaisance
So is this a problem with the physical switch (we need a better switch) or with the configuration of the switch (we need to configure the switch or configure the os to work with the switch)?