Dear mark, and Roland:
Thanks for all the suggestions.
I was confused gromacs4 paper with another one by Erik Lindahl. (http://www.ncbi.nlm.nih.gov/pubmed/19229308
) Since there they studied the same system (Kv1.2 voltage-gated ion
channel), and they mentioned about the same speed as the benckmark, on
a cray-xt4 machine. Here is also a link for the machine I'm working
on: http://www.nersc.gov/nusers/systems/franklin/
Bin.
On Mar 17, 2010, at 1:39 AM, Roland Schulz wrote:
On Wed, Mar 17, 2010 at 3:55 AM, Mark Abraham
<mark.abra...@anu.edu.au> wrote:
On 17/03/2010 6:19 PM, BIN ZHANG wrote:
Dear Mark:
Thanks for your reply and sorry for my less info.
I'm confused about your statement "I was trying to build gromacs 4.0
on a cray-xt4 machine, the same one as the benchmark in the gromacs4
paper" because I can't see any mention of results on such a machine
in J. Chem. Theory Comput. 2008, 4, 435-447
Here is the configuration line I used:
module load fftw/2.1.5.1
module load libxml2
CXX=CC CC=cc F77=ftn MPICC=cc LIBS="$XML2_LIBDIR -L/usr/X11/lib64"
./configure --enable-mpi --enable-double --enable-fortran
--prefix=$HOME/gmx/para --disable-nice --with-fft=fftw2
--program-suffix=_mpi
The use of double precision and the absence of hardware-optimized
inner loops (--enable-fortran, since AFAIK there's no alternative on
XT4) will slow things down compared to an Intel machine.
No. These are standard AMD CPUs and thus SSE2 works find.
I use
module swap PrgEnv-pgi PrgEnv-gnu
module swap gcc gcc/4.2.4
./configure '--enable-mpi' '--without-x' 'CC=cc' 'CPP=cpp'
'CXXCPP=cpp' 'CXX=CC' '--without-xml' 'CPPFLAGS=-I/sw/xt5/fftw/3.1.2/
sles10.1_gnu4.2.4/include' 'LDFLAGS=-L/sw/xt5/fftw/3.1.2/
sles10.1_gnu4.2.4/lib -lfftw3f' 'CFLAGS=-O3 -fomit-frame-pointer -
finline-functions -Wall -Wno-unused -msse2 -funroll-all-loops -
std=gnu99'
Also, I searched the maillist and added ddorder in the mdrun line, but
that doesn't seem to help much.
aprun -n 128 $gmxdir/mdrun_mpi -deffnm npt_02 -g npt_02.log -ddorder
cartesian -npme 32
You will need to experiment with npme and ddorder to find what's
best. Also consider g_tune_pme in the git codebase.
If you want to scale to larger number of CPUs you probably need 2D
PME. It is available in the 2dpme git branch. (That it is in a
branch means it is at the moment considered experimental - even more
than mast that is)
Roland
Mark
The system is a membrane protein and I'm using berger lipid/OPLS-AA
force filed.
Thanks
Bin
On Mar 17, 2010, at 12:02 AM, Mark Abraham wrote:
On 17/03/2010 5:43 PM, BIN ZHANG wrote:
Dear all:
I was trying to build gromacs 4.0 on a cray-xt4 machine, the same
one as
the benchmark in the gromacs4 paper (). However, my timing for a
similar
system, ~100,000 atoms, is almost 3 times slower than in the paper.
For
example, I only got ~25 ns/day with 128 cpus. So is there any special
flags, or tricks I can use during the configuration for detailed
tuning?
Probably. You've made it hard to help you when you haven't provided
(at least) your configure command, compiler and version, mdrun command
line and simulation system composition.
Mark
--
gmx-users mailing list gmx-users@gromacs.org
http://lists.gromacs.org/mailman/listinfo/gmx-users
Please search the archive at http://www.gromacs.org/search before
posting!
Please don't post (un)subscribe requests to the list. Use the www
interface or send it to gmx-users-requ...@gromacs.org.
Can't post? Read http://www.gromacs.org/mailing_lists/users.php
--
gmx-users mailing list gmx-users@gromacs.org
http://lists.gromacs.org/mailman/listinfo/gmx-users
Please search the archive at http://www.gromacs.org/search before
posting!
Please don't post (un)subscribe requests to the list. Use the www
interface or send it to gmx-users-requ...@gromacs.org.
Can't post? Read http://www.gromacs.org/mailing_lists/users.php
--
ORNL/UT Center for Molecular Biophysics cmb.ornl.gov
865-241-1537, ORNL PO BOX 2008 MS6309
--
gmx-users mailing list gmx-users@gromacs.org
http://lists.gromacs.org/mailman/listinfo/gmx-users
Please search the archive at http://www.gromacs.org/search before
posting!
Please don't post (un)subscribe requests to the list. Use the
www interface or send it to gmx-users-requ...@gromacs.org.
Can't post? Read http://www.gromacs.org/mailing_lists/users.php
--
gmx-users mailing list gmx-users@gromacs.org
http://lists.gromacs.org/mailman/listinfo/gmx-users
Please search the archive at http://www.gromacs.org/search before posting!
Please don't post (un)subscribe requests to the list. Use the
www interface or send it to gmx-users-requ...@gromacs.org.
Can't post? Read http://www.gromacs.org/mailing_lists/users.php