Re: [OMPI users] error configuring OpenMPI 1.6.3 with gcc 4.7.2

2012-12-11 Thread Joseph Farran
Hi All. I was away all of last week so I am late here. A note that I was able to compile OpenMP 1.6.3 with gcc 4.7.2 successfully. I built gcc 4.7.2 by hand with binutils-2.23.1, mpc-1.0.1, mpfr-3.1.1 and gmp-5.0.5. Joseph On 12/6/2012 2:37 PM, Paul Hatton wrote: Thanks. This is obvious

Re: [OMPI users] CentOS 6.3 & OpenMPI 1.6.3

2012-12-10 Thread Joseph Farran
been published at the same location: http://mellanox.com/downloads/hpc/mxm/v1.1/mxm-latest.tar -- YK On 12/4/2012 9:20 AM, Joseph Farran wrote: Hi Mike. Removed the old mxm, downloaded and installed: /tmp/mxm/v1.1/per-ofed/1.5.4.1/mxm-1.1.3a5e745-1.x86_64-rhel6u3.rpm I am suing OFED 1.5.4.1

Re: [OMPI users] CentOS 6.3 & OpenMPI 1.6.3

2012-12-04 Thread Joseph Farran
ED version (thanks to no ABI in OFED). On Sun, Dec 2, 2012 at 10:04 PM, Joseph Farran mailto:jfar...@uci.edu>> wrote: 1.5.4.1

Re: [OMPI users] CentOS 6.3 & OpenMPI 1.6.3

2012-12-02 Thread Joseph Farran
s: cannot access /usr/local/mofed-inst: No such file or directory # # ls /usr/local bin etc include lib lib64 libexec sbin share src # # find /usr -name "*mofed*" -print # On 12/2/2012 1:05 PM, Joseph Farran wrote: Next I will try MLNX_OFED_LINUX-1.5.3-3.1.0-rhel6.3-x86_64, with the mxm and try again. Joseph

Re: [OMPI users] CentOS 6.3 & OpenMPI 1.6.3

2012-12-02 Thread Joseph Farran
Next I will try MLNX_OFED_LINUX-1.5.3-3.1.0-rhel6.3-x86_64, with the mxm and try again. Joseph On 12/2/2012 12:04 PM, Joseph Farran wrote: Hi again. Had to get some sleep :-) Same thing. Let me outline the steps I took in case I missed something. I have a stock CentOS 6.3 with kernel

Re: [OMPI users] CentOS 6.3 & OpenMPI 1.6.3

2012-12-02 Thread Joseph Farran
Hi again. Had to get some sleep :-) Same thing. Let me outline the steps I took in case I missed something. I have a stock CentOS 6.3 with kernel 2.6.32-279.14.1.el6.x86_64 Install OFED-1.5.4.1 as follows: cd OFED-1.5.4.1 ./install.pl --all --print-available grep -v debuginfo ofed-all.conf

Re: [OMPI users] CentOS 6.3 & OpenMPI 1.6.3

2012-12-02 Thread Joseph Farran
/usr"  and retry configure/make stage. 10x On Sun, Dec 2, 2012 at 10:36 AM, Joseph Farran <jfar...@uci.edu> wrote: Hi Mike. Thanks for the help!

Re: [OMPI users] OpenMPI-1.6.3 & MXM

2012-12-02 Thread Joseph Farran
/com/products/mxm/ Compile ompi 1.6.3, add following to its configure line: ./configure --with-openib=/usr --with-mxm=/opt/mellanox/mxm <...>)   Regards M On Sat, Dec 1, 2012 at 2:23 AM, Joseph Farran

Re: [OMPI users] CentOS 6.3 & OpenMPI 1.6.3

2012-12-02 Thread Joseph Farran
ib=/usr" parameter during ompi "configure" stage? 10x M On Fri, Nov 30, 2012 at 1:11 AM, Joseph Farran <jfar...@uci.edu> wrote: Hi YK: Yes, I have those installe

Re: [OMPI users] OpenMPI-1.6.3 & MXM

2012-11-30 Thread Joseph Farran
Konz, For whatever it is worth, I am in the same boat. I have CentOS 6.3, trying to compile OpenMPI 1.6.3 with the mxm from Mellanox and it fails. Also, the Mellanox OFED ( MLNX_OFED_LINUX-1.5.3-3.1.0-rhel6.3-x86_64 ) does not work either. Mellanox really needs to step in here and help out.

Re: [OMPI users] OpenMPI 1.6.3 and Memory Issues

2012-11-29 Thread Joseph Farran
Hi again. I am using /etc/modprobe.d/mofed.conf, otherwise I get: WARNING: Deprecated config file /etc/modprobe.conf, all config files belong into /etc/modprobe.d/ But I am still getting the memory errors after making the changes and rebooting: $ cat /etc/modprobe.d/mofed.conf options mlx4_co

Re: [OMPI users] CentOS 6.3 & OpenMPI 1.6.3

2012-11-29 Thread Joseph Farran
Hi YK: Yes, I have those installed but they are newer versions: # rpm -qa | grep rdma librdmacm-1.0.15-1.x86_64 librdmacm-utils-1.0.15-1.x86_64 librdmacm-devel-1.0.15-1.x86_64 # locate librdmacm.la # Here are the RPMs the Mellanox build created for kernel: 2.6.32-279.14.1.el6.x86_64 # ls *rdm

Re: [OMPI users] OpenMPI 1.6.3 and Memory Issues

2012-11-29 Thread Joseph Farran
I'll assume: /etc/modprobe.d/mlx4_en.conf On 11/29/2012 02:34 PM, Joseph Farran wrote: Where do change those mellanox settings? On 11/29/2012 02:23 PM, Jeff Squyres wrote: See http://www.open-mpi.org/faq/?category=openfabrics#ib-low-reg-mem. On Nov 29, 2012, at 5:21 PM, Joseph Farran

Re: [OMPI users] OpenMPI 1.6.3 and Memory Issues

2012-11-29 Thread Joseph Farran
Where do change those mellanox settings? On 11/29/2012 02:23 PM, Jeff Squyres wrote: See http://www.open-mpi.org/faq/?category=openfabrics#ib-low-reg-mem. On Nov 29, 2012, at 5:21 PM, Joseph Farran wrote:

[OMPI users] OpenMPI 1.6.3 and Memory Issues

2012-11-29 Thread Joseph Farran
Hi All. In compiling a simple Hello world with OpenMPI 1.6.3 and mpirun the hello program, I am getting: $ ulimit -l unlimited $ mpirun -np 2 hello -- WARNING: It appears that your OpenFabrics subsystem is configured to onl

Re: [OMPI users] CentOS 6.3 & OpenMPI 1.6.3

2012-11-29 Thread Joseph Farran
On 11/28/2012 10:53 AM, Mike Dubman wrote: You need mxm-1.1.3a5e745-1.x86_64-rhel6u3.rpm On Wed, Nov 28, 2012 at 7:44 PM, Joseph Farran mailto:jfar...@uci.edu>> wrote: mxm-1.1.3a5e745-1.x86_64-rhel6u3.rpm After installing MLNX_OFED_LINUX-1.5.3-3.1.0-rhel6.3-x86_64, removing t

Re: [OMPI users] CentOS 6.3 & OpenMPI 1.6.3

2012-11-28 Thread Joseph Farran
Question on the version to use. The tar files contains the following RPMS: # ls | grep -v debug mxm-1.1.3a5e745-1.x86_64-centos5u6.rpm mxm-1.1.3a5e745-1.x86_64-centos5u7.rpm mxm-1.1.3a5e745-1.x86_64-centos6u0.rpm mxm-1.1.3a5e745-1.x86_64-rhel5u5.rpm mxm-1.1.3a5e745-1.x86_64-rhel6u1.rpm mxm-1

Re: [OMPI users] CentOS 6.3 & OpenMPI 1.6.3

2012-11-28 Thread Joseph Farran
Perfect and Thanks! I had searched the Mellanox web site for the mxm package to no avail. I will try recompiling later today. Best, Joseph On 11/28/2012 06:29 AM, Yevgeny Kliteynik wrote: On 11/28/2012 10:52 AM, Pavel Mezentsev wrote: You can try downloading and installing a fresher version

[OMPI users] CentOS 6.3 & OpenMPI 1.6.3

2012-11-27 Thread Joseph Farran
Howdy. I a have a stock CentOS 6.3 OS and a Mellanox MT26428 card. I installed the Mellanox OFED MLNX_OFED_LINUX-1.5.3-3.1.0-rhel6.3-x86_64 which installed just fine. Rebooted the system and when I try building OpenMPI 1.6.3, it aborts with: mtl_mxm_send.c: In function 'ompi_mtl_mxm_isend':