Re: [OMPI users] MPI for real time analysis
Any thoughts about this? Thanks for your time. On May 7, 2013, at 10:48 AM, RoboBeans wrote: > Are people in community using MPI libraries in their application for real > time processing / analytics? I have access to a cluster with infiniband and > want to test millions of hypotheses and depending upon which one passed would > run an aggregate function over them. I would like to achieve a subsecond > response for this and was wondering how one could take care of the network > calls overhead? Thanks! >
Re: [OMPI users] MPI for real time analysis
Difficult to say as it depends upon so many things that you haven't described. What do you do to "test a hypothesis"? Is each test an MPI job? If so, how big? Do they all run at the same time? Do all the tests need to participate in this "aggregate function"? Achieving subsecond response while running millions of tests seems a stretch unless those tests are rather trivial On May 8, 2013, at 7:54 AM, Robobeans wrote: > Any thoughts about this? Thanks for your time. > > On May 7, 2013, at 10:48 AM, RoboBeans wrote: > >> Are people in community using MPI libraries in their application for real >> time processing / analytics? I have access to a cluster with infiniband and >> want to test millions of hypotheses and depending upon which one passed >> would run an aggregate function over them. I would like to achieve a >> subsecond response for this and was wondering how one could take care of the >> network calls overhead? Thanks! >> > > ___ > users mailing list > us...@open-mpi.org > http://www.open-mpi.org/mailman/listinfo.cgi/users
Re: [OMPI users] MPI for real time analysis
Dear Mr. Bean,
On 07:54 Wed 08 May , Robobeans wrote:
> > Are people in community using MPI libraries in their application
> for real time processing / analytics?
Yes.
> I have access to a cluster with infiniband and want to test millions
> of hypotheses and depending upon which one passed would run an
> aggregate function over them. I would like to achieve a subsecond
> response for this and was wondering how one could take care of the
> network calls overhead? Thanks!
You'd need to tell us in more detail what you are trying to build.
No one can give you advice with so little information. Otherwise i
might just say "use MPI and you're done".
In any case this is probably not the right mailinglist to ask these
questions as this list is specifically for Open MPI, not MPI in
general.
Best
-Andreas
--
==
Andreas Schäfer
HPC and Grid Computing
Chair of Computer Science 3
Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany
+49 9131 85-27910
PGP/GPG key via keyserver
http://www.libgeodecomp.org
==
(\___/)
(+'.'+)
(")_(")
This is Bunny. Copy and paste Bunny into your
signature to help him gain world domination!
signature.asc
Description: Digital signature
[OMPI users] /usr/bin/ld: skipping incompatible ......
Dear All, I have recently installed gcc 4.7.3 on my cent OS 6.4. Moreover, I have compiled openmpi 1.6.4 with the above compiler. My LD_LIBRARY_PATH is set correctly and it points to both /lib and /lib64 where libgfortran.so and libgcc_s.so for 32 and 64 bits are located. Every time I compile a Fortran, a C or a C++ source code with the wrapper mpif90, mpicc or mpicx I get this warning: /usr/bin/ld: skipping incompatible /scratch/home0/pmatteo /research/lib_install/lib/libgfortran.so when searching for -lgfortran or /usr/bin/ld: skipping incompatible /scratch/home0/pmatteo /research/lib_install/lib/libgcc_s.so when searching for -lgcc_s I have switch my LD_LIBRARY_PATH as suggested in this thread: http://www.open-mpi.org/community/lists/users/2009/02/8067.php but nothing change. Any idea what I am doing wrong? I know that it is just a warning but I would like to avoid it. Thank you. -- Matteo
