Complex Analytics Genomics Benchmark Rebecca Taft-, Manasi Vartak-,
> Nadathur Rajagopalan Satish, Narayanan Sundaram, Samuel Madden, and Michael
> Stonebraker
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Is-There-Any-Benchmarks-
-, Manasi Vartak-,
Nadathur Rajagopalan Satish, Narayanan Sundaram, Samuel Madden, and Michael
Stonebraker
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Is-There-Any-Benchmarks-Comparing-C-MPI-with-Spark-tp7661p7919.html
Sent from the Apache Spark User List
Spark gives you four of the classical collectives: broadcast, reduce,
scatter, and gather. There are also a few additional primitives, mostly
based on a join. Spark is certainly less optimized than MPI for these, but
maybe that isn't such a big deal. Spark has one theoretical disadvantage
compar
I guess you have to understand the difference of architecture. I don't know
much about C++ MPI but it is basically MPI whereas Spark is inspired from
Hadoop MapReduce and optimised for reading/writing large amount of data
with a smart caching and locality strategy. Intuitively, if you have a high
r
Hello Wei,
I talk from experience of writing many HPC distributed application using
Open MPI (C/C++) on x86, PowerPC and Cell B.E. processors, and Parallel
Virtual Machine (PVM) way before that back in the 90's. I can say with
absolute certainty:
*Any gains you believe there are because "C++ is
Hi guys,
We are making choices between C++ MPI and Spark. Is there any official
comparation between them? Thanks a lot!
Wei
