Hi All,
Sorry for my late reply!
Yu Ishikawa,Thanks for your interests in Saury project. You are welcomed to
try that out. If you have questions about that, please email me. We are
keeping improving performance/adding features for the project.
Xiangrui, thanks for your encouragement. If you have
Hi Xiangrui Meng,
Thank you for your comment and creating tickets.
The ticket which I created would be moved to your tickets.
I will close my ticket, and then will link it to yours later.
Best,
Yu Ishikawa
--
View this message in context:
http://apache-spark-developers-list.1001551.n3.nabble
Sorry for my late reply! I'm also very interested in the
implementation of distributed matrix multiplication. As Shivaram
mentioned, the communication is the concern here. But maybe we can
start with a reasonable implementation and then iterate on its
performance. It would be great if eventually we
Hi Rong,
Great job! Thank you for let me know your work.
I will read the source code of saury later.
Although AMPLab is working to implement them, would you like to merge it
into Spark?
Best,
-- Yu Ishikawa
--
View this message in context:
http://apache-spark-developers-list.1001551.n3.na
Hi Jeremy,
Great work!
I'm interested in your work. If there is your code on github, could you let
me know?
-- Yu Ishikawa
--
View this message in context:
http://apache-spark-developers-list.1001551.n3.nabble.com/mllib-Add-multiplying-large-scale-matrices-tp8291p8309.html
Sent from the Ap
Missed the dev-list last email. Resent it again. Please ignore the
duplicated one.
2014-09-06 11:22 GMT+08:00 顾荣 :
> Hi All,
>
> This is RongGu from PasaLab at Nanjing Universtiy,China. Actually, we have
> been working on a distributed matrix operations library on Spark this
> summer. It is a Sum
Hey all,
Definitely agreed this would be nice! In our own work we've done element-wise
addition, subtraction, and scalar multiplication of similarly partitioned
matrices very efficiently with zipping. We've also done matrix-matrix
multiplication with zipping, but that only works in certain cir
Hey There,
I believe this is on the roadmap for the 1.2 next release. But
Xiangrui can comment on this.
- Patrick
On Fri, Sep 5, 2014 at 9:18 AM, Yu Ishikawa
wrote:
> Hi Evan,
>
> That's sounds interesting.
>
> Here is the ticket which I created.
> https://issues.apache.org/jira/browse/SPARK-34
FWIW matrix multiplication is extremely communication intensive when
you have two row partitioned matrices and there are often other ways
to solve problems. Regardless, it would be good to have a more
complete matrix library and it would be good to contribute some of the
stuff we have done in the A
Hi Evan,
That's sounds interesting.
Here is the ticket which I created.
https://issues.apache.org/jira/browse/SPARK-3416
thanks,
--
View this message in context:
http://apache-spark-developers-list.1001551.n3.nabble.com/mllib-Add-multiplying-large-scale-matrices-tp8291p8296.html
Sent from
There's some work on this going on in the AMP Lab. Create a ticket and we
can update with our progress so that we don't duplicate effort.
On Fri, Sep 5, 2014 at 8:18 AM, Yu Ishikawa
wrote:
> Hi RJ,
>
> Thank you for your comment. I am interested in to have other matrix
> operations too.
> I wil
Hi RJ,
Thank you for your comment. I am interested in to have other matrix
operations too.
I will create a JIRA issue in the first place.
thanks,
--
View this message in context:
http://apache-spark-developers-list.1001551.n3.nabble.com/mllib-Add-multiplying-large-scale-matrices-tp8291p8293.h
I think it would be interesting to have a variety of matrix operations
(multiplication, addition / subtraction, powers, scalar multiply, etc.)
available in Spark.
Diagonalization may be more difficult but iterative approximation
approaches may be quite amenable.
On Fri, Sep 5, 2014 at 5:26 AM, Y
13 matches
Mail list logo
