Ashwin,
What is your motivation for needing to share RDDs between jobs? Optimizing
for reusing data across jobs?
If so, you may want to look into Tachyon. My understanding is that Tachyon
acts like a caching layer and you can designate when data will be reused in
multiple jobs so it know to keep
We recently released a research prototype of a lightweight matrix library
for Spark here: https://github.com/amplab/ml-matrix which does support norm
and subtraction. Feel free to base your implementation on top of it.
Zongheng
On Sat, Oct 25, 2014 at 07:12 Xuefeng Wu wrote:
> how about non/spir
how about non/spire or twitter/scalding
Yours, Xuefeng Wu 吴雪峰 敬上
> On 2014年10月25日, at 下午9:03, salexln wrote:
>
> Hi guys,
>
> I'm working on the implementation of the FuzzyCMeans algorithm (Jira
> https://issues.apache.org/jira/browse/SPARK-2344)
> and I need to use some operations on Matrice
Hi guys,
I'm working on the implementation of the FuzzyCMeans algorithm (Jira
https://issues.apache.org/jira/browse/SPARK-2344)
and I need to use some operations on Matrices (norm & subtraction)
I could not find any Scala\ Spark Matrix class that will support these
actions.
Should I implement th
