I think Xiangrui's ALS code implement certain aspect of it. You may want to check it out. Best regards, Wei
--------------------------------- Wei Tan, PhD Research Staff Member IBM T. J. Watson Research Center From: Xiangrui Meng <[email protected]> To: Duy Huynh <[email protected]> Cc: user <[email protected]> Date: 11/05/2014 01:13 PM Subject: Re: sparse x sparse matrix multiplication You can use breeze for local sparse-sparse matrix multiplication and then define an RDD of sub-matrices RDD[(Int, Int, CSCMatrix[Double])] (blockRowId, blockColId, sub-matrix) and then use join and aggregateByKey to implement this feature, which is the same as in MapReduce. -Xiangrui --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
