Export BLAS module on Spark MLlib

Hello I'm developing a Spark package that manipulates Vector and Matrix for machine learning. This package uses mllib.linalg.Vector and mllib.linalg.Matrix in order to achieve compatible interface to mllib itself. But mllib.linalg.BLAS module is private inside spark package. We cannot use BLAS

Re: Why LibSVMRelation and CsvRelation don't extends HadoopFsRelation ?

Great, thank you! > On Nov 11, 2015, at 11:41 AM, Jeff Zhang wrote: > > Yes Kai, I also to plan to do for CsvRelation, will create PR for spark-csv > > On Wed, Nov 11, 2015 at 9:10 AM, Sasaki Kai <mailto:lewua...@me.com>> wrote: > Did you indicate CsvRe

Re: Why LibSVMRelation and CsvRelation don't extends HadoopFsRelation ?

Did you indicate CsvRelation in spark-csv package? LibSVMRelation is included in spark core package, but CsvRelation(spark-csv) is not. Is it necessary for us to modify also spark-csv as you proposed in SPARK-11622? Regards Kai > On Nov 5, 2015, at 11:30 AM, Jeff Zhang wrote: > > > Not sure

Re: Implementation of RNN/LSTM in Spark

>> I would love to work on this and ask for ideas on how it can be done or can >> suggest some papers as starting point. Also, I wanted to know if Spark >> would be an ideal platform to have a distributive implementation for RNN/LSTM >> >> On Mon, Nov 2, 2015 at 10:52

Re: Implementation of RNN/LSTM in Spark

Hi, Disha There seems to be no JIRA on RNN/LSTM directly. But there were several tickets about other type of networks regarding deep learning. Stacked Auto Encoder https://issues.apache.org/jira/browse/SPARK-2623 CNN https://issues.apache.org/j