Re: Implementation of RNN/LSTM in Spark

Yeah, I'd agree with Nick. To have an implementation of RNN/LSTM in Spark, you may need a comprehensive abstraction of neural networks which is general enough to represent the computation (think of Torch, Keras, Tensorflow, MXNet, Caffe, etc.), and modify current computation engine to work

Re: Implementation of RNN/LSTM in Spark

you to train a model on > Spark dataframes. > > Kind regards, > > Joeri > . > From: Nick Pentreath [nick.pentre...@gmail.com > <mailto:nick.pentre...@gmail.com>] > Sent: 23 February 2017 13:39 > To: dev@spark.apache.org <mailt

Re: Implementation of RNN/LSTM in Spark

@gmail.com] > Sent: 23 February 2017 13:39 > To: dev@spark.apache.org > Subject: Re: Implementation of RNN/LSTM in Spark > > The short answer is there is none and highly unlikely to be inside of > Spark MLlib any time in the near future. > > The best bets are to look at other

RE: Implementation of RNN/LSTM in Spark

th [nick.pentre...@gmail.com] Sent: 23 February 2017 13:39 To: dev@spark.apache.org Subject: Re: Implementation of RNN/LSTM in Spark The short answer is there is none and highly unlikely to be inside of Spark MLlib any time in the near future. The best bets are to look at other DL libraries - f

Re: Implementation of RNN/LSTM in Spark

t; View this message in context: > http://apache-spark-developers-list.1001551.n3.nabble.com/Implementation-of-RNN-LSTM-in-Spark-tp14866p21060.html > Sent from the Apache Spark Developers List mailing list archive at > Nabble.com. > >

Re: Implementation of RNN/LSTM in Spark

Hi, can anyone tell me what the current status about RNNs in Spark is? -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Implementation-of-RNN-LSTM-in-Spark-tp14866p21060.html Sent from the Apache Spark Developers List mailing list archive at Nabble.com

Re: Implementation of RNN/LSTM in Spark

Hi, Disha deeplearning4j seems to implement distributed RNN on core and scalaout packages. http://deeplearning4j.org/recurrentnetwork.html https://github.com/deeplearning4j/deeplearning4j It migh

Re: Implementation of RNN/LSTM in Spark

Hi Julio, Can you please cite references based on the distributed implementation? On Tue, Nov 3, 2015 at 8:52 PM, Julio Antonio Soto de Vicente < ju...@esbet.es> wrote: > Hi, > Is my understanding that little research has been done yet on distributed > computation (without access to shared memor

Re: Implementation of RNN/LSTM in Spark

Hi, Is my understanding that little research has been done yet on distributed computation (without access to shared memory) in RNN. I also look forward to contributing in this respect. > El 03/11/2015, a las 16:00, Disha Shrivastava escribió: > > I would love to work on this and ask for ideas

Re: Implementation of RNN/LSTM in Spark

I would love to work on this and ask for ideas on how it can be done or can suggest some papers as starting point. Also, I wanted to know if Spark would be an ideal platform to have a distributive implementation for RNN/LSTM On Mon, Nov 2, 2015 at 10:52 AM, Sasaki Kai wrote: > Hi, Disha > > Ther

Re: Implementation of RNN/LSTM in Spark

Hi, Disha There seems to be no JIRA on RNN/LSTM directly. But there were several tickets about other type of networks regarding deep learning. Stacked Auto Encoder https://issues.apache.org/jira/browse/SPARK-2623 CNN https://issues.apache.org/j

Implementation of RNN/LSTM in Spark

Hi, I wanted to know if someone is working on implementing RNN/LSTM in Spark or has already done. I am also willing to contribute to it and get some guidance on how to go about it. Thanks and Regards Disha Masters Student, IIT Delhi