RDD[internalRow] -> DataSet

Hi All, Is there a way to convert RDD[internalRow] to Dataset , from outside spark sql package. Regards, Satyajit.

Re: Spark.ml roadmap 2.3.0 and beyond

Thanks Joseph. We can wait for post 2.3.0. 2017-12-07 15:36 GMT-08:00 Joseph Bradley : > Hi Stephen, > > I used to post those roadmap JIRAs to share instructions for contributing > to MLlib and to try to coordinate amongst committers. My feeling was that > the coordination aspect was of mixed s

Re: Spark.ml roadmap 2.3.0 and beyond

Hi Stephen, I used to post those roadmap JIRAs to share instructions for contributing to MLlib and to try to coordinate amongst committers. My feeling was that the coordination aspect was of mixed success, so I did not post one for 2.3. I'm glad you pinged about this; if those were useful, then

queryable state & streaming

Hi, Maybe this has been discussed before. Given the fact that many streaming apps out there use state extensively, could be a good idea to make Spark expose streaming state with an external API like other systems do (Kafka streams, Flink etc), in order to facilitate interactive queries? Regards,