Re: I Want to Help with MLlib Migration

2018-02-16 Thread Yacine Mazari
Thanks for the clarification and suggestion @weichen. I will try to benchmark it and share the results for discussion. Regards, Yacine. -- Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/ - To unsubscribe

Re: I Want to Help with MLlib Migration

2018-02-16 Thread Weichen Xu
>>The goal is to have these algorithms implemented using the Dataset API. Currently, the implementation of these classes/algorithms uses RDDs by wrapping the old (mllib) classes, which will eventually be deprecated (and deleted). It need discussion and test for each algorithm before doing that. Si

Re: I Want to Help with MLlib Migration

2018-02-15 Thread Yacine Mazari
Thanks for the reply @srowen. >>I don't think you can move or alter the class APis. Agreed. That's not my intention at all. >>There also isn't much value in copying the code. Maybe there are opportunities for moving some internal code. There will probably be some copying and moving internal code

Re: I Want to Help with MLlib Migration

2018-02-15 Thread Sean Owen
I don't think you can move or alter the class APis. There also isn't much value in copying the code. Maybe there are opportunities for moving some internal code. But in general I think all this has to wait. On Thu, Feb 15, 2018, 5:17 AM Yacine Mazari wrote: > Hi, > > I see that many classes unde