Hi Professor Lin, It will be great if you could please review the TRON code in breeze and whether it is similar to the original TRON implementation...Breeze is already integrated in mllib (we are using BFGS and OWLQN is under works for mllib LogisticRegression) and comparing with TRON should be quick...
The code is over here: https://github.com/scalanlp/breeze/blob/master/math/src/main/scala/breeze/optimize/TruncatedNewtonMinimizer.scala If there are bugs, fixing them in breeze will be very helpful for people who are building upon it (like me :-) Thanks. Deb On Sun, Oct 26, 2014 at 6:33 PM, Chih-Jen Lin <cj...@csie.ntu.edu.tw> wrote: > Debasish Das writes: > > If the SVM is not already migrated to BFGS, that's the first thing you > should > > try...Basically following LBFGS Logistic Regression come up with LBFGS > based > > linear SVM... > > > > About integrating TRON in mllib, David already has a version of TRON in > breeze > > but someone needs to validate it for linear SVM and do experiment to > see if it > > can improve upon LBFGS based linear SVM...Based on lib-linear papers, > it should > > but I don't expect substantial difference... > > > > I am validating TRON for use-cases related to this PR (but I need more > features > > on top of TRON): > > > > https://github.com/apache/spark/pull/2705 > > > > We are also working on integrating TRON to MLlib, though we haven't cheked > the above work. > > We are also doing some serious comparison between quasi Newton and Newton, > though this will take some time > > Chih-Jen > > On Fri, Oct 24, 2014 at 2:09 PM, k.tham <kevins...@gmail.com> wrote: > > > > Just wondering, any update on this? Is there a plan to integrate > CJ's work > > with mllib? I'm asking since SVM impl in MLLib did not give us good > > results > > and we have to resort to training our svm classifier in a serial > manner on > > the driver node with liblinear. > > > > Also, it looks like CJ Lin is coming to the bay area in the coming > weeks > > (http://www.meetup.com/sfmachinelearning/events/208078582/) might > be a good > > time to connect with him. > > > > -- > > View this message in context: http:// > > apache-spark-user-list.1001560.n3.nabble.com/ > > Spark-LIBLINEAR-tp5546p17236.html > > Sent from the Apache Spark User List mailing list archive at > Nabble.com. > > > > > --------------------------------------------------------------------- > > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > > For additional commands, e-mail: user-h...@spark.apache.org > > >
