What is the difference between ml.classification.LogisticRegression and mllib.classification.LogisticRegressionWithLBFGS

2015-10-06 Thread YiZhi Liu
N directly? Instead, it uses breeze.optimize.LBFGS and re-implements most of the procedures in mllib.optimization.{LBFGS,OWLQN}. Thank you. Best, -- Yizhi Liu Senior Software Engineer / Data Mining www.mvad.com, Shanghai, China --

Re: What is the difference between ml.classification.LogisticRegression and mllib.classification.LogisticRegressionWithLBFGS

2015-10-12 Thread YiZhi Liu
any problem. Thank you! 2015-10-08 1:15 GMT+08:00 Joseph Bradley : > Hi YiZhi Liu, > > The spark.ml classes are part of the higher-level "Pipelines" API, which > works with DataFrames. When creating this API, we decided to separate it > from the old API to avoid confusion

Re: What is the difference between ml.classification.LogisticRegression and mllib.classification.LogisticRegressionWithLBFGS

2015-10-12 Thread YiZhi Liu
working code now, so it's time to > try to refactor those code to share more.) > > > Sincerely, > > DB Tsai > -- > Blog: https://www.dbtsai.com > PGP Key ID: 0xAF08DF8D > > On Mon, Oct 12, 2015 at 1:24 AM,

Re: Spark Implicit Functions

2015-10-17 Thread YiZhi Liu
n adding groupByKeyToList and groupByKeyUnique using >> implicit classes. I thought it might be useful to someone. >> >> http://codingjunkie.net/learning-scala-implicits-with-spark/ >> >> Thanks, >> Bill > &g

Ability to offer initial coefficients in ml.LogisticRegression

2015-10-20 Thread YiZhi Liu
x27;s output model as init coefficients since the data distribution between two days' training sample shouldn't change much. Is there any concern for not supporting this feature? -- Yizhi Liu Senior Software Engineer / Data Mining www.mvad.com,

Re: Ability to offer initial coefficients in ml.LogisticRegression

2015-10-22 Thread YiZhi Liu
Would someone mind giving some hint? 2015-10-20 15:34 GMT+08:00 YiZhi Liu : > Hi all, > > I noticed that in ml.classification.LogisticRegression, users are not > allowed to set initial coefficients, while it is supported in > mllib.classification.LogisticRegressionWithSGD. > &

Re: Ability to offer initial coefficients in ml.LogisticRegression

2015-10-22 Thread YiZhi Liu
Thank you Tsai. Holden, would you mind posting the JIRA issue id here? I searched but found nothing. Thanks. 2015-10-23 1:36 GMT+08:00 DB Tsai : > There is a JIRA for this. I know Holden is interested in this. > > > On Thursday, October 22, 2015, YiZhi Liu wrote: >> >> W

Re: Spark Implementation of XGBoost

2015-10-26 Thread YiZhi Liu
--- >>> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org >>> For additional commands, e-mail: user-h...@spark.apache.org >>> > > - > To unsubs

Re: Ability to offer initial coefficients in ml.LogisticRegression

2015-11-02 Thread YiZhi Liu
Hi Tsai, Is it proper if I create a jira and try to work on it? 2015-10-23 10:40 GMT+08:00 YiZhi Liu : > Thank you Tsai. > > Holden, would you mind posting the JIRA issue id here? I searched but > found nothing. Thanks. > > 2015-10-23 1:36 GMT+08:00 DB Tsai : >> There is

Re: Ability to offer initial coefficients in ml.LogisticRegression

2015-11-02 Thread YiZhi Liu
gt; coordinate with Holden, and keep me in the loop. Thanks. >> >> Sincerely, >> >> DB Tsai >> ------ >> Web: https://www.dbtsai.com >> PGP Key ID: 0xAF08DF8D >> >> >> On Mon, Nov 2, 2015 at 7:32 A