Re: Spark ML - Scaling logistic regression for many features

2016-04-28 Thread Daniel Siegmann
FYI: https://issues.apache.org/jira/browse/SPARK-14464 I have submitted a PR as well. On Fri, Mar 18, 2016 at 7:15 AM, Nick Pentreath wrote: > No, I didn't yet - feel free to create a JIRA. > > > > On Thu, 17 Mar 2016 at 22:55 Daniel Siegmann > wrote: > >> Hi Nick, >> >> Thanks again for your

Re: Spark ML - Scaling logistic regression for many features

2016-03-19 Thread Nick Pentreath
No, I didn't yet - feel free to create a JIRA. On Thu, 17 Mar 2016 at 22:55 Daniel Siegmann wrote: > Hi Nick, > > Thanks again for your help with this. Did you create a ticket in JIRA for > investigating sparse models in LR and / or multivariate summariser? If so, > can you give me the issue k

Re: Spark ML - Scaling logistic regression for many features

2016-03-19 Thread Daniel Siegmann
Hi Nick, Thanks again for your help with this. Did you create a ticket in JIRA for investigating sparse models in LR and / or multivariate summariser? If so, can you give me the issue key(s)? If not, would you like me to create these tickets? I'm going to look into this some more and see if I can

Re: Spark ML - Scaling logistic regression for many features

2016-03-12 Thread Nick Pentreath
Also adding dev list in case anyone else has ideas / views. On Sat, 12 Mar 2016 at 12:52, Nick Pentreath wrote: > Thanks for the feedback. > > I think Spark can certainly meet your use case when your data size scales > up, as the actual model dimension is very small - you will need to use > thos