Re: MLlib OneVsRest causing intermittent exceptions

2016-01-27 Thread David Brooks
does, then i would think we >> need to fix the issue in the underlying algorithm instead of the >> reduction somehow knowing that the binary classifier is sampling from the >> training dataset. >> >> Or am I misunderstanding the issue here? >> >> I'll take a

Re: MLlib OneVsRest causing intermittent exceptions

2016-01-26 Thread David Brooks
ll in the fix... happy to accept >> contributions! >> ccing Joseph who is one of the maintainers of MLLib as well.. when >> creating the JIRA can you attach a simple test case? >> >> On Tue, Jan 26, 2016 at 2:59 PM, David Brooks wrote: >> >>> Hi again Ra

Re: MLlib OneVsRest causing intermittent exceptions

2016-01-26 Thread David Brooks
with using the label metadata as a shortcut. Do you agree that there is an issue here? Would you accept contributions to the code to remedy it? I'd gladly take a look if I can be of help. Many thanks, David On Tue, Jan 26, 2016 at 1:29 PM David Brooks wrote: > Hi Ram, > > I did

Re: MLlib OneVsRest causing intermittent exceptions

2016-01-26 Thread David Brooks
and issue. I'm happy to try a simpler method for providing column metadata, if one is available. Thanks, David On Mon, Jan 25, 2016 at 11:13 PM Ram Sriharsha wrote: > Hi David > > What happens if you provide the class labels via metadata instead of > letting OneVsRest de

MLlib OneVsRest causing intermittent exceptions

2016-01-25 Thread David Brooks
Hi, I've run into an exception using MLlib OneVsRest with logistic regression (v1.6.0, but also in previous versions). The issue is intermittent. When running multiclass classification with K-fold cross validation, there are scenarios where the split does not contain instances for every target l