Re: Usage of mllib api in ml

2016-11-20 Thread Marco Mistroni
Hi If it is an rdd based can't u use data frame.rdd (though I don't know if u will have an rdd of vectorsu might need to convert each row to a vector yourself.. Hth On 20 Nov 2016 4:29 pm, "janardhan shetty" wrote: > Hi Marco and Yanbo, > > It is not the usage of MulticlassClassification

Re: Usage of mllib api in ml

2016-11-20 Thread janardhan shetty
Hi Marco and Yanbo, It is not the usage of MulticlassClassificationEvaluator. Probably I was not clear. Let me explain: I am trying to use confusionMatrix which is not present in MulticlassClassificationEvaluator ml version where as it is present in MulticlassMetrics of mllib. How to leverage RD

Re: Usage of mllib api in ml

2016-11-20 Thread Marco Mistroni
Hi you can also have a look at this example, https://github.com/sryza/aas/blob/master/ch04-rdf/src/main/scala/com/cloudera/datascience/rdf/RunRDF.scala#L220 kr marco On Sun, Nov 20, 2016 at 9:09 AM, Yanbo Liang wrote: > You can refer this example(http://spark.apache.org/docs/latest/ml-tunin

Re: Usage of mllib api in ml

2016-11-20 Thread Yanbo Liang
You can refer this example( http://spark.apache.org/docs/latest/ml-tuning.html#example-model-selection-via-cross-validation) which use BinaryClassificationEvaluator, and it should be very straightforward to switch to MulticlassClassificationEvaluator. Thanks Yanbo On Sat, Nov 19, 2016 at 9:03 AM,

Usage of mllib api in ml

2016-11-19 Thread janardhan shetty
Hi, I am trying to use the evaluation metrics offered by mllib multiclassmetrics in ml dataframe setting. Is there any examples how to use it?