Trainning a spark ml linear regresion model fail after migrating from 1.5.2 to 1.6.1

2016-06-08 Thread philippe v
I use spark-ml to train a linear regression model. It worked perfectly with spark version 1.5.2 but now with 1.6.1 I get the following error : Here is a minimal code : And input.csv data the pom.xml How can I fix it ? -- View this message in context: http://apache-spark-user-l

Re: Trainning a spark ml linear regresion model fail after migrating from 1.5.2 to 1.6.1

2016-06-08 Thread philippe v
here is a gist with the minimal code and data http://gist.github.com/anonymous/aca8ba5841404ea092f9efcc658c5d57 -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Trainning-a-spark-ml-linear-regresion-model-fail-after-migrating-from-1-5-2-to-1-6-1-tp27111p27

Re: Spark ml and PMML export

2016-06-23 Thread philippe v
Hi, You can try this lib : https://github.com/jpmml/jpmml-sparkml I'll try it soon... you need to be in >=1.6 Philippe -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-ml-and-PMML-export-tp26773p27215.html Sent from the Apache Spark User List mailing

Performance issue with spark ml model to make single predictions on server side

2016-06-23 Thread philippe v
Hello, I trained a linear regression model with spark-ml. I serialized the model pipeline with classical java serialization. Then I loaded it in a webservice to compute predictions. For each request recieved by the webservice I create a 1 row dataframe to compute that prediction. Probleme is th