Re: ml models distribution

2016-07-22 Thread Chris Fregly
hey everyone- this concept of deploying your Spark ML Pipelines and Algos into Production (user-facing production) has been coming up a lot recently. so much so, that i've dedicated the last few months of my research and engineering efforts to build out the infrastructure to support this in a hig

Re: ml models distribution

2016-07-22 Thread Inam Ur Rehman
Hello guys..i know its irrelevant to this topic but i've been looking desperately for the solution. I am facing en exception http://apache-spark-user-list.1001560.n3.nabble.com/how-to-resolve-you-must-build-spark-with-hive-exception-td27390.html plz help me.. I couldn't find any solution.. plz On

Re: ml models distribution

2016-07-22 Thread Sean Owen
No there isn't anything in particular, beyond the various bits of serialization support that write out something to put in your storage to begin with. What you do with it after reading and before writing is up to your app, on purpose. If you mean you're producing data outside the model that your m

Re: ml models distribution

2016-07-22 Thread Sergio Fernández
Hi Sean, On Fri, Jul 22, 2016 at 12:52 PM, Sean Owen wrote: > > If you mean, how do you distribute a new model in your application, > then there's no magic to it. Just reference the new model in the > functions you're executing in your driver. > > If you implemented some other manual way of deplo

Re: ml models distribution

2016-07-22 Thread Jacek Laskowski
Hehe, Sean. I knew that (and I knew the answer), but meant to ask a co-question to help to find the answer *together* :) Pozdrawiam, Jacek Laskowski https://medium.com/@jaceklaskowski/ Mastering Apache Spark http://bit.ly/mastering-apache-spark Follow me at https://twitter.com/jaceklaskowski

Re: ml models distribution

2016-07-22 Thread Sean Owen
Machine Learning If you mean, how do you distribute a new model in your application, then there's no magic to it. Just reference the new model in the functions you're executing in your driver. If you implemented some other manual way of deploying model info, just do that again. There's no special

Re: ml models distribution

2016-07-22 Thread Jacek Laskowski
Hi, What's a ML model? (I'm sure once we found out the answer you'd know the answer for your question :)) Pozdrawiam, Jacek Laskowski https://medium.com/@jaceklaskowski/ Mastering Apache Spark http://bit.ly/mastering-apache-spark Follow me at https://twitter.com/jaceklaskowski On Fri, Jul