Re: Model Persistence

2016-08-18 Thread Nick Pentreath
single node. A high-dimensional multi-layer perceptron with many layers could be quite a lot larger. An ALS model with millions of users &I items could be quite huge. On Thu, 18 Aug 2016 at 18:00, Rich Tarro wrote: > The following Databricks blog on Model Persistence states "Internally, w

Model Persistence

2016-08-18 Thread Rich Tarro
The following Databricks blog on Model Persistence states "Internally, we save the model metadata and parameters as JSON and the data as Parquet." https://databricks.com/blog/2016/05/31/apache-spark-2-0-preview-machine-learning-model-persistence.html What data associated with