Re: How To Save TF-IDF Model In PySpark

2016-01-15 Thread Jerry Lam
." > > andy > > > > > From: Asim Jalis > Date: Friday, January 15, 2016 at 4:02 PM > To: "user @spark" > Subject: How To Save TF-IDF Model In PySpark > > Hi, > > I am trying to save a TF-IDF model in PySpark. Looks like this

Re: How To Save TF-IDF Model In PySpark

2016-01-15 Thread Andy Davidson
o the algorithm¹s API documentation to see if saving and loading is supported." andy From: Asim Jalis Date: Friday, January 15, 2016 at 4:02 PM To: "user @spark" Subject: How To Save TF-IDF Model In PySpark > Hi, > > I am trying to save a TF-IDF model in Py

How To Save TF-IDF Model In PySpark

2016-01-15 Thread Asim Jalis
Hi, I am trying to save a TF-IDF model in PySpark. Looks like this is not supported. Using `model.save()` causes: AttributeError: 'IDFModel' object has no attribute 'save' Using `pickle` causes: TypeError: can't pickle lock objects Does anyone have suggestions Thanks! Asim Here is the full