Spark 1.5 officially use Parquet 1.7.0, but Spark 1.3 use Parquet 1.6.0.
It's better to check which version of Parquet is used in your environment.
2015-12-17 10:26 GMT+08:00 Joseph Bradley :
> This method is tested in the Spark 1.5 unit tests, so I'd guess it's a
> problem with the Parquet depen
This method is tested in the Spark 1.5 unit tests, so I'd guess it's a
problem with the Parquet dependency. What version of Parquet are you
building Spark 1.5 off of? (I'm not that familiar with Parquet issues
myself, but hopefully a SQL person can chime in.)
On Tue, Dec 15, 2015 at 3:23 PM, Rac
I have recently upgraded spark version but when I try to run save a random
forest model using model save command I am getting nosuchmethoderror. My code
works fine with 1.3x version.
model.save(sc.sc(), "modelsavedir");
ERROR: org.apache.spark.sql.execution.datasources.InsertIntoHadoopFsRel
