I am trying to run a function on every line of a parquet file. The function
is in an object. When I run the program, I get an exception that the object
is not serializable. I read around the internet and found that I should use
Kryo Serializer. I changed the setting in the spark conf and registered the
object to the Kryo Serializer. When I run the program I still get the same
exception (from the stack trace: "at
org.apache.spark.serializer.JavaSerializationStream.write
object(JavaSerializer.scala:47)"). For some reason, the program is still
trying to serialize using the default java Serializer. I am working with
spark 1.4.