Hi Mark,
Were you able to successfully store the RDD with Akhil's method? When you
read it back as an objectFile, you will also need to specify the correct
type.
You can find more information about integrating Spark and Tachyon on this
page: http://tachyon-project.org/documentation/Running-Spark-
I guess you can do a .saveAsObjectFiles and read it back as sc.objectFile
Thanks
Best Regards
On Fri, Oct 23, 2015 at 7:57 AM, mark wrote:
> I have Avro records stored in Parquet files in HDFS. I want to read these
> out as an RDD and save that RDD in Tachyon for any spark job that wants the
>
