Re: GenericRowWithSchema is too heavy

2015-07-27 Thread Michael Armbrust
= underlying sequence of a row > 4) saveAsObjectFile or use org.apache.spark.util.SizeEstimator.estimate > And my result is, > (dataframe with 5columns) > GenericRowWithSchema => 13gb > GenericRow => 8.2gb > Seq => 7gb > > Best regards > Kevin > > > >

GenericRowWithSchema is too heavy

2015-07-27 Thread Kevin Jung
/apache-spark-user-list.1001560.n3.nabble.com/GenericRowWithSchema-is-too-heavy-tp24018.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For a