Re: Which memory fraction is Spark using to compute RDDs that are not going to be persisted

not load the whole file at once and will partition the > input > file and do all these transformations per partition in a single stage. > However, which memory fraction Spark will use to load the partitioned > lines, > compute flatMap() and map()? > > Thanks > > > >

Which memory fraction is Spark using to compute RDDs that are not going to be persisted

nes, compute flatMap() and map()? Thanks -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Which-memory-fraction-is-Spark-using-to-compute-RDDs-that-are-not-going-to-be-persisted-tp23942.html Sent from the Apache Spark User List mail