There was a discussion happened on that earlier, let me re-post it for you.
For the following code:
val *df* = sqlContext.parquetFile(path)
*df* remains columnar (actually it just reads from the columnar Parquet
file on disk).
For the following code:
val *cdf* = df.cache()
*cdf* is
Hi Akhil,
It's interesting if RDDs are stored internally in a columnar format as well?
Or it is only when an RDD is cached in SQL context, it is converted to
columnar format.
What about data frames?
Thanks!
--
Ruslan Dautkhanov
On Fri, Jul 10, 2015 at 2:07 AM, Akhil Das
wrote:
>
> https://s
https://spark.apache.org/docs/latest/sql-programming-guide.html#caching-data-in-memory
Thanks
Best Regards
On Fri, Jul 10, 2015 at 10:05 AM, vinod kumar
wrote:
> Hi Guys,
>
> Can any one please share me how to use caching feature of spark via spark
> sql queries?
>
> -Vinod
>
