You can use persist(StorageLevel.MEMORY_AND_DISK) if you are not having sufficient memory to cache everything.
Thanks Best Regards On Fri, Feb 27, 2015 at 7:20 PM, Siddharth Ubale < siddharth.ub...@syncoms.com> wrote: > Hi, > > > > How do we manage putting partial data in to memory and partial into disk > where data resides in hive table ? > > We have tried using the available documentation but unable to go ahead > with above approach , we are only able to cache the entire table or uncache > it. > > > > Thanks, > > Siddharth Ubale, > > *Synchronized Communications * > > *#43, Velankani Tech Park, Block No. II, * > > *3rd Floor, Electronic City Phase I,* > > *Bangalore – 560 100* > > *Tel : +91 80 3202 4060* > > *Web:* *www.syncoms.com* <http://www.syncoms.com/> > > *[image: LogoNEWmohLARGE]* > > *London*|*Bangalore*|*Orlando* > > > > *we innovate, plan, execute, and transform the business​* > > >
