addtion : 1. i have run LOAD DATA INPATH '/user/root/input/test.txt' into table b; in shark. i think this will create rdd in memery, right? 2. when i run "free -g" , the result show somethings has been stored into memery. the file is almost 4g.
[root@bigdata001 spark-0.9.0-incubating-bin-hadoop2]# free -g total used free shared buffers cached Mem: 15 6 8 0 0 4 -/+ buffers/cache: 2 13 Swap: 7 0 7 2014-03-07 16:51 GMT+08:00 qingyang li <liqingyang1...@gmail.com>: > in that page, it is empty , it does not show anything. > Here is the picture. > > > > > 2014-03-07 16:14 GMT+08:00 Mayur Rustagi <mayur.rust...@gmail.com>: > > http://<Master URL>:4040/storage/ >> >> Mayur Rustagi >> Ph: +1 (760) 203 3257 >> http://www.sigmoidanalytics.com >> @mayur_rustagi <https://twitter.com/mayur_rustagi> >> >> >> >> On Fri, Mar 7, 2014 at 12:09 AM, qingyang li <liqingyang1...@gmail.com>wrote: >> >>> dear community, can anyone tell me : how to get size of rdd in memery ? >>> thanks. >>> >> >> >