Hi ,
I have simple question regarding Spark Hive integration with DataFrames. When we query for a table, does spark loads whole table into memory and applies the filter on top of it or it only loads the data with filter applied. for example if the my query 'select * from employee where deptno=10' does my rdd loads whole employee data into memory and applies fileter or will it load only dept number 10 data. Thanks Bala
