the operator plan of two sql is different.first one:
TableScanOperator--SelectOperator--ReduceOutputOperator--FileSinkOperator--MoveOperator
second one:TableScanOperator--SelectOperator--FetchOperator
in second one,FetchOperator work on client and directly output to local
directory.
but first one,
Hi,
I think the following two sql have the same effect.
1) hive -e "insert overwrite local directory 'output' select * from test
limit 10;"
2) hive -e "select * from test limit 10;" > output
but the second one read HDFS directly only takes two seconds, but the first
one submit a MR job, which h