Re: Hive insert overwrite strange behavior

2014-07-20 Thread Lianhui Wang
the operator plan of two sql is different.first one: TableScanOperator--SelectOperator--ReduceOutputOperator--FileSinkOperator--MoveOperator second one:TableScanOperator--SelectOperator--FetchOperator in second one,FetchOperator work on client and directly output to local directory. but first one,

Hive insert overwrite strange behavior

2014-07-15 Thread Azuryy Yu
Hi, I think the following two sql have the same effect. 1) hive -e "insert overwrite local directory 'output' select * from test limit 10;" 2) hive -e "select * from test limit 10;" > output but the second one read HDFS directly only takes two seconds, but the first one submit a MR job, which h