Have you tried sqoop merge?

On Thu, Aug 28, 2014 at 7:45 AM, 王洋 <wangyang....@gmail.com> wrote:

> Hello,
>      I have two table ,one is stored as textfile for loading data from
> local data, the other is stored as rcfile for compressing data。
>      when I execute the following sql two times
>
> *     insert into table tablename1 select * from tablename2*
>
>      I find that there are two files in the warehouse
>
>       *hadoop fs -ls /user/hive/warehouse/**tablename2**/*
> *      Found 2 items*
> *     -rwxrwxrwt   3 root supergroup        423 2014-08-28 21:09
> /user/hive/warehouse/**tablename2**/000000_0*
>  *     -rwxrwxrwt   3 root supergroup        423 2014-08-28 21:11
> /user/hive/warehouse/**tablename2**/000000_0_copy_1*
>
>     I need to merge the two files to reduce the small file, is there have
> some way to merge the files?
>    thank you !
>



-- 
Venkat V

Reply via email to