Re: How to merge the output file when insert data into a table

2014-08-28 Thread 王洋
I collect data from a real-time system, we have not another database. 2014-08-29 0:59 GMT+08:00 Venkat V : > Have you tried sqoop merge? > > > On Thu, Aug 28, 2014 at 7:45 AM, 王洋 wrote: > >> Hello, >> I have two table ,one is stored as textfile for loading data from >> local data, the othe

Re: How to merge the output file when insert data into a table

2014-08-28 Thread 王洋
It takes effect when i use "alter table tablename concatenate" after a insert sql thanks 2014-08-29 0:44 GMT+08:00 Prasanth Jayachandran < pjayachand...@hortonworks.com>: > Hi > > If its an rcfile you can use "alter table tablename concatenate" to merge > them into 1 file. For text files, you ca

Re: How to merge the output file when insert data into a table

2014-08-28 Thread Venkat V
Have you tried sqoop merge? On Thu, Aug 28, 2014 at 7:45 AM, 王洋 wrote: > Hello, > I have two table ,one is stored as textfile for loading data from > local data, the other is stored as rcfile for compressing data。 > when I execute the following sql two times > > * insert into tabl

Re: How to merge the output file when insert data into a table

2014-08-28 Thread Prasanth Jayachandran
Hi If its an rcfile you can use "alter table tablename concatenate" to merge them into 1 file. For text files, you can may have to reload these 2 files into another table with "Order By". This will force one reducer to generate total ordering and thereby generating 1 output file. But remember i

How to merge the output file when insert data into a table

2014-08-28 Thread 王洋
Hello, I have two table ,one is stored as textfile for loading data from local data, the other is stored as rcfile for compressing data。 when I execute the following sql two times * insert into table tablename1 select * from tablename2* I find that there are two files in the wa