Re: Hive Insert taking a lot of time

2015-11-02 Thread Kashif Hussain
source and destination tables have same schema. Are you suggesting to use sort by any of the partitions ? On Mon, Nov 2, 2015 at 6:52 PM, Jörn Franke wrote: > What is the create table statement? You may want to insert everything into > the orc table (sorted on x and/or y) and then apply the whe

Re: Hive Insert taking a lot of time

2015-11-02 Thread Jörn Franke
What is the create table statement? You may want to insert everything into the orc table (sorted on x and/or y) and then apply the where statement in your queries on the orc table. > On 02 Nov 2015, at 13:36, Kashif Hussain wrote: > > Hi, > I am trying to insert data into orc table from a tex

Hive Insert taking a lot of time

2015-11-02 Thread Kashif Hussain
Hi, I am trying to insert data into orc table from a text table.The query is as follows : insert into table test_orc(x,y) select * from test where x=4 and y=5 ; The MR is taking a lot of time and all but one reducer got completed quickly.But the last reducer is taking a lot of time. The total dat