Re: 答复: Hive Bucketing

2016-01-25 Thread Gopal Vijayaraghavan
> Hi,how to efficient insert into an orc bucket table,I found it too >slow.thanks you Assuming you have partitions & slow inserts, you need to enable the flag from HIVE-6455 set hive.optimize.sort.dynamic.partition=true; Cheers, Gopal

RE: Hive Bucketing

2016-01-25 Thread Akansha Jain
Thanks for detailed explanation. Even without bucket pruning, expectation from bucketing is performance improvement. I am joining two tables which are bucketed on same no of buckets and column and comparing the performance with join of two unbucketed tables on bucket led column. I am using mapr dis

RE: Hive Bucketing

2016-01-25 Thread Mich Talebzadeh
Hi, Can you do show create table And send the output please. Thanks Dr Mich Talebzadeh LinkedIn https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw Sybase ASE 15 Gold Medal Award 2008 A Winning Strategy: Running the most Critical Financia

答复: Hive Bucketing

2016-01-25 Thread 谭成灶
Hi,how to efficient insert into an orc bucket table,I found it too slow.thanks you 发件人: Mich Talebzadeh 发送时间: ‎2016/‎1/‎23 7:31 收件人: user@hive.apache.org 主题: RE: Hive Bucketing Hi, In general my underst

Re: chmod: changing permissions of '/datadir/000056_0': Permission denied. user=danielh is not the owner of inode=000056_0

2016-01-25 Thread Daniel Haviv
Hi, Any thoughts on this issue ? Thank you. Daniel On Wed, Jan 20, 2016 at 12:28 PM, Daniel Haviv < daniel.ha...@veracity-group.com> wrote: > Hi, > We have a table in which the files are created by different users (under > the same group). > When a user inserts into the table it will finish succ

Re: Hive ExIm from on-premise HDP to Amazon EMR

2016-01-25 Thread Elliot West
Yes, we do use Falcon. But only a small fraction of our the datasets we wish to replicate are defined in this way. Could I perhaps just declare the feeds in falcon and not the processes that create them? Also, doesn't falcon use Hive ExIm/Replication to achieve this internally and therefore might I