Re: Inserting data in hive bucket

2016-08-22 Thread Rahul Channe
Thank you for the responses On Sunday, August 21, 2016, Mich Talebzadeh wrote: > Hi Rahul, > > I don't believe you can drop a particular bucket in Hive > > HTH > > Dr Mich Talebzadeh > > > > LinkedIn * > https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw >

Re: Inserting data in hive bucket

2016-08-21 Thread Mich Talebzadeh
Hi Rahul, I don't believe you can drop a particular bucket in Hive HTH Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw * http://talebzadehmich.w

Re: Inserting data in hive bucket

2016-08-20 Thread Rahul Channe
Hi Mich, I want to know If we can drop data of particular bucket in hive On Friday, August 19, 2016, Mich Talebzadeh wrote: > Hash partitioning (Bucketing) does not make much sense for /MM/DD/32 > as pointed out. > > So it is clear that with (mod 32), the maximum number of offsets is going

Re: Inserting data in hive bucket

2016-08-19 Thread Mich Talebzadeh
Hash partitioning (Bucketing) does not make much sense for /MM/DD/32 as pointed out. So it is clear that with (mod 32), the maximum number of offsets is going to be 32, i.e. in the range between 0-31. With /MM/DD you have to account for hash collisions as well. The set of inputs is potenti

Re: Inserting data in hive bucket

2016-08-19 Thread Gopal Vijayaraghavan
> We are bucketing by date so we wil have max 32 buckets If you do want to lookup specifically by date, you could just create day partitions and never partition by month. FYI, in a modern version of Hive select count(1) from table where YEAR(dt) = 2016 and MONTH(dt) = 12 does prune it on the c

Re: Inserting data in hive bucket

2016-08-19 Thread Rahul Channe
Hi Mich, We are bucketing by date so we wil have max 32 buckets On Friday, August 19, 2016, Mich Talebzadeh wrote: > Hi, > > You are partitioning by Month and bucketing by date or day? > > If that is the case you only have 30-31 hash partitioning (bucketing) for > each Month? > > HTH > > Dr Mic

Re: Inserting data in hive bucket

2016-08-19 Thread Mich Talebzadeh
Hi, You are partitioning by Month and bucketing by date or day? If that is the case you only have 30-31 hash partitioning (bucketing) for each Month? HTH Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw