Re: [Hive 0.13.1] - Explanation/confusion over "Fatal error occurred when node tried to create too many dynamic partitions" on small dataset with dynamic partitions

rarely) which only allocates one reducer – we can be sure we don’t run into this issue again With thanks, Daniel Harper Software Engineer, OTG ANT BC5 A5 From: Mich Talebzadeh mailto:m...@peridale.co.uk>> Reply-To: "user@hive.apache.org<mailto:user@hive.apache.org>" mailt

Re: [Hive 0.13.1] - Explanation/confusion over "Fatal error occurred when node tried to create too many dynamic partitions" on small dataset with dynamic partitions

As in you can only have 32 buckets (rather than 128 in our case?) With thanks, Daniel Harper Software Engineer, OTG ANT BC5 A5 From: Mich Talebzadeh mailto:m...@peridale.co.uk>> Reply-To: "user@hive.apache.org<mailto:user@hive.apache.org>" mailto:user@hive.apache.org>&g

[Hive 0.13.1] - Explanation/confusion over "Fatal error occurred when node tried to create too many dynamic partitions" on small dataset with dynamic partitions

buting the rows fairly uniformly so we have > 100 buckets to write to via one reducer Any help will be greatly appreciated With thanks, Daniel Harper Software Engineer, OTG ANT BC5 A5