Re: HIVE issues when using large number of partitions

2013-03-09 Thread Edward Capriolo
2) Getting 'out of memory' java exception while adding partitions > 5 3) Sometimes getting 'out of memory' java exception for select queries for partitions > 1 So hive/hadoop have to "plan" the job. Planning involves building all the partitions into a list (in memory) of the client. It als

Re: HIVE issues when using large number of partitions

2013-03-09 Thread Ramki Palle
Check this for your first question: https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL#LanguageManualDDL-Recoverpartitions Please post if you find any solution for your 2nd and 3rd questions. Regards, Ramki. On Thu, Mar 7, 2013 at 8:01 PM, Suresh Krishnappa < suresh.krishna...