Re: mapred.user.jobconf.limit question

2012-06-20 Thread Edward Capriolo
If you have a query producing that many partitions it is probably a bad idea. Consider using hive's bucketing or changing your partitioning scheme. Edward On Wed, Jun 20, 2012 at 12:52 PM, Greg Fuller wrote: > Hi, > > I sent this out to common-u...@hadoop.apache.org yesterday, but the hive > ma

mapred.user.jobconf.limit question

2012-06-20 Thread Greg Fuller
Hi, I sent this out to common-u...@hadoop.apache.org yesterday, but the hive mailing list might be a better forum for this question. With CDH3u4 and Cloudera Manager, and I am running a hive query to repartition all of our tables. I'm reducing the number of partitions from 5 to 2, because the