Re: Creating Indexes again

2012-11-23 Thread Nitin Pawar
peter.mar...@trilliumsoftware.com ** > ** > > ** ** > > *From:* Nitin Pawar [mailto:nitinpawar...@gmail.com] > *Sent:* 23 November 2012 08:55 > *To:* user@hive.apache.org > *Subject:* Re: Creating Indexes again > > ** ** > > try increasing ulimit on you

RE: Creating Indexes again

2012-11-23 Thread Peter Marron
<mailto:roy.willi...@trilliumsoftware.com> From: Nitin Pawar [mailto:nitinpawar...@gmail.com] Sent: 23 November 2012 08:55 To: user@hive.apache.org Subject: Re: Creating Indexes again try increasing ulimit on your hadoop cluster as well increase the memory for map and reducer both by setting t

Re: Creating Indexes again

2012-11-23 Thread Nitin Pawar
try increasing ulimit on your hadoop cluster as well increase the memory for map and reducer both by setting them up on hive set mapred.job.map.memory.mb=6000; set mapred.job.reduce.memory.mb=4000; you can change the values based on the hadoop cluster you have setup On Fri, Nov 23, 2012 at 2:17

Creating Indexes again

2012-11-23 Thread Peter Marron
Hi, I'm trying to create indexes in Hive, and I've switched to using CDH-4. The creation of the index is failing and it's pretty obvious that the reducers are running out of heap space. When I use the web interface for the "Hadoop reduce task list" I can find this entry: Error: Java heap space Er