Re: need help in Mapreduce(urgent)

2012-01-09 Thread hadoop hive
Hey thanks for your reply i wanna ask that *setOutputFormatClass *works in Java New Api, please tell me if u have any idea. regards hadoophive On Mon, Jan 9, 2012 at 8:47 PM, Martin Kuhn wrote: > > > one more i wanna ask like how i can write output in different > directories according to key va

Re: need help in Mapreduce(urgent)

2012-01-09 Thread Martin Kuhn
> one more i wanna ask like how i can write output in different directories > according to key values. It would be good to know your use case, but maybe you can partition your results according to the keys http://developer.yahoo.com/hadoop/tutorial/module5.html#partitioning and use a cust

Re: need help in Mapreduce(urgent)

2012-01-09 Thread hadoop hive
Thanks martin :) one more i wanna ask like how i can write output in different directories according to key values. On Mon, Jan 9, 2012 at 6:39 PM, Martin Kuhn wrote: > Hi Vikas, > > > 1:- How to format output from reduce( like default is tab separator can > we make it "," separator) > > If you

Re: need help in Mapreduce(urgent)

2012-01-09 Thread Martin Kuhn
Hi Vikas, > 1:- How to format output from reduce( like default is tab separator can we > make it "," separator) If you want this behaviour for all your Hadoop jobs, you have to put this into your mapred-site.xml: mapred.textoutputformat.separator , (see https://issue

Re: need help in Mapreduce(urgent)

2012-01-09 Thread vikas Srivastava
do you have any sample code of that , it ll be very helpful to me On Mon, Jan 9, 2012 at 6:08 PM, Bhavesh Shah wrote: > Hello, > when you use the context.write(key,value), it appears as (seperated by > tab): > (key)(value) > (Text)(IntWritable) > hive 1 > hadoop 2 > > I am also

Re: need help in Mapreduce(urgent)

2012-01-09 Thread Bhavesh Shah
Hello, when you use the context.write(key,value), it appears as (seperated by tab): (key)(value) (Text)(IntWritable) hive 1 hadoop 2 I am also new to Hadoop but faced this problems previously. What I did that I had combine the value in mapper by "," and then I passed it to contex

Re: need help in Mapreduce(urgent)

2012-01-09 Thread vikas Srivastava
Hi Bhavesh Shah , thanks for you reply but the this is , my Mapper is sending *context.write(new Text(catagoryAll), new IntWritable(val));* and my reducer is like *context.write(key,new IntWritable(sum));* * * and these provide result like hive 1 hadoop 2 and wat i want is output l

Re: need help in Mapreduce(urgent)

2012-01-09 Thread Bhavesh Shah
Hello, *1:- How to format output from reduce( like default is tab separator can we make it "," separator) * Instead of formatting output in reduce, you set it in map phase when you set the value for mapper. In that you can set according to our formayt e.g. word.set(fname+" "+lname); and gi