Any luck with "localhost:50030"??
Regards,
Mohammad Tariq
On Wed, Dec 12, 2012 at 5:53 PM, imen Megdiche <imen.megdi...@gmail.com>wrote:
> i run the job through the command line
>
>
> 2012/12/12 Mohammad Tariq <donta...@gmail.com>
>
>> You have to replace "JobTrackerHost" in "JobTrackerHost:50030" with the
>> actual name of the machine where JobTracker is running. For example, If
>> you are working on a local cluster, you have to use "localhost:50030".
>>
>> Are you running your job through the command line or some IDE?
>>
>> Regards,
>> Mohammad Tariq
>>
>>
>>
>> On Wed, Dec 12, 2012 at 5:42 PM, imen Megdiche
>> <imen.megdi...@gmail.com>wrote:
>>
>>> excuse me the data size is 98 MB
>>>
>>>
>>> 2012/12/12 imen Megdiche <imen.megdi...@gmail.com>
>>>
>>>> the size of data 49 MB and n of map 4
>>>> the web UI JobTrackerHost:50030 does not wok, what should i do to make
>>>> this appear , i work on ubuntu
>>>>
>>>>
>>>> 2012/12/12 Mohammad Tariq <donta...@gmail.com>
>>>>
>>>>> Hi Imen,
>>>>>
>>>>> You can visit the MR web UI at "JobTrackerHost:50030" and see all
>>>>> the useful information like no. of mappers, no of reducers, time taken
>>>>> for
>>>>> the execution etc.
>>>>>
>>>>> One quick question for you, what is the size of your data and what is
>>>>> the no of maps which you are getting right now?
>>>>>
>>>>> Regards,
>>>>> Mohammad Tariq
>>>>>
>>>>>
>>>>>
>>>>> On Wed, Dec 12, 2012 at 5:11 PM, imen Megdiche <
>>>>> imen.megdi...@gmail.com> wrote:
>>>>>
>>>>>> Thank you Mohammad but the number of map tasks still the same in the
>>>>>> execution. Do you know how to capture the time spent on execution.
>>>>>>
>>>>>>
>>>>>> 2012/12/12 Mohammad Tariq <donta...@gmail.com>
>>>>>>
>>>>>>> Hi Imen,
>>>>>>>
>>>>>>> You can add "mapred.map.tasks" property in your mapred-site.xml
>>>>>>> file.
>>>>>>>
>>>>>>> But, it is just a hint for the InputFormat. Actually no. of maps is
>>>>>>> actually determined by the no of InputSplits created by the InputFormat.
>>>>>>>
>>>>>>> HTH
>>>>>>>
>>>>>>> Regards,
>>>>>>> Mohammad Tariq
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On Wed, Dec 12, 2012 at 4:11 PM, imen Megdiche <
>>>>>>> imen.megdi...@gmail.com> wrote:
>>>>>>>
>>>>>>>> Hi,
>>>>>>>>
>>>>>>>> I try to force the number of map for the mapreduce job with the
>>>>>>>> command :
>>>>>>>> public static void main(String[] args) throws Exception {
>>>>>>>>
>>>>>>>> JobConf conf = new JobConf(WordCount.class);
>>>>>>>> conf.set("mapred.job.tracker", "local");
>>>>>>>> conf.set("fs.default.name", "local");
>>>>>>>> conf.setJobName("wordcount");
>>>>>>>>
>>>>>>>> conf.setOutputKeyClass(Text.class);
>>>>>>>> conf.setOutputValueClass(IntWritable.class);
>>>>>>>>
>>>>>>>> conf.setNumMapTask(6);
>>>>>>>> conf.setMapperClass(Map.class);
>>>>>>>> conf.setCombinerClass(Reduce.class);
>>>>>>>> conf.setReducerClass(Reduce.class);
>>>>>>>> ...
>>>>>>>> }
>>>>>>>>
>>>>>>>> But it doesn t work.
>>>>>>>> What can i do to modify the number of map and reduce tasks.
>>>>>>>>
>>>>>>>> Thank you
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
>
