have you a page in which you explain the steps.
2012/12/12 Mohammad Tariq
> Hi Imen,
>
> I am sorry, I didn't get the question. Are you asking about
> creating a distributed cluster? Yeah, I have done that.
>
> Regards,
> Mohammad Tariq
>
>
>
> On Wed, Dec 12, 2012 at 7:45 PM, ime
Hi Imen,
I am sorry, I didn't get the question. Are you asking about
creating a distributed cluster? Yeah, I have done that.
Regards,
Mohammad Tariq
On Wed, Dec 12, 2012 at 7:45 PM, imen Megdiche wrote:
> have you please commented the configuration of hadoop on cluster
>
> thanks
have you please commented the configuration of hadoop on cluster
thanks
2012/12/12 Mohammad Tariq
> You are always welcome. If you still need any help, you can go here :
> http://cloudfront.blogspot.in/2012/07/how-to-configure-hadoop.html
> I have outlined the entire process here along with fe
thank you very much you re awsome.
Fixed
2012/12/12 Mohammad Tariq
> Uncomment the property in core-site.xml. That is a must. After doing this
> you have to restart the daemons?
>
> Regards,
> Mohammad Tariq
>
>
>
> On Wed, Dec 12, 2012 at 7:08 PM, imen Megdiche wrote:
>
>> I changed the
I wonder how you are able to run the job without a JT. You must have this
on your mapred-site.xml file :
mapred.job.tracker
localhost:9001
Also add "hadoop.tmp.dir" in core-site.xml, and "dfs.name.dir" &
"dfs.data.dir" in hdfs-site.xml.
Regards,
Mohammad Tariq
On Wed, Dec 12, 20
For mapred-site.xml :
mapred.map.tasks
6
for core-site.xml :
on hdfs-site.xml nothing
2012/12/12 Mohammad Tariq
> Can I have a look at your config files?
>
> Regards,
> Mohammad Tariq
>
>
>
> On Wed, Dec 12, 2012 at 6:31 PM, imen Megdiche wrote:
>
>> i run the start-all.s
Can I have a look at your config files?
Regards,
Mohammad Tariq
On Wed, Dec 12, 2012 at 6:31 PM, imen Megdiche wrote:
> i run the start-all.sh and all daemons starts without problems. But i the
> log of the tasktracker look like this :
>
>
> 2012-12-12 13:53:45,495 INFO org.apache.hadoop.m
i run the start-all.sh and all daemons starts without problems. But i the
log of the tasktracker look like this :
2012-12-12 13:53:45,495 INFO org.apache.hadoop.mapred.TaskTracker:
STARTUP_MSG:
/
STARTUP_MSG: Starting TaskTracker
STARTUP
I would check if all the daemons are running properly or not, before
anything else. If some problem is found, next place to track is the log of
each daemon.
The correct command to check the status of a job from command line is :
hadoop job -status jobID.
(Mind the 'space' after job and remove 'com
My goal is to analyze the response time of MapReduce depending on the size
of the input files. I need to change the number of map and / or Reduce tasks
and recover the execution time. S it turns out that nothing works locally on my
pc :
neither hadoop job-status command job_local_0001 (which return
Are you working locally?What exactly is the issue?
Regards,
Mohammad Tariq
On Wed, Dec 12, 2012 at 6:00 PM, imen Megdiche wrote:
> no
>
>
> 2012/12/12 Mohammad Tariq
>
>> Any luck with "localhost:50030"??
>>
>> Regards,
>> Mohammad Tariq
>>
>>
>>
>> On Wed, Dec 12, 2012 at 5:53 PM, im
no
2012/12/12 Mohammad Tariq
> Any luck with "localhost:50030"??
>
> Regards,
> Mohammad Tariq
>
>
>
> On Wed, Dec 12, 2012 at 5:53 PM, imen Megdiche wrote:
>
>> i run the job through the command line
>>
>>
>> 2012/12/12 Mohammad Tariq
>>
>>> You have to replace "JobTrackerHost" in "JobTra
Any luck with "localhost:50030"??
Regards,
Mohammad Tariq
On Wed, Dec 12, 2012 at 5:53 PM, imen Megdiche wrote:
> i run the job through the command line
>
>
> 2012/12/12 Mohammad Tariq
>
>> You have to replace "JobTrackerHost" in "JobTrackerHost:50030" with the
>> actual name of the machi
i run the job through the command line
2012/12/12 Mohammad Tariq
> You have to replace "JobTrackerHost" in "JobTrackerHost:50030" with the
> actual name of the machine where JobTracker is running. For example, If
> you are working on a local cluster, you have to use "localhost:50030".
>
> Are y
You have to replace "JobTrackerHost" in "JobTrackerHost:50030" with the
actual name of the machine where JobTracker is running. For example, If you
are working on a local cluster, you have to use "localhost:50030".
Are you running your job through the command line or some IDE?
Regards,
Mohamm
excuse me the data size is 98 MB
2012/12/12 imen Megdiche
> the size of data 49 MB and n of map 4
> the web UI JobTrackerHost:50030 does not wok, what should i do to make
> this appear , i work on ubuntu
>
>
> 2012/12/12 Mohammad Tariq
>
>> Hi Imen,
>>
>> You can visit the MR web UI at "J
the size of data 49 MB and n of map 4
the web UI JobTrackerHost:50030 does not wok, what should i do to make this
appear , i work on ubuntu
2012/12/12 Mohammad Tariq
> Hi Imen,
>
> You can visit the MR web UI at "JobTrackerHost:50030" and see all the
> useful information like no. of mapper
Hi Imen,
You can visit the MR web UI at "JobTrackerHost:50030" and see all the
useful information like no. of mappers, no of reducers, time taken for the
execution etc.
One quick question for you, what is the size of your data and what is the
no of maps which you are getting right now?
Reg
Thank you Mohammad but the number of map tasks still the same in the
execution. Do you know how to capture the time spent on execution.
2012/12/12 Mohammad Tariq
> Hi Imen,
>
> You can add "mapred.map.tasks" property in your mapred-site.xml file.
>
> But, it is just a hint for the InputForm
Hi Imen,
You can add "mapred.map.tasks" property in your mapred-site.xml file.
But, it is just a hint for the InputFormat. Actually no. of maps is
actually determined by the no of InputSplits created by the InputFormat.
HTH
Regards,
Mohammad Tariq
On Wed, Dec 12, 2012 at 4:11 PM, ime
20 matches
Mail list logo
