In ResourceManager, is there any way to findout if the assigned container
is going to execute a mapping task or a reduce task? I can access objects
Container, Application and Request in ResourceManager, can I somehow get
TaskId by using any of these objects?? Please let me know a way.
Thanks.
ote that
> TaskId/TaskAttemptID/Map/Reduce tasks are MapReduce concepts. So
> ResourceManager has no idea about them. MapReduce ApplicationMaster is the
> place where you can obtain more such MR specific information.
>
> If it is the later, your question is moot.
>
> HTH,
> +Vi
I am trying to talk to R from Resource Manager. To do that I have to set a
VM argument
-Djava.library.path=/Library/Frameworks/R.framework/Resources/library/rJava/jri/
I have tried to set this argument by adding following line in hadoop-env.sh
export
HADOOP_OPTS="-Djava.library.path=/Library/F
As par my experience the MapReduce API is same for both YARN and MRv2.
Applications compiled again YARN should run smoothly on MRv1. Ans the vice
versa is also true.
And in general YARN is pretty stable now.
Regards,
Shekhar
On Sun, Apr 21, 2013 at 3:45 PM, Amir Sanjar wrote:
> Would an appli
ir Sanjar
>
> System Management Architect
> PowerLinux Open Source Hadoop development lead
> IBM Senior Software Engineer
> Phone# 512-286-8393
> Fax# 512-838-8858
>
>
>
> [image: Inactive hide details for Shekhar Gupta ---04/21/2013 06:06:33
> PM---As par my e
Hi Brad,
YARN scheduling does take care of data locality. In YARN, tasks are not
assigned based on capacity. Actually certain number of containers are
allocated on every node based on node's capacity. Tasks are executed on
those containers. While scheduling tasks on containers YARN scheduler
s
Issue Type: Bug
Affects Versions: 0.20.2
Environment: Linux
Reporter: Shekhar Gupta
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
