Hi Guys,
After add 3 hosts to yarn cluster, some job can’t startup, then I found
some informations as shown below:
2017-07-17 17:37:29.928 [AMRM Callback Handler Thread]
YarnClusterResourceManager [INFO] Container allocated from RM on
rflow79.antfact.com
2017-07-17 17:37:29.929 [AMRM Callback Handler Thread]
YarnClusterResourceManager [INFO] Container allocated from RM on
rflow6.antfact.com
2017-07-17 17:37:29.929 [AMRM Callback Handler Thread]
YarnClusterResourceManager [INFO] Container allocated from RM on
rflow5.antfact.com
2017-07-17 17:37:29.929 [AMRM Callback Handler Thread]
ContainerProcessManager [INFO] Container allocated from RM on
rflow79.antfact.com
2017-07-17 17:37:29.929 [AMRM Callback Handler Thread]
ResourceRequestState [INFO] Host affinity not enabled. Saving the samzaResource
container_e38_1500040925911_0028_01_000007 in the buffer for ANY_HOST
2017-07-17 17:37:29.929 [AMRM Callback Handler Thread]
ContainerProcessManager [INFO] Container allocated from RM on
rflow6.antfact.com
2017-07-17 17:37:29.929 [AMRM Callback Handler Thread]
ResourceRequestState [INFO] Host affinity not enabled. Saving the samzaResource
container_e38_1500040925911_0028_01_000008 in the buffer for ANY_HOST
2017-07-17 17:37:29.929 [AMRM Callback Handler Thread]
ContainerProcessManager [INFO] Container allocated from RM on
rflow5.antfact.com
2017-07-17 17:37:29.929 [AMRM Callback Handler Thread]
ResourceRequestState [INFO] Host affinity not enabled. Saving the samzaResource
container_e38_1500040925911_0028_01_000010 in the buffer for ANY_HOST
What does “Host affinity” mean?
Thanks!
————————
Qi Shu