Yan,
I have reached out to yarn-dev mailing list. I have not received any
response yet.
Wondering if there is any other channel where I can get some answers on
yarn.
- Shekar
On Tue, Jun 23, 2015 at 1:18 PM, Yan Fang wrote:
> Hi Shekar,
>
> Cool. Let me know if it works.
>
> Thanks,
>
> Fang,
Hi Shekar,
Cool. Let me know if it works.
Thanks,
Fang, Yan
yanfang...@gmail.com
On Tue, Jun 23, 2015 at 12:40 PM, Shekar Tippur wrote:
> Yan,
>
> I have restarted Yarn but I still see the same issue. I will post this
> question on Yarn mailing list.
> yarn-...@hadoop.apache.org
>
> - Shekar
Yan,
I have restarted Yarn but I still see the same issue. I will post this
question on Yarn mailing list.
yarn-...@hadoop.apache.org
- Shekar
Hi Shekar,
My guess is that, in order to get this property to take effect, you may
need to restart the yarn. Otherwise, send this question to the Yarn mailing
list, you may get more valuable answers.
Thanks,
Fang, Yan
yanfang...@gmail.com
On Mon, Jun 22, 2015 at 2:43 PM, Shekar Tippur wrote:
Looks like when I kill an application ID, the next application ID in the
pending queue takes over.
As there are 2 running jobs, I see that for every in coming event, there
are 2 outputs.
a. How do I force to have just 1 running job
b. How to force the number of application pending to a smaller numb
Yan,
As suggested, I killed one of the application id's but looks like it
respawns another one. Guessing I need to kill the application master and
restart it?
Cluster MetricsApps SubmittedApps PendingApps RunningApps CompletedContainers
RunningMemory UsedMemory TotalMemory ReservedVCores UsedVCor
Hi Shekar,
Ok. If there is only one application is running, if you kill this one, will
you still be able to see the processed messages coming? If not, I think the
code in your application maybe the cause of the problem. We can have a
further look at your code to see where the problem is.
Thanks,
This is what I see on Yarn monitoring page:
As we can see, there are 9998 apps pending. There is some 10k limit we are
hitting. I see only 1 app running.
Apps SubmittedApps PendingApps RunningApps CompletedContainers RunningMemory
UsedMemory TotalMemory ReservedVCores UsedVCores TotalVCores Rese
Hi Shekar,
a. How do I detect it?
-- You can go to Yarn's monitoring page, usually, localhost:8088. May see
what are running.
b. How do I kill redundant jobs?
-- Just like what you do for any Yarn jobs. *yarn application -kill
applicationId* . If you are using the similar structure as the hello-s
