Hi Jagadish, Thanks for your help and suggestions!
———————— Qi Shu > 在 2018年12月28日,下午5:34,Jagadish Venkatraman <jagadish1...@gmail.com> 写道: > > Hi Qi, > >>> I want to know is this normal and how to avoid such log. > > From Samza's perspective, I would treat these messages as red-herrings as > long as your containers are up and running. The INFO messages in the > ResourceManager log correspond to resources requested by your application. > > On a related note, I see that you are currently running Samza 0.12. I would > recommend upgrading to the 0.14.1 release, since it includes multiple > critical fixes <https://issues.apache.org/jira/browse/SAMZA-1484> to run > stateful jobs on YARN. > > Best, > Jagadish > > On Wed, Dec 26, 2018 at 6:00 PM QiShu <sh...@eefung.com> wrote: > >> Hi Guys, >> >> Now I use Samza 0.12.0 with HDP-3.0.0.0(Hadoop3.1.0). >> >> And everything is fine, except the ResourceManager and NodeManager >> log some infomations repeatedly and very quickly, like belows: >> >> ===ResourceManager log=== >> 2018-12-27 09:51:05,433 INFO capacity.CapacityScheduler >> (CapacityScheduler.java:allocate(1200)) - Allocation for application >> appattempt_1545793580017_0011_000001 : Allocation{containers=[], >> strictContainers=null, fungibleContainers=[], >> fungibleResources=[{AllocationRequestId: -1, Priority: -1, Capability: >> <memory:1024, vCores:1>, # Containers: 0, Location: *, Relax Locality: >> true, Execution Type Request: {Execution Type: GUARANTEED, Enforce >> Execution Type: false}, Node Label Expression: null}], nmTokens=[], >> increasedContainers=[], decreasedContainers=[], promotedContainers=[], >> demotedContainers=[], previousAttemptContainers=null, >> resourceLimit=<memory:307200, vCores:400>} with cluster resource : >> <memory:552960, vCores:468> >> 2018-12-27 09:51:05,448 INFO capacity.CapacityScheduler >> (CapacityScheduler.java:allocate(1200)) - Allocation for application >> appattempt_1545793580017_0018_000001 : Allocation{containers=[], >> strictContainers=null, fungibleContainers=[], >> fungibleResources=[{AllocationRequestId: -1, Priority: -1, Capability: >> <memory:1024, vCores:1>, # Containers: 0, Location: *, Relax Locality: >> true, Execution Type Request: {Execution Type: GUARANTEED, Enforce >> Execution Type: false}, Node Label Expression: null}], nmTokens=[], >> increasedContainers=[], decreasedContainers=[], promotedContainers=[], >> demotedContainers=[], previousAttemptContainers=null, >> resourceLimit=<memory:307200, vCores:400>} with cluster resource : >> <memory:552960, vCores:468> >> 2018-12-27 09:51:05,606 INFO capacity.CapacityScheduler >> (CapacityScheduler.java:allocate(1200)) - Allocation for application >> appattempt_1545793580017_0008_000001 : Allocation{containers=[], >> strictContainers=null, fungibleContainers=[], >> fungibleResources=[{AllocationRequestId: -1, Priority: -1, Capability: >> <memory:1024, vCores:1>, # Containers: 0, Location: *, Relax Locality: >> true, Execution Type Request: {Execution Type: GUARANTEED, Enforce >> Execution Type: false}, Node Label Expression: null}], nmTokens=[], >> increasedContainers=[], decreasedContainers=[], promotedContainers=[], >> demotedContainers=[], previousAttemptContainers=null, >> resourceLimit=<memory:307200, vCores:400>} with cluster resource : >> <memory:552960, vCores:468> >> >> ===NodeManager log=== >> Dec 26, 2018 12:55:06 PM >> com.sun.jersey.server.wadl.generators.AbstractWadlGeneratorGrammarGenerator >> attachTypes >> INFO: Couldn't find grammar element for class javax.ws.rs.core.Response >> Dec 26, 2018 12:55:06 PM >> com.sun.jersey.server.wadl.generators.AbstractWadlGeneratorGrammarGenerator >> attachTypes >> INFO: Couldn't find grammar element for class javax.ws.rs.core.Response >> Dec 26, 2018 12:55:06 PM >> com.sun.jersey.server.wadl.generators.AbstractWadlGeneratorGrammarGenerator >> attachTypes >> INFO: Couldn't find grammar element for class javax.ws.rs.core.Response >> Dec 26, 2018 12:55:06 PM >> com.sun.jersey.server.wadl.generators.AbstractWadlGeneratorGrammarGenerator >> attachTypes >> INFO: Couldn't find grammar element for class javax.ws.rs.core.Response >> Dec 26, 2018 12:55:06 PM >> com.sun.jersey.server.wadl.generators.AbstractWadlGeneratorGrammarGenerator >> attachTypes >> >> >> I want to know is this normal and how to avoid such log. >> >> Thanks! >> >> >> ———————— >> Qi Shu >> >> > > -- > Jagadish V, > Graduate Student, > Department of Computer Science, > Stanford University