Thank you, Jesse.
Here are more log info:
2020-07-15 18:19:36,456 INFO org.apache.flink.client.cli.CliFrontend
-
--------------------------------------------------------------------------------
2020-07-15 18:19:36,460 INFO
org.apache.flink.configuration.GlobalConfiguration - Loading
configuration property: jobmanager.rpc.address, localhost
2020-07-15 18:19:36,460 INFO
org.apache.flink.configuration.GlobalConfiguration - Loading
configuration property: jobmanager.rpc.port, 6123
2020-07-15 18:19:36,460 INFO
org.apache.flink.configuration.GlobalConfiguration - Loading
configuration property: jobmanager.heap.size, 1024m
2020-07-15 18:19:36,460 INFO
org.apache.flink.configuration.GlobalConfiguration - Loading
configuration property: taskmanager.heap.size, 1024m
2020-07-15 18:19:36,460 INFO
org.apache.flink.configuration.GlobalConfiguration - Loading
configuration property: taskmanager.numberOfTaskSlots, 1
2020-07-15 18:19:36,460 INFO
org.apache.flink.configuration.GlobalConfiguration - Loading
configuration property: parallelism.default, 1
2020-07-15 18:19:36,461 INFO
org.apache.flink.configuration.GlobalConfiguration - Loading
configuration property: jobmanager.execution.failover-strategy, region
2020-07-15 18:19:36,463 WARN org.apache.flink.client.cli.CliFrontend
- Could not load CLI class
org.apache.flink.yarn.cli.FlinkYarnSessionCli.
java.lang.NoClassDefFoundError:
org/apache/hadoop/yarn/exceptions/YarnException
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at
org.apache.flink.client.cli.CliFrontend.loadCustomCommandLine(CliFrontend.java:1185)
at
org.apache.flink.client.cli.CliFrontend.loadCustomCommandLines(CliFrontend.java:1145)
at
org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1070)
Caused by: java.lang.ClassNotFoundException:
org.apache.hadoop.yarn.exceptions.YarnException
at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 5 more
2020-07-15 18:19:36,519 INFO org.apache.flink.core.fs.FileSystem
- Hadoop is not in the classpath/dependencies. The extended
set of supported File Systems via Hadoop is not availab\
le.
2020-07-15 18:19:36,647 INFO
org.apache.flink.runtime.security.modules.HadoopModuleFactory - Cannot
create Hadoop Security Module because Hadoop cannot be found in the
Classpath.
2020-07-15 18:19:36,658 INFO
org.apache.flink.runtime.security.SecurityUtils - Cannot
install HadoopSecurityContext because Hadoop cannot be found in the
Classpath.
Best regards
Rainie
On Wed, Jul 15, 2020 at 11:49 AM Jesse Lord <[email protected]> wrote:
> Hi Rainie,
>
>
>
> I am relatively new to flink, but I suspect that your error is somewhere
> else in the log. I have found most of my problems by doing a search for the
> word “error” or “exception”. Since all of these log lines are at the info
> level, they are probably not highlighting any real issues. If you send more
> of the log or find an error line that might help others debug.
>
>
>
> Thanks,
>
> Jesse
>
>
>
> *From: *Rainie Li <[email protected]>
> *Date: *Wednesday, July 15, 2020 at 10:54 AM
> *To: *"[email protected]" <[email protected]>
> *Subject: *flink app crashed
>
>
>
> Hi All,
>
>
>
> I am new to Flink, any idea why flink app's Job Manager stuck, here is
> bottom part from the Job Manager log. Any suggestion will be appreciated.
>
> 2020-07-15 16:49:52,749 INFO
> org.apache.flink.runtime.rpc.akka.AkkaRpcService - Starting RPC endpoint
> for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at
> akka://flink/user/dispatcher .
>
> 2020-07-15 16:49:52,759 INFO
> org.apache.flink.runtime.leaderretrieval.ZooKeeperLeaderRetrievalService -
> Starting ZooKeeperLeaderRetrievalService /leader/resource_manager_lock.
>
> 2020-07-15 16:49:52,759 INFO
> org.apache.flink.runtime.leaderretrieval.ZooKeeperLeaderRetrievalService -
> Starting ZooKeeperLeaderRetrievalService /leader/dispatcher_lock.
>
> 2020-07-15 16:49:52,762 INFO
> org.apache.flink.runtime.leaderelection.ZooKeeperLeaderElectionService -
> Starting ZooKeeperLeaderElectionService
> ZooKeeperLeaderElectionService{leaderPath='/leader/dispatcher_lock'}.
>
> 2020-07-15 16:49:52,790 INFO
> org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Dispatcher
> /user/dispatcher was granted leadership with fencing token
>
> 2020-07-15 16:49:52,791 INFO
> org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Recovering all
> persisted jobs.
>
> 2020-07-15 16:49:52,931 INFO
> org.apache.hadoop.yarn.client.ConfiguredRMFailoverProxyProvider - Failing
> over to rm1
>
> 2020-07-15 16:49:53,014 INFO org.apache.flink.yarn.YarnResourceManager -
> Recovered 0 containers from previous attempts ([]).
>
> 2020-07-15 16:49:53,018 INFO
> org.apache.hadoop.yarn.client.api.async.impl.NMClientAsyncImpl - Upper
> bound of the thread pool size is 500
>
> 2020-07-15 16:49:53,020 INFO
> org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy -
> yarn.client.max-cached-nodemanagers-proxies : 0
>
> 2020-07-15 16:49:53,021 INFO
> org.apache.flink.runtime.leaderelection.ZooKeeperLeaderElectionService -
> Starting ZooKeeperLeaderElectionService
> ZooKeeperLeaderElectionService{leaderPath='/leader/resource_manager_lock'}.
>
> 2020-07-15 16:49:53,042 INFO org.apache.flink.yarn.YarnResourceManager -
> ResourceManager akka.tcp://flink@cluster-dev-001/user/resourcemanager was
> granted leadership with fencing token
>
> 2020-07-15 16:49:53,046 INFO
> org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl -
> Starting the SlotManager.
>
> 2020-07-15 16:50:52,217 INFO org.apache.kafka.clients.Metadata - Cluster
> ID: FZrfSqHiTpaZwEzIRYkCLQ
>
>
>
>
>
> Thanks
>
> Best regards
>
> Rainie
>
