Hi all,
We have recently upgraded from 1.7.2 to 1.8.0. In 1.7.2, when I start a task
manager in Standalone mode, the actor system was being started with a host
name. But after upgrading to 1.8.0, this is getting started with the IP
address. As a result, the task managers on the dashboard show IP addresses
instead of their hostnames. Is there some change that needs to be done while
starting task managers when switching from 1.8.0 to 1.7.2?
This is how I’m starting the task manager - ${Flink_HOME}/bin/taskmanager.sh
start
Including logs of both versions –
Flink 1.7.2:
2019-05-17 08:36:59,421 WARN
org.apache.flink.configuration.Configuration - Config uses
deprecated configuration key 'jobmanager.rpc.address' instead of proper key
'rest.address'
2019-05-17 08:36:59,425 INFO
org.apache.flink.runtime.util.LeaderRetrievalUtils - Trying to
select the network interface and address to use by connecting to the leading
JobManager.
2019-05-17 08:36:59,425 INFO
org.apache.flink.runtime.util.LeaderRetrievalUtils - TaskManager
will try to connect for 10000 milliseconds before falling back to heuristics
2019-05-17 08:36:59,428 INFO
org.apache.flink.runtime.net.ConnectionUtils - Retrieved new
target address flink0-0.high.ue1.pre.aws.cloud.abc.com/10.86.94.11:6123.
2019-05-17 08:36:59,430 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner - TaskManager
will use hostname/address 'flink1-0.high.ue1.pre.aws.cloud.abc.com'
(10.86.94.11) for communication.
2019-05-17 08:36:59,432 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils - Trying to start
actor system at flink1-0.high.ue1.pre.aws.cloud.abc.com:0
2019-05-17 08:36:59,802 INFO akka.event.slf4j.Slf4jLogger
- Slf4jLogger started
2019-05-17 08:36:59,856 INFO akka.remote.Remoting
- Starting remoting
2019-05-17 08:36:59,964 INFO akka.remote.Remoting
- Remoting started; listening on addresses
:[akka.tcp://fl...@flink1-0.high.ue1.pre.aws.cloud.abc.com:20183]
2019-05-17 08:36:59,966 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils - Actor system
started at akka.tcp://fl...@flink1-0.high.ue1.pre.aws.cloud.abc.com:20183
2019-05-17 08:36:59,979 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner - Trying to start
actor system at flink1-0.high.ue1.pre.aws.cloud.abc.com:0
2019-05-17 08:37:00,017 INFO akka.event.slf4j.Slf4jLogger
- Slf4jLogger started
2019-05-17 08:37:00,025 INFO akka.remote.Remoting
- Starting remoting
Flink 1.8.0:
2019-05-17 08:48:59,819 INFO
org.apache.flink.configuration.Configuration - Config uses
fallback configuration key 'jobmanager.rpc.address' instead of key
'rest.address'
2019-05-17 08:48:59,824 INFO
org.apache.flink.runtime.util.LeaderRetrievalUtils - Trying to
select the network interface and address to use by connecting to the leading
JobManager.
2019-05-17 08:48:59,824 INFO
org.apache.flink.runtime.util.LeaderRetrievalUtils - TaskManager
will try to connect for 10000 milliseconds before falling back to heuristics
2019-05-17 08:48:59,827 INFO
org.apache.flink.runtime.net.ConnectionUtils - Retrieved new
target address flink0-1.high.ue1.pre.aws.cloud.abc.com/10.16.74.117:6123.
2019-05-17 08:48:59,830 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner - TaskManager
will use hostname/address 'flink1-1.high.ue1.pre.aws.cloud.abc.com'
(10.86.94.11) for communication.
2019-05-17 08:48:59,832 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils - Trying to start
actor system at 10.86.94.11:0
2019-05-17 08:49:00,212 INFO akka.event.slf4j.Slf4jLogger
- Slf4jLogger started
2019-05-17 08:49:00,277 INFO akka.remote.Remoting
- Starting remoting
2019-05-17 08:49:00,422 INFO akka.remote.Remoting
- Remoting started; listening on addresses
:[akka.tcp://flink@10.86.94.11:12923]
2019-05-17 08:49:00,429 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils - Actor system
started at akka.tcp://flink@10.86.94.11:12923
2019-05-17 08:49:00,438 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner - Trying to start
actor system at 10.86.94.11:0
2019-05-17 08:49:00,462 INFO akka.event.slf4j.Slf4jLogger
- Slf4jLogger started
2019-05-17 08:49:00,467 INFO akka.remote.Remoting
- Starting remoting
Thanks,
Harshith
