Hi Till/Ned, Soory I thought this was my post.
Le Vendredi 15 avril 2016 17h28, ned dogg <neddog...@gmail.com> a écrit : Hi Till/Jstar, Thanks for the the reply. Well I'm facing the same issue as Jstar. Here is my scenarios, I have app that is creating flink cluster on VMs for users. This app cannot create generate a file with the key-pair. So ssh the instance to deploy the flink topology wouldn't be possible as we can't provide them with key-pairs. On Fri, Apr 15, 2016 at 4:36 PM, star jlong <jlongs...@yahoo.fr.invalid> wrote: Hi Till, Thanks for the reply. The idea of ssh of the instance is a good one. I thought of that but in my case it is not applicable because I setting up a cluster some employees of a company. And ssh the instance by employees will mean giving them the instance's key-pair, which I can not. Matter of fact, I'm the one who is supposed to handle the maintainance of the cluster. Le Vendredi 15 avril 2016 10h34, Till Rohrmann <trohrm...@apache.org> a écrit : Hi Ned, what you also could do is to ssh to your remote cluster and submit the job using the private IP address which is reachable from within your cluster. I don't know whether that would be applicable to your use case. Cheers, Till On Fri, Apr 15, 2016 at 9:22 AM, Till Rohrmann <trohrm...@apache.org> wrote: > The log says: Unable to allocate on port 6123, due to error: Cannot assign > requested address > > Thus, I would assume that something with your cluster configuration is not > entirely correct. Could you check that? > > On Thu, Apr 14, 2016 at 11:19 AM, ned dogg <neddog...@gmail.com> wrote: > >> Here a try that I given. As first I was configuring my cluster with >> private >> ip and it was starting properly. >> So to avoid this akka issue, I decided to configure my cluster with public >> address but with this configuration, my cluster is not starting at all. >> Here is the logs that I get >> 2016-04-14 09:08:52,845 INFO >> org.apache.flink.runtime.jobmanager.JobManager - >> >> -------------------------------------------------------------------------------- >> 2016-04-14 09:08:52,847 INFO >> org.apache.flink.runtime.jobmanager.JobManager - Starting >> JobManager (Version: 1.0.1, Rev:4afa401, Date:31.03.2016 @ 13:40:33 UTC) >> 2016-04-14 09:08:52,847 INFO >> org.apache.flink.runtime.jobmanager.JobManager - Current >> user: ubuntu >> 2016-04-14 09:08:52,847 INFO >> org.apache.flink.runtime.jobmanager.JobManager - JVM: >> OpenJDK 64-Bit Server VM - Oracle Corporation - 1.7/24.95-b01 >> 2016-04-14 09:08:52,847 INFO >> org.apache.flink.runtime.jobmanager.JobManager - Maximum >> heap size: 247 MiBytes >> 2016-04-14 09:08:52,847 INFO >> org.apache.flink.runtime.jobmanager.JobManager - >> JAVA_HOME: (not set) >> 2016-04-14 09:08:52,880 INFO >> org.apache.flink.runtime.jobmanager.JobManager - Hadoop >> version: 1.2.1 >> 2016-04-14 09:08:52,881 INFO >> org.apache.flink.runtime.jobmanager.JobManager - JVM >> Options: >> 2016-04-14 09:08:52,881 INFO >> org.apache.flink.runtime.jobmanager.JobManager - >> -Xms256m >> 2016-04-14 09:08:52,881 INFO >> org.apache.flink.runtime.jobmanager.JobManager - >> -Xmx256m >> 2016-04-14 09:08:52,881 INFO >> org.apache.flink.runtime.jobmanager.JobManager - >> -XX:MaxPermSize=256m >> 2016-04-14 09:08:52,881 INFO >> org.apache.flink.runtime.jobmanager.JobManager - >> >> -Dlog.file=/home/ubuntu/flink/log/flink-ubuntu-jobmanager-1-tresor-thiswithpublicip.479319055.streamly.com.log >> 2016-04-14 09:08:52,881 INFO >> org.apache.flink.runtime.jobmanager.JobManager - >> -Dlog4j.configuration=file:/home/ubuntu/flink/conf/log4j.properties >> 2016-04-14 09:08:52,881 INFO >> org.apache.flink.runtime.jobmanager.JobManager - >> -Dlogback.configurationFile=file:/home/ubuntu/flink/conf/logback.xml >> 2016-04-14 09:08:52,881 INFO >> org.apache.flink.runtime.jobmanager.JobManager - Program >> Arguments: >> 2016-04-14 09:08:52,881 INFO >> org.apache.flink.runtime.jobmanager.JobManager - >> --configDir >> 2016-04-14 09:08:52,881 INFO >> org.apache.flink.runtime.jobmanager.JobManager - >> /home/ubuntu/flink/conf >> 2016-04-14 09:08:52,881 INFO >> org.apache.flink.runtime.jobmanager.JobManager - >> --executionMode >> 2016-04-14 09:08:52,881 INFO >> org.apache.flink.runtime.jobmanager.JobManager - >> cluster >> 2016-04-14 09:08:52,881 INFO >> org.apache.flink.runtime.jobmanager.JobManager - >> Classpath: >> >> /home/ubuntu/flink/lib/flink-dist_2.10-1.0.1.jar:/home/ubuntu/flink/lib/flink-python_2.10-1.0.1.jar:/home/ubuntu/flink/lib/log4j-1.2.17.jar:/home/ubuntu/flink/lib/slf4j-log4j12-1.7.7.jar::: >> 2016-04-14 09:08:52,882 INFO >> org.apache.flink.runtime.jobmanager.JobManager - >> >> -------------------------------------------------------------------------------- >> 2016-04-14 09:08:52,883 INFO >> org.apache.flink.runtime.jobmanager.JobManager - >> Registered >> UNIX signal handlers for [TERM, HUP, INT] >> 2016-04-14 09:08:53,324 INFO >> org.apache.flink.runtime.jobmanager.JobManager - Loading >> configuration from /home/ubuntu/flink/conf >> 2016-04-14 09:08:53,373 INFO >> org.apache.flink.runtime.jobmanager.JobManager - Starting >> JobManager without high-availability >> 2016-04-14 09:08:53,390 INFO >> org.apache.flink.runtime.jobmanager.JobManager - Starting >> JobManager on 54.233.145.230:6123 with execution mode CLUSTER >> 2016-04-14 09:08:53,613 INFO >> org.apache.flink.runtime.jobmanager.JobManager - Security >> is not enabled. Starting non-authenticated JobManager. >> 2016-04-14 09:08:53,651 INFO org.apache.flink.util.NetUtils >> - Unable to allocate on port 6123, due to error: Cannot >> assign requested address >> 2016-04-14 09:08:53,654 ERROR >> org.apache.flink.runtime.jobmanager.JobManager - Failed to >> run JobManager. >> java.lang.RuntimeException: Unable to do further retries starting the >> actor >> system >> at >> >> org.apache.flink.runtime.jobmanager.JobManager$.retryOnBindException(JobManager.scala:1779) >> at >> >> org.apache.flink.runtime.jobmanager.JobManager$.runJobManager(JobManager.scala:1719) >> at >> >> org.apache.flink.runtime.jobmanager.JobManager$.main(JobManager.scala:1655) >> at org.apache.flink.runtime.jobmanager.JobManager.main(JobManager.scala) >> >> >> >> On Thu, Apr 14, 2016 at 10:11 AM, ned dogg <neddog...@gmail.com> wrote: >> >> > Thanks Till for the reply. >> > >> > But according to you how can I address that? >> > >> > Thanks, >> > Ned >> > >> > On Thu, Apr 14, 2016 at 9:56 AM, Till Rohrmann <till.rohrm...@gmail.com >> > >> > wrote: >> > >> >> Hi Ned, >> >> >> >> I think you are facing the issue described in this JIRA issue [1]. The >> >> problem is that you have a private and a public IP address and that >> Akka >> >> binds to the private IP address. Since the registered IP of an >> ActorSystem >> >> and the target IP address of a request to this ActorSystem have to be >> >> matching, you cannot reach the ActorSystem via the public IP address. >> >> Requests with a non-matching IP address are discarded, as indicated by >> the >> >> last log statements. >> >> >> >> [1] https://issues.apache.org/jira/browse/FLINK-2821 >> >> >> >> Cheers, >> >> Till >> >> >> >> On Thu, Apr 14, 2016 at 10:41 AM, ned dogg <neddog...@gmail.com> >> wrote: >> >> >> >> > 2016-04-14 08:23:51,900 INFO >> >> > org.apache.flink.runtime.jobmanager.JobManager - >> >> > >> >> > >> >> >> -------------------------------------------------------------------------------- >> >> > 2016-04-14 08:23:51,902 INFO >> >> > org.apache.flink.runtime.jobmanager.JobManager - >> >> Starting >> >> > JobManager (Version: 1.0.1, Rev:4afa401, Date:31.03.2016 @ 13:40:33 >> UTC) >> >> > 2016-04-14 08:23:51,902 INFO >> >> > org.apache.flink.runtime.jobmanager.JobManager - >> >> Current >> >> > user: root >> >> > 2016-04-14 08:23:51,902 INFO >> >> > org.apache.flink.runtime.jobmanager.JobManager - >> JVM: >> >> > OpenJDK 64-Bit Server VM - Oracle Corporation - 1.7/24.95-b01 >> >> > 2016-04-14 08:23:51,902 INFO >> >> > org.apache.flink.runtime.jobmanager.JobManager - >> >> Maximum >> >> > heap size: 247 MiBytes >> >> > 2016-04-14 08:23:51,902 INFO >> >> > org.apache.flink.runtime.jobmanager.JobManager - >> >> > JAVA_HOME: /usr/lib/jvm/java-7-openjdk-amd64 >> >> > 2016-04-14 08:23:51,929 INFO >> >> > org.apache.flink.runtime.jobmanager.JobManager - >> Hadoop >> >> > version: 1.2.1 >> >> > 2016-04-14 08:23:51,929 INFO >> >> > org.apache.flink.runtime.jobmanager.JobManager - JVM >> >> > Options: >> >> > 2016-04-14 08:23:51,930 INFO >> >> > org.apache.flink.runtime.jobmanager.JobManager - >> >> > -Xms256m >> >> > 2016-04-14 08:23:51,930 INFO >> >> > org.apache.flink.runtime.jobmanager.JobManager - >> >> > -Xmx256m >> >> > 2016-04-14 08:23:51,930 INFO >> >> > org.apache.flink.runtime.jobmanager.JobManager - >> >> > -XX:MaxPermSize=256m >> >> > 2016-04-14 08:23:51,930 INFO >> >> > org.apache.flink.runtime.jobmanager.JobManager - >> >> > >> >> > >> >> >> -Dlog.file=/home/ubuntu/flink/log/flink-root-jobmanager-0-tresor-testflinkth.1541841583.streamly.com.log >> >> > 2016-04-14 08:23:51,930 INFO >> >> > org.apache.flink.runtime.jobmanager.JobManager - >> >> > -Dlog4j.configuration=file:/home/ubuntu/flink/conf/log4j.properties >> >> > 2016-04-14 08:23:51,930 INFO >> >> > org.apache.flink.runtime.jobmanager.JobManager - >> >> > -Dlogback.configurationFile=file:/home/ubuntu/flink/conf/logback.xml >> >> > 2016-04-14 08:23:51,930 INFO >> >> > org.apache.flink.runtime.jobmanager.JobManager - >> >> Program >> >> > Arguments: >> >> > 2016-04-14 08:23:51,930 INFO >> >> > org.apache.flink.runtime.jobmanager.JobManager - >> >> > --configDir >> >> > 2016-04-14 08:23:51,930 INFO >> >> > org.apache.flink.runtime.jobmanager.JobManager - >> >> > /home/ubuntu/flink/conf >> >> > 2016-04-14 08:23:51,930 INFO >> >> > org.apache.flink.runtime.jobmanager.JobManager - >> >> > --executionMode >> >> > 2016-04-14 08:23:51,930 INFO >> >> > org.apache.flink.runtime.jobmanager.JobManager - >> >> > cluster >> >> > 2016-04-14 08:23:51,930 INFO >> >> > org.apache.flink.runtime.jobmanager.JobManager - >> >> > Classpath: >> >> > >> >> > >> >> >> /home/ubuntu/flink/lib/flink-dist_2.10-1.0.1.jar:/home/ubuntu/flink/lib/flink-python_2.10-1.0.1.jar:/home/ubuntu/flink/lib/log4j-1.2.17.jar:/home/ubuntu/flink/lib/slf4j-log4j12-1.7.7.jar::: >> >> > 2016-04-14 08:23:51,930 INFO >> >> > org.apache.flink.runtime.jobmanager.JobManager - >> >> > >> >> > >> >> >> -------------------------------------------------------------------------------- >> >> > 2016-04-14 08:23:51,931 INFO >> >> > org.apache.flink.runtime.jobmanager.JobManager - >> >> Registered >> >> > UNIX signal handlers for [TERM, HUP, INT] >> >> > 2016-04-14 08:23:52,362 INFO >> >> > org.apache.flink.runtime.jobmanager.JobManager - >> Loading >> >> > configuration from /home/ubuntu/flink/conf >> >> > 2016-04-14 08:23:52,400 INFO >> >> > org.apache.flink.runtime.jobmanager.JobManager - >> >> Starting >> >> > JobManager without high-availability >> >> > 2016-04-14 08:23:52,408 INFO >> >> > org.apache.flink.runtime.jobmanager.JobManager - >> >> Starting >> >> > JobManager on 172.31.45.232:6123 with execution mode CLUSTER >> >> > 2016-04-14 08:23:52,655 INFO >> >> > org.apache.flink.runtime.jobmanager.JobManager - >> >> Security >> >> > is not enabled. Starting non-authenticated JobManager. >> >> > 2016-04-14 08:23:52,701 INFO >> >> > org.apache.flink.runtime.jobmanager.JobManager - >> >> Starting >> >> > JobManager >> >> > 2016-04-14 08:23:52,701 INFO >> >> > org.apache.flink.runtime.jobmanager.JobManager - >> >> Starting >> >> > JobManager actor system at 172.31.45.232:6123 >> >> > 2016-04-14 08:23:54,091 INFO akka.event.slf4j.Slf4jLogger >> >> > - Slf4jLogger started >> >> > 2016-04-14 08:23:54,293 INFO Remoting >> >> > - Starting remoting >> >> > 2016-04-14 08:23:54,712 INFO Remoting >> >> > - Remoting started; listening on addresses >> >> :[akka.tcp:// >> >> > flink@172.31.45.232:6123] >> >> > 2016-04-14 08:23:54,732 INFO >> >> > org.apache.flink.runtime.jobmanager.JobManager - >> >> Starting >> >> > JobManger web frontend >> >> > 2016-04-14 08:23:54,777 INFO >> >> > org.apache.flink.runtime.webmonitor.WebMonitorUtils - >> >> Determined >> >> > location of JobManager log file: >> >> > >> >> > >> >> >> /home/ubuntu/flink/log/flink-root-jobmanager-0-tresor-testflinkth.1541841583.streamly.com.log >> >> > 2016-04-14 08:23:54,777 INFO >> >> > org.apache.flink.runtime.webmonitor.WebMonitorUtils - >> >> Determined >> >> > location of JobManager stdout file: >> >> > >> >> > >> >> >> /home/ubuntu/flink/log/flink-root-jobmanager-0-tresor-testflinkth.1541841583.streamly.com.out >> >> > 2016-04-14 08:23:54,805 INFO >> >> > org.apache.flink.runtime.webmonitor.WebRuntimeMonitor - >> Using >> >> > directory /tmp/flink-web-dadb12c4-4ac9-42d6-b127-712db44b4add for the >> >> web >> >> > interface files >> >> > 2016-04-14 08:23:54,805 INFO >> >> > org.apache.flink.runtime.webmonitor.WebRuntimeMonitor - >> Using >> >> > directory /tmp/flink-web-upload-88dc8823-f114-4787-a6f4-f1955380e384 >> for >> >> > web frontend JAR file uploads >> >> > 2016-04-14 08:23:55,600 INFO >> >> > org.apache.flink.runtime.webmonitor.WebRuntimeMonitor - Web >> >> > frontend listening at 0:0:0:0:0:0:0:0:8081 >> >> > 2016-04-14 08:23:55,601 INFO >> >> > org.apache.flink.runtime.jobmanager.JobManager - >> >> Starting >> >> > JobManager actor >> >> > 2016-04-14 08:23:55,619 INFO >> org.apache.flink.runtime.blob.BlobServer >> >> > - Created BLOB server storage directory >> >> > /tmp/blobStore-bbc7f33e-fa65-41f8-8c68-549e9707fd56 >> >> > 2016-04-14 08:23:55,634 INFO >> org.apache.flink.runtime.blob.BlobServer >> >> > - Started BLOB server at 0.0.0.0:60439 - max >> >> concurrent >> >> > requests: 50 - max backlog: 1000 >> >> > 2016-04-14 08:23:55,653 INFO >> >> > org.apache.flink.runtime.checkpoint.SavepointStoreFactory - >> Using >> >> job >> >> > manager savepoint state backend. >> >> > 2016-04-14 08:23:55,678 INFO >> >> > org.apache.flink.runtime.webmonitor.WebRuntimeMonitor - >> >> Starting >> >> > with JobManager akka.tcp://flink@172.31.45.232:6123/user/jobmanager >> on >> >> > port >> >> > 8081 >> >> > 2016-04-14 08:23:55,678 INFO >> >> > org.apache.flink.runtime.webmonitor.JobManagerRetriever - New >> >> leader >> >> > reachable under akka.tcp:// >> >> flink@172.31.45.232:6123/user/jobmanager:null. >> >> > 2016-04-14 08:23:55,692 INFO >> >> > org.apache.flink.runtime.jobmanager.JobManager - >> >> Starting >> >> > JobManager at akka.tcp://flink@172.31.45.232:6123/user/jobmanager. >> >> > 2016-04-14 08:23:55,696 INFO >> >> > org.apache.flink.runtime.jobmanager.MemoryArchivist - >> Started >> >> > memory archivist akka://flink/user/archive >> >> > 2016-04-14 08:23:55,702 INFO >> >> > org.apache.flink.runtime.jobmanager.JobManager - >> >> JobManager >> >> > akka.tcp://flink@172.31.45.232:6123/user/jobmanager was granted >> >> leadership >> >> > with leader session ID None. >> >> > 2016-04-14 08:24:12,740 INFO >> >> > org.apache.flink.runtime.instance.InstanceManager - >> >> Registered >> >> > TaskManager at tresor-testflinkth (akka.tcp:// >> >> > flink@172.31.45.130:42189/user/taskmanager) as >> >> > 734b6b21dd60760c7a05722db3c3d1c4. Current number of registered hosts >> is >> >> 1. >> >> > Current number of alive task slots is 1. >> >> > 2016-04-14 08:24:17,855 INFO >> >> > org.apache.flink.runtime.instance.InstanceManager - >> >> Registered >> >> > TaskManager at tresor-testflinkth (akka.tcp:// >> >> > flink@172.31.34.121:58814/user/taskmanager) as >> >> > fead50f6831aa3f341d58162bb918d90. Current number of registered hosts >> is >> >> 2. >> >> > Current number of alive task slots is 2. >> >> > 2016-04-14 08:29:50,346 ERROR akka.remote.EndpointWriter >> >> > - dropping message [class >> >> > akka.actor.ActorSelectionMessage] for non-local recipient >> >> > [Actor[akka.tcp:// >> >> > flink@54.233.183.228:6123/]] arriving at [akka.tcp:// >> >> > flink@54.233.183.228:6123] inbound addresses are [akka.tcp:// >> >> > flink@172.31.45.232:6123] >> >> > 2016-04-14 08:29:59,777 WARN akka.remote.ReliableDeliverySupervisor >> >> > - Association with remote system [akka.tcp:// >> >> > flink@127.0.0.1:35953] has failed, address is now gated for [5000] >> ms. >> >> > Reason is: [Disassociated]. >> >> > >> >> > >> >> > Where 54.233.183.228 <http://flink@54.233.183.228:6123> is the >> public >> >> > address of the VM hosting job manager and 172.31.45.232 >> >> > <http://flink@172.31.45.232:6123> is it private address. >> >> > 172.31.45.130 <http://flink@172.31.45.130:42189/user/taskmanager> >> and >> >> > 172.31.34.121 <http://flink@172.31.34.121:58814/user/taskmanager> >> are >> >> the >> >> > private address of the task manager >> >> > >> >> > On Thu, Apr 14, 2016 at 9:05 AM, Till Rohrmann <trohrm...@apache.org >> > >> >> > wrote: >> >> > >> >> > > I'm referring to the jobmanager.log file not the client log file. >> You >> >> can >> >> > > find it in the `/log` directory. >> >> > > >> >> > > Cheers, >> >> > > Till >> >> > > >> >> > > On Thu, Apr 14, 2016 at 9:56 AM, ned dogg <neddog...@gmail.com> >> >> wrote: >> >> > > >> >> > > > Hi Till >> >> > > > >> >> > > > Thanks for the prompt reply. >> >> > > > >> >> > > > The logs say that Please make sure that the actor is running and >> its >> >> > port >> >> > > > is reachable. >> >> > > > And it is actaully reachable because I can ping that address. >> >> > > > >> >> > > > Ned. >> >> > > > >> >> > > > On Thu, Apr 14, 2016 at 8:43 AM, Till Rohrmann < >> >> > till.rohrm...@gmail.com> >> >> > > > wrote: >> >> > > > >> >> > > > > Hi Ned, >> >> > > > > >> >> > > > > what does the logs of the JobManager say? >> >> > > > > >> >> > > > > Cheers, >> >> > > > > Till >> >> > > > > On Apr 14, 2016 9:19 AM, "ned dogg" <neddog...@gmail.com> >> wrote: >> >> > > > > >> >> > > > > > Hi everybody, >> >> > > > > > >> >> > > > > > I'm Ned, a young and passionte developer of apache >> >> technologies. I >> >> > > have >> >> > > > > > been playing with apache flink lastly. >> >> > > > > > >> >> > > > > > This is what I wanted to do submit a flink topology to a >> remote >> >> > flink >> >> > > > > > cluster. The following are the steps that I did. >> >> > > > > > >> >> > > > > > - Install flink as a cluster indicated on the link >> >> > > > > > >> >> > > > > > >> >> > > > > >> >> > > > >> >> > > >> >> > >> >> >> https://ci.apache.org/projects/flink/flink-docs-master/setup/cluster_setup.html >> >> > > > > > on three remotes VMs. >> >> > > > > > - Run the sample WordCountRemoteByClient >> >> > > > > > < >> >> > > > > > >> >> > > > > >> >> > > > >> >> > > >> >> > >> >> >> https://github.com/apache/flink/blob/master/flink-contrib/flink-storm-examples/src/main/java/org/apache/flink/storm/wordcount/WordCountRemoteByClient.java >> >> > > > > > > >> >> > > > > > by >> >> > > > > > changing >> >> > > > > > conf.put(Config.NIMBUS_HOST, "localhost"); to >> >> > > > > > conf.put(Config.NIMBUS_HOST, >> >> > > "publicIpOfJobmanagerInMyRemoteCluster"); >> >> > > > > > >> >> > > > > > Unfortunately for me when I run that program, I have a the >> >> > following >> >> > > > > > exception. >> >> > > > > > >> >> > > > > > org.apache.flink.client.program.ProgramInvocationException: >> The >> >> > main >> >> > > > > method >> >> > > > > > caused an error. >> >> > > > > > at >> >> > > > > > >> >> > > > > > >> >> > > > > >> >> > > > >> >> > > >> >> > >> >> >> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:520) >> >> > > > > > at >> >> > > > > > >> >> > > > > > >> >> > > > > >> >> > > > >> >> > > >> >> > >> >> >> org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:403) >> >> > > > > > at >> >> > > org.apache.flink.client.program.Client.runBlocking(Client.java:248) >> >> > > > > > at >> >> > > > > > >> >> > > > > > >> >> > > > > >> >> > > > >> >> > > >> >> > >> >> >> org.apache.flink.client.CliFrontend.executeProgramBlocking(CliFrontend.java:866) >> >> > > > > > at >> org.apache.flink.client.CliFrontend.run(CliFrontend.java:333) >> >> > > > > > at >> >> > > > > > >> >> > > > > >> >> > > > >> >> > > >> >> > >> >> >> org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:1189) >> >> > > > > > at >> >> org.apache.flink.client.CliFrontend.main(CliFrontend.java:1239) >> >> > > > > > Caused by: java.lang.RuntimeException: Could not connect to >> >> Flink >> >> > > > > > JobManager with address >> >> publicIpOfJobmanagerInMyRemoteCluster:6123 >> >> > > > > > at >> >> > > > > > >> >> > > > > > >> >> > > > > >> >> > > > >> >> > > >> >> > >> >> >> org.apache.flink.storm.api.FlinkClient.getTopologyJobId(FlinkClient.java:305) >> >> > > > > > at >> >> > > > > > >> >> > > > > > >> >> > > > > >> >> > > > >> >> > > >> >> > >> >> >> org.apache.flink.storm.api.FlinkClient.submitTopologyWithOpts(FlinkClient.java:177) >> >> > > > > > at >> >> > > > > > >> >> > > > > >> >> > > > >> >> > > >> >> > >> >> >> org.apache.flink.storm.api.FlinkClient.submitTopology(FlinkClient.java:167) >> >> > > > > > at >> >> > > > > > >> >> > > > > > >> >> > > > > >> >> > > > >> >> > > >> >> > >> >> >> stormWorldCount.WordCountRemoteByClient.main(WordCountRemoteByClient.java:72) >> >> > > > > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native >> Method) >> >> > > > > > at >> >> > > > > > >> >> > > > > > >> >> > > > > >> >> > > > >> >> > > >> >> > >> >> >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) >> >> > > > > > at >> >> > > > > > >> >> > > > > > >> >> > > > > >> >> > > > >> >> > > >> >> > >> >> >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> >> > > > > > at java.lang.reflect.Method.invoke(Method.java:483) >> >> > > > > > at >> >> > > > > > >> >> > > > > > >> >> > > > > >> >> > > > >> >> > > >> >> > >> >> >> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:505) >> >> > > > > > ... 6 more >> >> > > > > > Caused by: java.io.IOException: Actor at akka.tcp://flink@ >> >> > > > > > publicIpOfJobmanagerInMyRemoteCluster:6123/user/jobmanager >> not >> >> > > > reachable. >> >> > > > > > Please make sure that the actor is running and its port is >> >> > reachable. >> >> > > > > > at >> >> > > > > > >> >> > > > >> >> > >> >> >> org.apache.flink.runtime.akka.AkkaUtils$.getActorRef(AkkaUtils.scala:384) >> >> > > > > > at >> >> > > > > > >> >> > > > > > >> >> > > > > >> >> > > > >> >> > > >> >> > >> >> >> org.apache.flink.runtime.jobmanager.JobManager$.getJobManagerActorRef(JobManager.scala:2380) >> >> > > > > > at >> >> > > > > > >> >> > > > > > >> >> > > > > >> >> > > > >> >> > > >> >> > >> >> >> org.apache.flink.runtime.jobmanager.JobManager$.getJobManagerActorRef(JobManager.scala:2400) >> >> > > > > > at >> >> > > > > > >> >> > > > > > >> >> > > > > >> >> > > > >> >> > > >> >> > >> >> >> org.apache.flink.runtime.jobmanager.JobManager.getJobManagerActorRef(JobManager.scala) >> >> > > > > > at >> >> > > > > > >> >> > > > > >> >> > > > >> >> > > >> >> > >> >> >> org.apache.flink.storm.api.FlinkClient.getJobManager(FlinkClient.java:333) >> >> > > > > > at >> >> > > > > > >> >> > > > > > >> >> > > > > >> >> > > > >> >> > > >> >> > >> >> >> org.apache.flink.storm.api.FlinkClient.getTopologyJobId(FlinkClient.java:279) >> >> > > > > > ... 14 more >> >> > > > > > Caused by: java.util.concurrent.TimeoutException: Futures >> timed >> >> out >> >> > > > after >> >> > > > > > [10000 milliseconds] >> >> > > > > > at >> >> > > > >> >> scala.concurrent.impl.Promise$DefaultPromise.ready(Promise.scala:219) >> >> > > > > > at >> >> > > > >> >> scala.concurrent.impl.Promise$DefaultPromise.result(Promise.scala:223) >> >> > > > > > at >> >> > scala.concurrent.Await$$anonfun$result$1.apply(package.scala:107) >> >> > > > > > at >> >> > > > > > >> >> > > > > > >> >> > > > > >> >> > > > >> >> > > >> >> > >> >> >> scala.concurrent.BlockContext$DefaultBlockContext$.blockOn(BlockContext.scala:53) >> >> > > > > > at scala.concurrent.Await$.result(package.scala:107) >> >> > > > > > at >> >> > > > > > >> >> > > > >> >> > >> >> >> org.apache.flink.runtime.akka.AkkaUtils$.getActorRef(AkkaUtils.scala:380) >> >> > > > > > ... 19 more >> >> > > > > > >> >> > > > > > I try ping my jobmanager with >> >> > > > > > curl publicIpOfJobmanagerInMyRemoteCluster:6123 I had the >> >> following >> >> > > as >> >> > > > > > responces. >> >> > > > > > >> >> > > > > > curl: (52) Empty reply from server >> >> > > > > > >> >> > > > > > Which is an indication that the job manager is reachable. >> >> > > > > > >> >> > > > > > So I was wondering if I doing it the right way. Please any >> help >> >> > will >> >> > > be >> >> > > > > > welcoming. >> >> > > > > > >> >> > > > > > Thanks, >> >> > > > > > Ned >> >> > > > > > >> >> > > > > >> >> > > > >> >> > > >> >> > >> >> >> > >> > >> > >