Hi! Is it possible that the docker container config forbids to open ports? Flink will try to open some ports and needs the OS or container to permit that.
Greetings, Stephan On Thu, Mar 10, 2016 at 6:27 PM, Deepak Jha <dkjhan...@gmail.com> wrote: > Hi Stephan, > I tried 0.10.2 as well still running into the same issue. > > On Thursday, March 10, 2016, Deepak Jha <dkjhan...@gmail.com> wrote: > > > Yes. Flink 1.0.0 > > > > On Thursday, March 10, 2016, Stephan Ewen <se...@apache.org > > <javascript:_e(%7B%7D,'cvml','se...@apache.org');>> wrote: > > > >> Hi! > >> > >> Is this Flink 1.0.0 ? > >> > >> Stephan > >> > >> > >> On Thu, Mar 10, 2016 at 6:02 AM, Deepak Jha <dkjhan...@gmail.com> > wrote: > >> > >> > Hi All, > >> > > >> > I'm trying to setup Flink 1.0.0 cluster on Docker (separate containers > >> for > >> > jobmanager and taskmanager) inside AWS (Using AWS ECS service). I > >> tested it > >> > locally and its working fine but on AWS Docker, I am running into > >> following > >> > issue > >> > > >> > *2016-03-09 18:04:12,114 PST [INFO] ec2-52-3-248-202.compute-1.ama > >> [main] > >> > o.a.f.runtime.jobmanager.JobManager - Starting JobManager with > >> > high-availability* > >> > *2016-03-09 18:04:12,118 PST [INFO] ec2-52-3-248-202.compute-1.ama > >> [main] > >> > o.a.f.runtime.jobmanager.JobManager - Starting JobManager on > >> > 172.31.63.152:8079 <http://172.31.63.152:8079> with execution mode > >> CLUSTER* > >> > *2016-03-09 18:04:12,172 PST [INFO] ec2-52-3-248-202.compute-1.ama > >> [main] > >> > o.a.f.runtime.jobmanager.JobManager - Security is not enabled. > Starting > >> > non-authenticated JobManager.* > >> > *2016-03-09 18:04:12,174 PST [DEBUG] ec2-52-3-248-202.compute-1.ama > >> [main] > >> > org.apache.flink.util.NetUtils - Trying to open socket on port 8079* > >> > *2016-03-09 18:04:12,176 PST [DEBUG] ec2-52-3-248-202.compute-1.ama > >> [main] > >> > org.apache.flink.util.NetUtils - Unable to allocate socket on port* > >> > *java.net.BindException: Cannot assign requested address* > >> > * at java.net.PlainSocketImpl.socketBind(Native Method)* > >> > * at > >> > > java.net.AbstractPlainSocketImpl.bind(AbstractPlainSocketImpl.java:387)* > >> > * at java.net.ServerSocket.bind(ServerSocket.java:375)* > >> > * at java.net.ServerSocket.<init>(ServerSocket.java:237)* > >> > * at > >> > > >> > org.apache.flink.runtime.jobmanager.JobManager$$anonfun$2$$anon$3.createSocket(JobManager.scala:1722)* > >> > * at > >> > > org.apache.flink.util.NetUtils.createSocketFromPorts(NetUtils.java:237)* > >> > * at > >> > > >> > org.apache.flink.runtime.jobmanager.JobManager$$anonfun$2.apply$mcV$sp(JobManager.scala:1719)* > >> > * at > >> > > >> > org.apache.flink.runtime.jobmanager.JobManager$$anonfun$2.apply(JobManager.scala:1717)* > >> > * at > >> > > >> > org.apache.flink.runtime.jobmanager.JobManager$$anonfun$2.apply(JobManager.scala:1717)* > >> > * at scala.util.Try$.apply(Try.scala:192)* > >> > * at > >> > > >> > org.apache.flink.runtime.jobmanager.JobManager$.retryOnBindException(JobManager.scala:1772)* > >> > * at > >> > > >> > org.apache.flink.runtime.jobmanager.JobManager$.runJobManager(JobManager.scala:1717)* > >> > * at > >> > > >> > org.apache.flink.runtime.jobmanager.JobManager$.main(JobManager.scala:1653)* > >> > * at > >> > org.apache.flink.runtime.jobmanager.JobManager.main(JobManager.scala)* > >> > *2016-03-09 18:04:12,180 PST [ERROR] ec2-52-3-248-202.compute-1.ama > >> [main] > >> > o.a.f.runtime.jobmanager.JobManager - Failed to run JobManager.* > >> > *java.lang.RuntimeException: Unable to do further retries starting the > >> > actor system* > >> > * at > >> > > >> > org.apache.flink.runtime.jobmanager.JobManager$.retryOnBindException(JobManager.scala:1777)* > >> > * at > >> > > >> > org.apache.flink.runtime.jobmanager.JobManager$.runJobManager(JobManager.scala:1717)* > >> > * at > >> > > >> > org.apache.flink.runtime.jobmanager.JobManager$.main(JobManager.scala:1653)* > >> > * at > >> > org.apache.flink.runtime.jobmanager.JobManager.main(JobManager.scala)* > >> > *2016-03-09 18:04:12,991 PST [DEBUG] ec2-52-3-248-202.compute-1.ama > >> [main] > >> > o.a.h.m.lib.MutableMetricsFactory - field > >> > org.apache.hadoop.metrics2.lib.MutableRate > >> > > org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginSuccess > >> > with annotation @org.apache.hadoop.metrics2.annotation.Metric(about=, > >> > sampleName=Ops, always=false, type=DEFAULT, value=[Rate of successful > >> > kerberos logins and latency (milliseconds)], valueName=Time)* > >> > > >> > > >> > Initially Jobmanager tries to bind to port 0 which did not work. On > >> > looking further into it, I tried using recovery jobmanager port using > >> > different port combinations, but it does not seems to be working... > I've > >> > exposed the ports in the docker compose file as well.... > >> > > >> > > >> > PFA the jobmanager log file for details also the jobmanager config > >> file... > >> > -- > >> > Thanks, > >> > Deepak Jha > >> > > >> > > >> > > > > > > -- > > Sent from Gmail Mobile > > > > > -- > Sent from Gmail Mobile >
