RE: Unable to change job manager port when launching session cluster on Docker

[Papadopoulos, Konstantinos]

Hi Aleksey,

I tried using "8081:5000" as port binding configuration with no success. I also 
tried different port numbers (i.e,. other than 5000) to bind, but admin seems 
not to launch.
Is there any easy way to change flink-conf.yaml or pass additional command line 
argument keeping the docker-compose approach? Or alternatively, should I pull 
the image, create the container and modify the respective configuration after 
connecting to it?

Regards,
Konstantinos

From: Aleksey Pak <alek...@ververica.com>
Sent: Friday, October 18, 2019 10:46 PM
To: Papadopoulos, Konstantinos <konstantinos.papadopou...@iriworldwide.com>
Cc: user@flink.apache.org
Subject: Re: Unable to change job manager port when launching session cluster 
on Docker

Hi Konstantinos,

Can you try using "8081:5000" as port binding configuration?
This should bind container's 8081 port to 5000 port on host.
If you want to use 5000 port as JobManager's port in the *container*, you would 
need to change flink-conf.yaml or pass additional command line argument (to 
override the corresponding config option).

Regards,
Aleksey

On Fri, Oct 18, 2019 at 2:55 PM Papadopoulos, Konstantinos 
<konstantinos.papadopou...@iriworldwide.com<mailto:konstantinos.papadopou...@iriworldwide.com>>
 wrote:
Hello all,

I am trying to launch an Apache Flink session cluster on Docker using Docker 
Compose and following the respective tutorial:
https://ci.apache.org/projects/flink/flink-docs-stable/ops/deployment/docker.html#flink-with-docker-compose<https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fci.apache.org%2Fprojects%2Fflink%2Fflink-docs-stable%2Fops%2Fdeployment%2Fdocker.html%23flink-with-docker-compose&data=02%7C01%7C%7C9df2eb6860b542c70ffc08d75403d6d4%7C43728c2044474b27ac2e4bdabb3c0121%7C0%7C1%7C637070247780922430&sdata=1aPGVtqJugXdTZNwVyIc6JtXiHYZoFyvUY7QEQLacOI%3D&reserved=0>
The default job manager port (i.e., 8081) is in use on my host so the cluster 
fails to launch.
I tried to change the configuration from the respective service definition on 
docker-compose.yml (e.g., services -> jobmanager -> ports: "5000:5000") with no 
success; job manager container seems to launch on the default port.
Can anybody help me to proceed with this?

Thanks in advance,
Konstantinos

P.S.: My docker-compose.yml is the following:

version: "2.1"
services:
  jobmanager:
    image: ${FLINK_DOCKER_IMAGE_NAME:-flink}
    expose:
      - "6123"
    ports:
      - "5000:5000"
    command: jobmanager
    environment:
      - JOB_MANAGER_RPC_ADDRESS=jobmanager

  taskmanager:
    image: ${FLINK_DOCKER_IMAGE_NAME:-flink}
    expose:
      - "6121"
      - "6122"
    depends_on:
      - jobmanager
    command: taskmanager
    links:
      - "jobmanager:jobmanager"
    environment:
      - JOB_MANAGER_RPC_ADDRESS=jobmanager