Github user ankurcha commented on the pull request: https://github.com/apache/flink/pull/948#issuecomment-142825340 Hi @rmetzger, This completely got buried in scheduler but i think i have finally worked out the kinks. Thanks for spending the time to try it out. I think we are closer to having this out of the door so have a go at it and let me know if you see something off. ```bash vagrant@mesos:/vagrant$ java -Dlog4j.configuration=file:/vagrant/log4j.properties -cp *.jar org.apache.flink.mesos.scheduler.FlinkScheduler --confDir /vagrant --port 10080 INFO 2015-09-24 06:22:04,584 [main] FlinkScheduler$: -------------------------------------------------------------------------------- INFO 2015-09-24 06:22:04,585 [main] FlinkScheduler$: Starting JobManager (Version: 0.10-SNAPSHOT, Rev:bc21de2, Date:23.09.2015 @ 20:06:33 UTC) INFO 2015-09-24 06:22:04,585 [main] FlinkScheduler$: Current user: vagrant INFO 2015-09-24 06:22:04,585 [main] FlinkScheduler$: JVM: OpenJDK 64-Bit Server VM - Oracle Corporation - 1.7/24.79-b02 INFO 2015-09-24 06:22:04,585 [main] FlinkScheduler$: Maximum heap size: 592 MiBytes INFO 2015-09-24 06:22:04,585 [main] FlinkScheduler$: JAVA_HOME: (not set) INFO 2015-09-24 06:22:04,588 [main] FlinkScheduler$: Hadoop version: 2.3.0 INFO 2015-09-24 06:22:04,588 [main] FlinkScheduler$: JVM Options: INFO 2015-09-24 06:22:04,588 [main] FlinkScheduler$: -Dlog4j.configuration=file:/vagrant/log4j.properties INFO 2015-09-24 06:22:04,588 [main] FlinkScheduler$: Program Arguments: INFO 2015-09-24 06:22:04,588 [main] FlinkScheduler$: --confDir INFO 2015-09-24 06:22:04,588 [main] FlinkScheduler$: /vagrant INFO 2015-09-24 06:22:04,588 [main] FlinkScheduler$: --port INFO 2015-09-24 06:22:04,589 [main] FlinkScheduler$: 10080 INFO 2015-09-24 06:22:04,589 [main] FlinkScheduler$: -------------------------------------------------------------------------------- INFO 2015-09-24 06:22:04,595 [main] FlinkScheduler$: Maximum number of open file descriptors is 4096 INFO 2015-09-24 06:22:04,596 [main] FlinkScheduler$: Loading configuration from /vagrant DEBUG 2015-09-24 06:22:04,665 [main] FlinkScheduler$: Serving configuration via: Some(http://127.0.0.1:10080) INFO 2015-09-24 06:22:04,725 [Thread-3] JobManager: Starting JobManager INFO 2015-09-24 06:22:04,726 [Thread-3] JobManager: Starting JobManager actor system at :6123. I0924 06:22:04.812088 7312 sched.cpp:157] Version: 0.22.1 2015-09-24 06:22:04,815:7311(0x7fcaf8bbb700):ZOO_INFO@log_env@712: Client environment:zookeeper.version=zookeeper C client 3.4.5 2015-09-24 06:22:04,816:7311(0x7fcaf8bbb700):ZOO_INFO@log_env@716: Client environment:host.name=mesos 2015-09-24 06:22:04,818:7311(0x7fcaf8bbb700):ZOO_INFO@log_env@723: Client environment:os.name=Linux 2015-09-24 06:22:04,821:7311(0x7fcaf8bbb700):ZOO_INFO@log_env@724: Client environment:os.arch=3.16.0-30-generic 2015-09-24 06:22:04,822:7311(0x7fcaf8bbb700):ZOO_INFO@log_env@725: Client environment:os.version=#40~14.04.1-Ubuntu SMP Thu Jan 15 17:43:14 UTC 2015 2015-09-24 06:22:04,824:7311(0x7fcaf8bbb700):ZOO_INFO@log_env@733: Client environment:user.name=vagrant 2015-09-24 06:22:04,827:7311(0x7fcaf8bbb700):ZOO_INFO@log_env@741: Client environment:user.home=/home/vagrant 2015-09-24 06:22:04,829:7311(0x7fcaf8bbb700):ZOO_INFO@log_env@753: Client environment:user.dir=/vagrant 2015-09-24 06:22:04,830:7311(0x7fcaf8bbb700):ZOO_INFO@zookeeper_init@786: Initiating client connection, host=127.0.0.1:2181 sessionTimeout=10000 watcher=0x7fcb29b99a60 sessionId=0 sessionPasswd=<null> context=0x1c0f350 flags=0 2015-09-24 06:22:04,837:7311(0x7fcaf2ffd700):ZOO_INFO@check_events@1703: initiated connection to server [127.0.0.1:2181] 2015-09-24 06:22:04,839:7311(0x7fcaf2ffd700):ZOO_INFO@check_events@1750: session establishment complete on server [127.0.0.1:2181], sessionId=0x14ffdcf98d00015, negotiated timeout=10000 I0924 06:22:04.840190 7333 group.cpp:313] Group process (group(1)@127.0.1.1:36068) connected to ZooKeeper I0924 06:22:04.840239 7333 group.cpp:790] Syncing group operations: queue size (joins, cancels, datas) = (0, 0, 0) I0924 06:22:04.840265 7333 group.cpp:385] Trying to create path '/mesos' in ZooKeeper I0924 06:22:04.843736 7333 detector.cpp:138] Detected a new leader: (id='0') I0924 06:22:04.843868 7331 group.cpp:659] Trying to get '/mesos/info_0000000000' in ZooKeeper I0924 06:22:04.844832 7331 detector.cpp:452] A new leading master (UPID=master@127.0.1.1:5050) is detected I0924 06:22:04.844923 7331 sched.cpp:254] New master detected at master@127.0.1.1:5050 I0924 06:22:04.845263 7331 sched.cpp:264] No credentials provided. Attempting to register without authentication I0924 06:22:04.847537 7331 sched.cpp:448] Framework registered with 20150924-052444-16842879-5050-1219-0012 INFO 2015-09-24 06:22:04,872 [Thread-2] log: jetty-0.10-SNAPSHOT INFO 2015-09-24 06:22:04,948 [Thread-2] log: Started SocketConnector@127.0.0.1:10080 Embedded server listening at http://127.0.0.1:10080 Press any key to stop. INFO 2015-09-24 06:22:05,194 [Thread-5] FlinkScheduler$: Accepting INFO 2015-09-24 06:22:05,951 [flink-akka.actor.default-dispatcher-4] Slf4jLogger: Slf4jLogger started INFO 2015-09-24 06:22:06,243 [flink-akka.actor.default-dispatcher-4] Remoting: Starting remoting INFO 2015-09-24 06:22:06,536 [flink-akka.actor.default-dispatcher-4] Remoting: Remoting started; listening on addresses :[akka.tcp://flink@127.0.0.1:6123] INFO 2015-09-24 06:22:06,549 [Thread-3] JobManager: Starting JobManager actor INFO 2015-09-24 06:22:06,559 [Thread-3] BlobServer: Created BLOB server storage directory /tmp/blobStore-b226277a-1f52-47ad-b3a5-c981cc67cb02 INFO 2015-09-24 06:22:06,560 [Thread-3] BlobServer: Started BLOB server at 0.0.0.0:50466 - max concurrent requests: 50 - max backlog: 1000 INFO 2015-09-24 06:22:06,588 [flink-akka.actor.default-dispatcher-4] MemoryArchivist: Started memory archivist akka://flink/user/archive INFO 2015-09-24 06:22:06,595 [flink-akka.actor.default-dispatcher-2] JobManager: Starting JobManager at akka.tcp://flink@127.0.0.1:6123/user/jobmanager. INFO 2015-09-24 06:22:06,623 [flink-akka.actor.default-dispatcher-2] JobManager: JobManager akka.tcp://flink@127.0.0.1:6123/user/jobmanager was granted leadership with leader session ID None. INFO 2015-09-24 06:22:06,638 [Thread-3] JobManager: Starting JobManger web frontend INFO 2015-09-24 06:22:06,640 [Thread-3] WebInfoServer: Setting up web info server, using web-root directory jar:file:/vagrant/flink-dist-0.10-SNAPSHOT.jar!/web-docs-infoserver. INFO 2015-09-24 06:22:06,650 [Thread-3] log: jetty-0.10-SNAPSHOT INFO 2015-09-24 06:22:06,656 [Thread-3] log: Started SelectChannelConnector@0.0.0.0:8081 INFO 2015-09-24 06:22:06,656 [Thread-3] WebInfoServer: Started web info server for JobManager on 0.0.0.0:8081 INFO 2015-09-24 06:22:06,978 [Thread-27] FlinkScheduler$: statusUpdate received from taskId: TaskManager_1 slaveId: 20150924-052444-16842879-5050-1219-S0 [TASK_RUNNING] DEBUG 2015-09-24 06:22:06,979 [Thread-27] FlinkScheduler$: No action to take for statusUpdate TASK_RUNNING INFO 2015-09-24 06:22:10,768 [Thread-28] FlinkScheduler$: Declining offer(s) from slave 20150924-052444-16842879-5050-1219-S0 offered [cpus: 1.5 | mem : 488.0 | disk: 33044.0] required [cpus: 0.5 | mem: 512.0 | disk: 1024.0] ```
--- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---