Running MesosClusterDispatcher through marathon with bridged mode

2016-03-10 Thread Eran Chinthaka Withana
Hi I was able to run MesosClusterDispatcher, through marathon, using docker host networking. It registers with mesos and can submit jobs without any issues. But when I tried to make MesosClusterDispatcher run with bridged networking mode, it never registers with mesos. I exposed ports 8081 and 707

Re: Problem mixing MESOS Cluster Mode and Docker task execution

2016-03-10 Thread Eran Chinthaka Withana
er in mesos through marathon. Thanks, Eran Chinthaka Withana On Thu, Mar 10, 2016 at 11:11 AM, yanlin wang wrote: > How you guys make driver docker within container to be reachable from > spark worker ? > > Would you share your driver docker? i am trying to put only driver in >

Re: Problem mixing MESOS Cluster Mode and Docker task execution

2016-03-10 Thread Eran Chinthaka Withana
n. Thanks, Eran Chinthaka Withana On Thu, Mar 10, 2016 at 10:10 AM, Tim Chen wrote: > Hi Eran, > > I need to investigate but perhaps that's true, we're using SPARK_JAVA_OPTS > to pass all the options and not --conf. > > I'll take a look at the bug, but if you can try

Re: Problem mixing MESOS Cluster Mode and Docker task execution

2016-03-10 Thread Eran Chinthaka Withana
Hi Timothy What version of spark are you guys running? > I'm using Spark 1.6.0. You can see the Dockerfile I used here: https://github.com/echinthaka/spark-mesos-docker/blob/master/docker/mesos-spark/Dockerfile > And also did you set the working dir in your image to be spark home? > Yes I did

Re: Problem mixing MESOS Cluster Mode and Docker task execution

2016-03-09 Thread Eran Chinthaka Withana
ince https://issues.apache.org/jira/browse/SPARK-12345 is marked as resolved) Really appreciate if I can get some help here. Thanks, Eran Chinthaka Withana On Wed, Feb 17, 2016 at 2:00 PM, g.eynard.bonte...@gmail.com < g.eynard.bonte...@gmail.com> wrote: > Hi everybody, > > I am test