The relevant bit from our vagrant provisioning script is here: https://github.com/apache/incubator-aurora/blob/599a7dcbe11a49f15d082882781e812a092e959d/examples/vagrant/provision-dev-cluster.sh#L37-L42
Unfortunately, the mesos RPM/debs don't include python libraries, so we need to install those out of band :-/ -=Bill On Thu, Oct 16, 2014 at 9:31 AM, Zameer Manji <zma...@twopensource.com> wrote: > You need to grab and use the eggs listed here > https://mesosphere.com/downloads/ > > On Thu, Oct 16, 2014 at 9:20 AM, Joe Stein <joe.st...@stealth.ly> wrote: > > > I am getting the following error trying to build executor. I have mesos > > 0.20.1 (below seems like it is looking for 0.20.0 maybe that is problem > not > > sure if so and how to fix???) > > > > /opt/apache/incubator-aurora$aurorabuild executor > > Build operating on top level addresses: > > > > > set([BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/bin/BUILD, > > gc_executor)]) > > Building PythonBinary > > > > > PythonBinary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/bin/BUILD, > > gc_executor)): > > Problem executing PythonBuilder for targets > > > > > OrderedSet([PythonBinary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/bin/BUILD, > > gc_executor)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/common/BUILD, > > path)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/BUILD, > > executor_detector)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/BUILD, > > executor_vars)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/BUILD, > > gc_executor)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/BUILD, > > executor_base)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/common/BUILD, > > ckpt)), > > > > > PythonThriftLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/thrift/org/apache/thermos/BUILD, > > py-thrift)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/core/BUILD, > > helper)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/core/BUILD, > > inspector)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/core/BUILD, > > muxer)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/monitoring/BUILD, > > detector)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/monitoring/BUILD, > > garbage)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/config/BUILD, > > schema)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/config/schema/BUILD, > > schema)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/config/BUILD, > > schema)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/common/BUILD, > > planner)), > > > > > PythonThriftLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/thrift/org/apache/aurora/gen/BUILD, > > py-thrift)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/common/BUILD, > > sandbox))]): Traceback (most recent call last): > > File > > > > > "/root/.pex/install/pantsbuild.pants-0.0.24-py2-none-any.whl.cb55b0a8565dea1e6135f0c1310fb6b325e58091/pantsbuild.pants-0.0.24-py2-none-any.whl/pants/backend/python/commands/build.py", > > line 130, in _python_build > > debug=self._verbose) > > File > > > > > "/root/.pex/install/pantsbuild.pants-0.0.24-py2-none-any.whl.cb55b0a8565dea1e6135f0c1310fb6b325e58091/pantsbuild.pants-0.0.24-py2-none-any.whl/pants/backend/python/python_builder.py", > > line 52, in build > > conn_timeout=conn_timeout).run() > > File > > > > > "/root/.pex/install/pantsbuild.pants-0.0.24-py2-none-any.whl.cb55b0a8565dea1e6135f0c1310fb6b325e58091/pantsbuild.pants-0.0.24-py2-none-any.whl/pants/backend/python/binary_builder.py", > > line 53, in run > > env = self.chroot.dump() > > File > > > > > "/root/.pex/install/pantsbuild.pants-0.0.24-py2-none-any.whl.cb55b0a8565dea1e6135f0c1310fb6b325e58091/pantsbuild.pants-0.0.24-py2-none-any.whl/pants/backend/python/python_chroot.py", > > line 191, in dump > > conn_timeout=self._conn_timeout) > > File > > > > > "/root/.pex/install/pantsbuild.pants-0.0.24-py2-none-any.whl.cb55b0a8565dea1e6135f0c1310fb6b325e58091/pantsbuild.pants-0.0.24-py2-none-any.whl/pants/backend/python/resolver.py", > > line 100, in resolve_multi > > platform=platform) > > File > > > > > "/root/.pex/install/pex-0.7.0-py2.py3-none-any.whl.1528dd6e325a4178651c50d45cba558709e6df75/pex-0.7.0-py2.py3-none-any.whl/pex/resolver.py", > > line 101, in resolve > > raise Unsatisfiable('Cannot satisfy requirements: %s' % > > requirement_set[requirement.key]) > > Unsatisfiable: Cannot satisfy requirements: > > [PythonRequirement(mesos.native==0.20.0)] > > > > > > Usage: > > pantsbuild.pants-0.0.24.pex build (options) [spec] (build args) > > pantsbuild.pants-0.0.24.pex build (options) [spec]... -- (build args) > > > > Options: > > --version show program's version number and exit > > --no-pantsrc Specifies that pantsrc files should be ignored. > > --log-exit Log an exit message on success or failure. > > -t CONN_TIMEOUT, --timeout=CONN_TIMEOUT > > Number of seconds to wait for http connections. > > -i INTERPRETERS, --interpreter=INTERPRETERS > > Constrain what Python interpreters to use. Uses > > Requirement format from pkg_resources, e.g. > > 'CPython>=2.6,<3' or 'PyPy'. By default, no > > constraints are used. Multiple constraints may > be > > added. They will be ORed together. > > -v, --verbose Show verbose output. > > -f, --fast Run tests in a single chroot. > > > > Builds the specified Python target(s). Use ./pants goal for JVM and other > > targets. > > Build operating on top level addresses: > > > > > set([BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/bin/BUILD, > > thermos_executor)]) > > Building PythonBinary > > > > > PythonBinary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/bin/BUILD, > > thermos_executor)): > > Problem executing PythonBuilder for targets > > > > > OrderedSet([PythonBinary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/bin/BUILD, > > thermos_executor)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/common/BUILD, > > announcer)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/common/BUILD, > > status_checker)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/common/BUILD, > > task_info)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/config/BUILD, > > config)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/common/BUILD, > > common)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/common/BUILD, > > aurora_job_key)), > > > > > PythonThriftLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/thrift/org/apache/aurora/gen/BUILD, > > py-thrift)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/common/BUILD, > > cluster)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/common/BUILD, > > cluster_option)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/common/BUILD, > > clusters)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/common/BUILD, > > http_signaler)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/common/BUILD, > > shellify)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/common/BUILD, > > transport)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/common/auth/BUILD, > > auth)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/thrift/org/apache/aurora/gen/BUILD, > > py-thrift-packaged)), > > > > > PythonThriftLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/thrift/org/apache/aurora/gen/BUILD, > > py-thrift-test)), > > > > > PythonThriftLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/thrift/org/apache/aurora/gen/BUILD, > > py-thrift-storage)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/config/schema/BUILD, > > schema)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/config/BUILD, > > schema)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/common/BUILD, > > planner)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/common/BUILD, > > executor_timeout)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/common/BUILD, > > health_checker)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/common/BUILD, > > sandbox)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/BUILD, > > executor_detector)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/BUILD, > > executor_vars)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/BUILD, > > aurora_executor)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/BUILD, > > status_manager)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/BUILD, > > executor_base)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/common/BUILD, > > kill_manager)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/common/BUILD, > > task_runner)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/BUILD, > > thermos_task_runner)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/common/BUILD, > > common)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/common/BUILD, > > ckpt)), > > > > > PythonThriftLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/thrift/org/apache/thermos/BUILD, > > py-thrift)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/common/BUILD, > > options)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/common/BUILD, > > path)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/core/BUILD, > > core)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/core/BUILD, > > inspector)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/core/BUILD, > > muxer)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/core/BUILD, > > runner)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/core/BUILD, > > helper)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/core/BUILD, > > process)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/config/BUILD, > > config)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/thermos/monitoring/BUILD, > > monitor)), > > > > > PythonLibrary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/BUILD, > > thermos_statuses))]): Traceback (most recent call last): > > File > > > > > "/root/.pex/install/pantsbuild.pants-0.0.24-py2-none-any.whl.cb55b0a8565dea1e6135f0c1310fb6b325e58091/pantsbuild.pants-0.0.24-py2-none-any.whl/pants/backend/python/commands/build.py", > > line 130, in _python_build > > debug=self._verbose) > > File > > > > > "/root/.pex/install/pantsbuild.pants-0.0.24-py2-none-any.whl.cb55b0a8565dea1e6135f0c1310fb6b325e58091/pantsbuild.pants-0.0.24-py2-none-any.whl/pants/backend/python/python_builder.py", > > line 52, in build > > conn_timeout=conn_timeout).run() > > File > > > > > "/root/.pex/install/pantsbuild.pants-0.0.24-py2-none-any.whl.cb55b0a8565dea1e6135f0c1310fb6b325e58091/pantsbuild.pants-0.0.24-py2-none-any.whl/pants/backend/python/binary_builder.py", > > line 53, in run > > env = self.chroot.dump() > > File > > > > > "/root/.pex/install/pantsbuild.pants-0.0.24-py2-none-any.whl.cb55b0a8565dea1e6135f0c1310fb6b325e58091/pantsbuild.pants-0.0.24-py2-none-any.whl/pants/backend/python/python_chroot.py", > > line 191, in dump > > conn_timeout=self._conn_timeout) > > File > > > > > "/root/.pex/install/pantsbuild.pants-0.0.24-py2-none-any.whl.cb55b0a8565dea1e6135f0c1310fb6b325e58091/pantsbuild.pants-0.0.24-py2-none-any.whl/pants/backend/python/resolver.py", > > line 100, in resolve_multi > > platform=platform) > > File > > > > > "/root/.pex/install/pex-0.7.0-py2.py3-none-any.whl.1528dd6e325a4178651c50d45cba558709e6df75/pex-0.7.0-py2.py3-none-any.whl/pex/resolver.py", > > line 101, in resolve > > raise Unsatisfiable('Cannot satisfy requirements: %s' % > > requirement_set[requirement.key]) > > Unsatisfiable: Cannot satisfy requirements: > > [PythonRequirement(mesos.native==0.20.0)] > > > > > > Usage: > > pantsbuild.pants-0.0.24.pex build (options) [spec] (build args) > > pantsbuild.pants-0.0.24.pex build (options) [spec]... -- (build args) > > > > Options: > > --version show program's version number and exit > > --no-pantsrc Specifies that pantsrc files should be ignored. > > --log-exit Log an exit message on success or failure. > > -t CONN_TIMEOUT, --timeout=CONN_TIMEOUT > > Number of seconds to wait for http connections. > > -i INTERPRETERS, --interpreter=INTERPRETERS > > Constrain what Python interpreters to use. Uses > > Requirement format from pkg_resources, e.g. > > 'CPython>=2.6,<3' or 'PyPy'. By default, no > > constraints are used. Multiple constraints may > be > > added. They will be ORed together. > > -v, --verbose Show verbose output. > > -f, --fast Run tests in a single chroot. > > > > Builds the specified Python target(s). Use ./pants goal for JVM and other > > targets. > > Build operating on top level addresses: > > > > > set([BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/bin/BUILD, > > thermos_runner)]) > > Building PythonBinary > > > > > PythonBinary(BuildFileAddress(/mnt/data1/apache/incubator-aurora/src/main/python/apache/aurora/executor/bin/BUILD, > > thermos_runner)): > > Wrote /mnt/data1/apache/incubator-aurora/dist/thermos_runner.pex > > <stdin>:4: UserWarning: Duplicate name: > > 'apache/aurora/executor/resources/__init__.py' > > <stdin>:5: UserWarning: Duplicate name: > > 'apache/aurora/executor/resources/thermos_runner.pex' > > > > /******************************************* > > Joe Stein > > Founder, Principal Consultant > > Big Data Open Source Security LLC > > http://www.stealth.ly > > Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop> > > ********************************************/ > > > > > > -- > Zameer Manji >
