Yep, and the pex http code on master has been refactored substantially recently to make this quite a lot easier to do. Mind filing an issue on pantsbuild/pex to get this implemented?
On Thu, Oct 9, 2014 at 11:48 AM, Zameer Manji <zma...@twopensource.com> wrote: > I think to fix this problem we might need to get pex to do HTTP retries. > > On Thu, Oct 9, 2014 at 11:43 AM, Apache Jenkins Server < > jenk...@builds.apache.org> wrote: > > > See <https://builds.apache.org/job/Aurora/636/changes> > > > > Changes: > > > > [maxim] Fixing quota checking for updates. > > > > ------------------------------------------ > > Started by an SCM change > > Building remotely on ubuntu-5 (docker Ubuntu ubuntu5 ubuntu) in > workspace < > > https://builds.apache.org/job/Aurora/ws/> > > Wiping out workspace first. > > Cloning the remote Git repository > > Cloning repository > > https://git-wip-us.apache.org/repos/asf/incubator-aurora.git > > > git init <https://builds.apache.org/job/Aurora/ws/> > > Fetching upstream changes from > > https://git-wip-us.apache.org/repos/asf/incubator-aurora.git > > > git --version > > > git fetch --tags --progress > > https://git-wip-us.apache.org/repos/asf/incubator-aurora.git > > +refs/heads/*:refs/remotes/origin/* > > > git config remote.origin.url > > https://git-wip-us.apache.org/repos/asf/incubator-aurora.git > > > git config remote.origin.fetch +refs/heads/*:refs/remotes/origin/* > > > git config remote.origin.url > > https://git-wip-us.apache.org/repos/asf/incubator-aurora.git > > Fetching upstream changes from > > https://git-wip-us.apache.org/repos/asf/incubator-aurora.git > > > git fetch --tags --progress > > https://git-wip-us.apache.org/repos/asf/incubator-aurora.git > > +refs/heads/*:refs/remotes/origin/* > > > git rev-parse origin/master^{commit} > > Checking out Revision 7bc791cea1a7f26c9cb019225cecfc3a812e8121 > > (origin/master) > > > git config core.sparsecheckout > > > git checkout -f 7bc791cea1a7f26c9cb019225cecfc3a812e8121 > > > git rev-list 18ae90569b9a5fda44d0f7a9ea59e8eee916408b > > Cleaning workspace > > > git rev-parse --verify HEAD > > Resetting working tree > > > git reset --hard > > > git clean -fdx > > [Aurora] $ /bin/bash -xe /tmp/hudson4749902613838005785.sh > > + ./build-support/jenkins/build.sh > > + date > > Thu Oct 9 18:38:07 UTC 2014 > > + ./gradlew -Pq clean build --stacktrace > > :clean > > :bootstrapThriftsrc/thrift/transport/TFileTransport.cpp: In member > > function 'void > apache::thrift::transport::TFileTransport::writerThread()': > > src/thrift/transport/TFileTransport.cpp:317:30: warning: ignoring return > > value of 'int ftruncate(int, __off_t)', declared with attribute > > warn_unused_result [-Wunused-result] > > ftruncate(fd_, offset_); > > ^ > > src/Transport/THttpClient.cs(43,32): warning CS0414: The private field > > `Thrift.Transport.THttpClient.connection' is assigned but its value is > > never used > > > > :checkPython > > :generateSources > > :compileGeneratedJavaNote: Some input files use unchecked or unsafe > > operations. > > Note: Recompile with -Xlint:unchecked for details. > > > > :processGeneratedResources UP-TO-DATE > > :generatedClasses > > :compileJavaNote: Writing < > > > https://builds.apache.org/job/Aurora/ws/dist/classes/main/com/twitter/common/args/apt/cmdline.arg.info.txt.2 > > > > > > > :processResources > > :classes > > :jar > > :assemble > > :jsHint > > :checkstyleMain > > :compileTestJava > > :processTestResources > > :testClasses > > :checkstyleTest > > :findbugsGenerated > > :findbugsMain > > :findbugsTest > > :licenseGenerated UP-TO-DATE > > :licenseMain UP-TO-DATE > > :licenseTest UP-TO-DATE > > :license UP-TO-DATE > > :pmdMain > > :test > > :jacocoTestReport > > Coverage report generated: file://< > > > https://builds.apache.org/job/Aurora/ws/dist/reports/jacoco/test/html/index.html > > > > > :check > > :build > > > > BUILD SUCCESSFUL > > > > Total time: 5 mins 6.389 secs > > + ./pants build --timeout=60 src/test/python:all -vxs > > Building pants.pex @ 0.0.24 > > Bootstrapping twitter.common.python @ 0.5.9 > > + VIRTUALENV_VERSION=1.10.1 > > + which python2.7 > > ++ which python2.7 > > + PY=/usr/bin/python2.7 > > + echo 'Using /usr/bin/python2.7' > > Using /usr/bin/python2.7 > > +++ dirname < > > https://builds.apache.org/job/Aurora/ws/build-support/virtualenv> > > ++ cd <https://builds.apache.org/job/Aurora/ws/build-support> > > ++ pwd > > + HERE=<https://builds.apache.org/job/Aurora/ws/build-support> > > + '[' -f < > > > https://builds.apache.org/job/Aurora/ws/build-support/virtualenv-1.10.1/BOOTSTRAPPED > > > > ']' > > + pushd <https://builds.apache.org/job/Aurora/ws/build-support> > > ~/jenkins-slave/workspace/Aurora/build-support > > ~/jenkins-slave/workspace/Aurora > > + curl -O > > > https://pypi.python.org/packages/source/v/virtualenv/virtualenv-1.10.1.tar.gz > > % Total % Received % Xferd Average Speed Time Time Time > > Current > > Dload Upload Total Spent Left > > Speed > > > > 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- > > 0 > > 100 1294k 100 1294k 0 0 2297k 0 --:--:-- --:--:-- --:--:-- > > 2298k > > + tar zxvf virtualenv-1.10.1.tar.gz > > virtualenv-1.10.1/ > > virtualenv-1.10.1/AUTHORS.txt > > virtualenv-1.10.1/bin/ > > virtualenv-1.10.1/bin/rebuild-script.py > > virtualenv-1.10.1/docs/ > > virtualenv-1.10.1/docs/_theme/ > > virtualenv-1.10.1/docs/_theme/nature/ > > virtualenv-1.10.1/docs/_theme/nature/static/ > > virtualenv-1.10.1/docs/_theme/nature/static/nature.css_t > > virtualenv-1.10.1/docs/_theme/nature/static/pygments.css > > virtualenv-1.10.1/docs/_theme/nature/theme.conf > > virtualenv-1.10.1/docs/conf.py > > virtualenv-1.10.1/docs/index.rst > > virtualenv-1.10.1/docs/make.bat > > virtualenv-1.10.1/docs/Makefile > > virtualenv-1.10.1/docs/news.rst > > virtualenv-1.10.1/LICENSE.txt > > virtualenv-1.10.1/MANIFEST.in > > virtualenv-1.10.1/PKG-INFO > > virtualenv-1.10.1/README.rst > > virtualenv-1.10.1/scripts/ > > virtualenv-1.10.1/scripts/virtualenv > > virtualenv-1.10.1/setup.cfg > > virtualenv-1.10.1/setup.py > > virtualenv-1.10.1/virtualenv.egg-info/ > > virtualenv-1.10.1/virtualenv.egg-info/dependency_links.txt > > virtualenv-1.10.1/virtualenv.egg-info/entry_points.txt > > virtualenv-1.10.1/virtualenv.egg-info/not-zip-safe > > virtualenv-1.10.1/virtualenv.egg-info/PKG-INFO > > virtualenv-1.10.1/virtualenv.egg-info/SOURCES.txt > > virtualenv-1.10.1/virtualenv.egg-info/top_level.txt > > virtualenv-1.10.1/virtualenv.py > > virtualenv-1.10.1/virtualenv_embedded/ > > virtualenv-1.10.1/virtualenv_embedded/activate.bat > > virtualenv-1.10.1/virtualenv_embedded/activate.csh > > virtualenv-1.10.1/virtualenv_embedded/activate.fish > > virtualenv-1.10.1/virtualenv_embedded/activate.ps1 > > virtualenv-1.10.1/virtualenv_embedded/activate.sh > > virtualenv-1.10.1/virtualenv_embedded/activate_this.py > > virtualenv-1.10.1/virtualenv_embedded/deactivate.bat > > virtualenv-1.10.1/virtualenv_embedded/distutils-init.py > > virtualenv-1.10.1/virtualenv_embedded/distutils.cfg > > virtualenv-1.10.1/virtualenv_embedded/site.py > > virtualenv-1.10.1/virtualenv_support/ > > virtualenv-1.10.1/virtualenv_support/__init__.py > > virtualenv-1.10.1/virtualenv_support/pip-1.4.1.tar.gz > > virtualenv-1.10.1/virtualenv_support/setuptools-0.9.8.tar.gz > > + touch virtualenv-1.10.1/BOOTSTRAPPED > > + popd > > ~/jenkins-slave/workspace/Aurora > > + exec /usr/bin/python2.7 < > > > https://builds.apache.org/job/Aurora/ws/build-support/virtualenv-1.10.1/virtualenv.py > > > > <https://builds.apache.org/job/Aurora/ws/build-support/pex.venv> > > New python executable in < > > > https://builds.apache.org/job/Aurora/ws/build-support/pex.venv/bin/python2.7 > > > > > Also creating executable in < > > > https://builds.apache.org/job/Aurora/ws/build-support/pex.venv/bin/python> > > Installing > > > Setuptools..............................................................................................................................................................................................................................done. > > Installing > > > Pip.....................................................................................................................................................................................................................................................................................................................................done. > > Downloading/unpacking twitter.common.python==0.5.9 > > Running setup.py egg_info for package twitter.common.python > > > > Downloading/unpacking setuptools>=1 (from twitter.common.python==0.5.9) > > Running setup.py egg_info for package setuptools > > > > Downloading/unpacking wheel (from twitter.common.python==0.5.9) > > Running setup.py egg_info for package wheel > > > > no previously-included directories found matching 'wheel/test/*/dist' > > no previously-included directories found matching > 'wheel/test/*/build' > > Installing collected packages: twitter.common.python, setuptools, wheel > > Running setup.py install for twitter.common.python > > Skipping installation of < > > > https://builds.apache.org/job/Aurora/ws/build-support/pex.venv/lib/python2.7/site-packages/twitter/__init__.py > > > > (namespace package) > > Skipping installation of < > > > https://builds.apache.org/job/Aurora/ws/build-support/pex.venv/lib/python2.7/site-packages/twitter/common/__init__.py > > > > (namespace package) > > > > Installing < > > > https://builds.apache.org/job/Aurora/ws/build-support/pex.venv/lib/python2.7/site-packages/twitter.common.python-0.5.9-py2.7-nspkg.pth > > > > > Installing pex script to < > > https://builds.apache.org/job/Aurora/ws/build-support/pex.venv/bin> > > Found existing installation: setuptools 0.9.8 > > Uninstalling setuptools: > > Successfully uninstalled setuptools > > Running setup.py install for setuptools > > > > Installing easy_install script to < > > https://builds.apache.org/job/Aurora/ws/build-support/pex.venv/bin> > > Installing easy_install-2.7 script to < > > https://builds.apache.org/job/Aurora/ws/build-support/pex.venv/bin> > > Running setup.py install for wheel > > > > no previously-included directories found matching 'wheel/test/*/dist' > > no previously-included directories found matching > 'wheel/test/*/build' > > Installing wheel script to < > > https://builds.apache.org/job/Aurora/ws/build-support/pex.venv/bin> > > Successfully installed twitter.common.python setuptools wheel > > Cleaning up... > > twitter.common.python.http: Crawling /home/jenkins/.pex/build > > twitter.common.python.http: Crawling /home/jenkins/.pex/build: 0.8ms > > twitter.common.python.http: Crawling /home/jenkins/.pex/build > > twitter.common.python.http: Crawling /home/jenkins/.pex/build: 0.5ms > > twitter.common.python.http: Crawling /home/jenkins/.pex/build > > twitter.common.python.http: Crawling /home/jenkins/.pex/build: 0.9ms > > twitter.common.python.http: Crawling /home/jenkins/.pex/build > > twitter.common.python.http: Crawling /home/jenkins/.pex/build: 0.6ms > > twitter.common.python.http: Crawling /home/jenkins/.pex/build > > twitter.common.python.http: Crawling /home/jenkins/.pex/build: 0.7ms > > twitter.common.python.http: Crawling > > https://pypi.python.org/simple/twitter.common.process/ > > twitter.common.python.http: Crawling > > https://pypi.python.org/simple/twitter.common.process/ :: Opening > > (uncached) > > twitter.common.python.http: Crawling > > https://pypi.python.org/simple/twitter.common.process/ :: Opening > > (uncached) :: Fetching > > https://pypi.python.org/simple/twitter.common.process/ > > twitter.common.python.http: Crawling > > https://pypi.python.org/simple/twitter.common.process/ :: Opening > > (uncached) :: Fetching > > https://pypi.python.org/simple/twitter.common.process/ :: Resolving > > pypi.python.org > > twitter.common.python.http: Crawling > > https://pypi.python.org/simple/twitter.common.process/ :: Opening > > (uncached) :: Fetching > > https://pypi.python.org/simple/twitter.common.process/ :: Connecting to > > pypi.python.org > > twitter.common.python.http: Crawling > > https://pypi.python.org/simple/twitter.common.process/ :: Opening > > (uncached) :: Caching > > https://pypi.python.org/simple/twitter.common.process/ > > twitter.common.python.http: Crawling > > https://pypi.python.org/simple/twitter.common.process/: 220.6ms > > twitter.common.python.http: Opening (uncached): 219.4ms > > twitter.common.python.http: Fetching > > https://pypi.python.org/simple/twitter.common.process/: 217.0ms > > twitter.common.python.http: Resolving pypi.python.org: 32.0ms > > twitter.common.python.http: Connecting to pypi.python.org: 52.2ms > > twitter.common.python.http: Caching > > https://pypi.python.org/simple/twitter.common.process/: 1.9ms > > twitter.common.python.http: Crawling /home/jenkins/.pex/build > > twitter.common.python.http: Crawling /home/jenkins/.pex/build: 0.8ms > > twitter.common.python.http: Crawling > > https://pypi.python.org/simple/twitter.common.log/ > > twitter.common.python.http: Crawling > > https://pypi.python.org/simple/twitter.common.log/ :: Opening (uncached) > > twitter.common.python.http: Crawling > > https://pypi.python.org/simple/twitter.common.log/ :: Opening (uncached) > > :: Fetching https://pypi.python.org/simple/twitter.common.log/ > > twitter.common.python.http: Crawling > > https://pypi.python.org/simple/twitter.common.log/ :: Opening (uncached) > > :: Fetching https://pypi.python.org/simple/twitter.common.log/ :: > > Resolving pypi.python.org > > twitter.common.python.http: Timed out resolving pypi.python.org > > twitter.common.python.http: Failed to fetch > > https://pypi.python.org/simple/twitter.common.log/: Could not reach > > https://pypi.python.org/simple/twitter.common.log/ within deadline. > > Traceback (most recent call last): > > File "< > > https://builds.apache.org/job/Aurora/ws/build-support/pex.venv/bin/pex > ",> > > line 9, in <module> > > load_entry_point('twitter.common.python==0.5.9', 'console_scripts', > > 'pex')() > > File "< > > > https://builds.apache.org/job/Aurora/ws/build-support/pex.venv/local/lib/python2.7/site-packages/twitter/common/python/bin/pex.py > ",> > > line 320, in main > > pex_builder = build_pex(args, options) > > File "< > > > https://builds.apache.org/job/Aurora/ws/build-support/pex.venv/local/lib/python2.7/site-packages/twitter/common/python/bin/pex.py > ",> > > line 284, in build_pex > > platform=options.platform) > > File "< > > > https://builds.apache.org/job/Aurora/ws/build-support/pex.venv/local/lib/python2.7/site-packages/twitter/common/python/resolver.py > ",> > > line 98, in resolve > > raise Unsatisfiable('Cannot satisfy requirements: %s' % > > requirement_set[requirement.key]) > > twitter.common.python.resolver.Unsatisfiable: Cannot satisfy > requirements: > > [Requirement.parse('twitter.common.log>=0.3.1,<0.4')] > > Build step 'Execute shell' marked build as failure > > Recording test results > > > > > > -- > Zameer Manji >
