See <https://builds.apache.org/job/Aurora/567/changes>
Changes: [maxim] Store new task configuration in JobUpdateConfiguration as InstanceTaskConfig ------------------------------------------ [...truncated 7414 lines...] collecting ... collected 15 items src/test/python/apache/thermos/core/test_finalization.py::TestRegularFinalizingTask::test_runner_state PASSED src/test/python/apache/thermos/core/test_finalization.py::TestRegularFinalizingTask::test_runner_process_in_expected_states PASSED src/test/python/apache/thermos/core/test_finalization.py <- ../../../../../tmp/tmpQSgKZw/apache/thermos/testing/runner.py::TestRegularFinalizingTask::test_runner_state_reconstruction PASSEDFailed to kill runner: [Errno 3] No such process src/test/python/apache/thermos/core/test_finalization.py::TestSequentialFinalizationSchedule::test_runner_state PASSED src/test/python/apache/thermos/core/test_finalization.py::TestSequentialFinalizationSchedule::test_runner_process_in_expected_states PASSED src/test/python/apache/thermos/core/test_finalization.py <- ../../../../../tmp/tmpQSgKZw/apache/thermos/testing/runner.py::TestSequentialFinalizationSchedule::test_runner_state_reconstruction PASSEDFailed to kill runner: [Errno 3] No such process src/test/python/apache/thermos/core/test_finalization.py::TestTaskSucceedsDespiteFinalizationFailure::test_runner_state PASSED src/test/python/apache/thermos/core/test_finalization.py::TestTaskSucceedsDespiteFinalizationFailure::test_runner_process_in_expected_states PASSED src/test/python/apache/thermos/core/test_finalization.py <- ../../../../../tmp/tmpQSgKZw/apache/thermos/testing/runner.py::TestTaskSucceedsDespiteFinalizationFailure::test_runner_state_reconstruction PASSEDFailed to kill runner: [Errno 3] No such process src/test/python/apache/thermos/core/test_finalization.py::TestParallelFinalizationFailure::test_runner_state PASSED src/test/python/apache/thermos/core/test_finalization.py::TestParallelFinalizationFailure::test_runner_process_in_expected_states PASSED src/test/python/apache/thermos/core/test_finalization.py <- ../../../../../tmp/tmpQSgKZw/apache/thermos/testing/runner.py::TestParallelFinalizationFailure::test_runner_state_reconstruction PASSEDFailed to kill runner: [Errno 3] No such process src/test/python/apache/thermos/core/test_finalization.py::TestFinalizationRunsDespiteFailure::test_runner_state PASSED src/test/python/apache/thermos/core/test_finalization.py::TestFinalizationRunsDespiteFailure::test_runner_process_in_expected_states PASSED src/test/python/apache/thermos/core/test_finalization.py <- ../../../../../tmp/tmpQSgKZw/apache/thermos/testing/runner.py::TestFinalizationRunsDespiteFailure::test_runner_state_reconstruction PASSEDFailed to kill runner: [Errno 3] No such process ========================== 15 passed in 19.32 seconds ========================== ============================= test session starts ============================== platform linux2 -- Python 2.7.6 -- py-1.4.24 -- pytest-2.6.2 -- /usr/bin/python2.7 plugins: cov, timeout collecting ... collected 7 items src/test/python/apache/aurora/config/test_base.py::test_all_static PASSED src/test/python/apache/aurora/config/test_base.py::test_binding PASSED src/test/python/apache/aurora/config/test_base.py::test_cycle PASSED src/test/python/apache/aurora/config/test_base.py::test_empty_config PASSED src/test/python/apache/aurora/config/test_base.py::test_simple_config PASSED src/test/python/apache/aurora/config/test_base.py::test_ports PASSED src/test/python/apache/aurora/config/test_base.py::test_static_port_aliasing PASSED =========================== 7 passed in 1.28 seconds =========================== ============================= test session starts ============================== platform linux2 -- Python 2.7.6 -- py-1.4.24 -- pytest-2.6.2 -- /usr/bin/python2.7 plugins: cov, timeout collecting ... collected 2 items src/test/python/apache/thermos/core/test_helper.py::test_this_is_really_our_pid PASSED src/test/python/apache/thermos/core/test_helper.py::test_scan_process WARNING:root: Error gathering information on pid 12345: WARNING:root: Error gathering information on pid 13337: PASSED =========================== 2 passed in 0.15 seconds =========================== ============================= test session starts ============================== platform linux2 -- Python 2.7.6 -- py-1.4.24 -- pytest-2.6.2 -- /usr/bin/python2.7 plugins: cov, timeout collecting ... collected 1 items src/test/python/apache/aurora/common/test_shellify.py::test_shellify PASSED =========================== 1 passed in 0.01 seconds =========================== ============================= test session starts ============================== platform linux2 -- Python 2.7.6 -- py-1.4.24 -- pytest-2.6.2 -- /usr/bin/python2.7 plugins: cov, timeout collecting ... collected 9 items src/test/python/apache/aurora/admin/test_host_maintenance.py <- <https://builds.apache.org/job/Aurora/ws/src/test/python/apache/aurora/admin/test_host_maintenance.py>::TestHostMaintenance::test_check_status PASSED src/test/python/apache/aurora/admin/test_host_maintenance.py <- <https://builds.apache.org/job/Aurora/ws/src/test/python/apache/aurora/admin/test_host_maintenance.py>::TestHostMaintenance::test_complete_maintenance PASSED src/test/python/apache/aurora/admin/test_host_maintenance.py <- <https://builds.apache.org/job/Aurora/ws/src/test/python/apache/aurora/admin/test_host_maintenance.py>::TestHostMaintenance::test_drain_hosts WARNING:root:us-west-001.example.com is currently in status SCHEDULED WARNING:root:us-west-003.example.com is currently in status SCHEDULED WARNING:root:us-west-002.example.com is currently in status SCHEDULED WARNING:root:us-west-002.example.com is currently in status DRAINING WARNING:root:us-west-001.example.com is currently in status DRAINING WARNING:root:us-west-003.example.com is currently in status DRAINING WARNING:root:us-west-001.example.com is currently in status DRAINING PASSED src/test/python/apache/aurora/admin/test_host_maintenance.py <- <https://builds.apache.org/job/Aurora/ws/src/test/python/apache/aurora/admin/test_host_maintenance.py>::TestHostMaintenance::test_end_maintenance PASSED src/test/python/apache/aurora/admin/test_host_maintenance.py <- <https://builds.apache.org/job/Aurora/ws/src/test/python/apache/aurora/admin/test_host_maintenance.py>::TestHostMaintenance::test_perform_maintenance PASSED src/test/python/apache/aurora/admin/test_host_maintenance.py <- <https://builds.apache.org/job/Aurora/ws/src/test/python/apache/aurora/admin/test_host_maintenance.py>::TestHostMaintenance::test_perform_maintenance_partial_sla_failure WARNING:root:Some hosts did not pass SLA check and will not be drained! Skipping hosts: set(['us-west-001.example.com']) us-west-001.example.com PASSED src/test/python/apache/aurora/admin/test_host_maintenance.py <- <https://builds.apache.org/job/Aurora/ws/src/test/python/apache/aurora/admin/test_host_maintenance.py>::TestHostMaintenance::test_start_maintenance WARNING:root:Skipping maintenance for unknown hosts: set(['us-west-001.example.com', 'us-west-003.example.com', 'us-west-002.example.com']) PASSED src/test/python/apache/aurora/admin/test_host_maintenance.py <- <https://builds.apache.org/job/Aurora/ws/src/test/python/apache/aurora/admin/test_host_maintenance.py>::test_default_grouping PASSED src/test/python/apache/aurora/admin/test_host_maintenance.py <- <https://builds.apache.org/job/Aurora/ws/src/test/python/apache/aurora/admin/test_host_maintenance.py>::test_rack_grouping PASSED =========================== 9 passed in 0.54 seconds =========================== ============================= test session starts ============================== platform linux2 -- Python 2.7.6 -- py-1.4.24 -- pytest-2.6.2 -- /usr/bin/python2.7 plugins: cov, timeout collecting ... collected 2 items src/test/python/apache/aurora/executor/common/test_executor_timeout.py::TestExecutorTimeout::test_run PASSED src/test/python/apache/aurora/executor/common/test_executor_timeout.py::TestExecutorTimeout::test_run_timeout ERROR:root:Executor timing out. PASSED =========================== 2 passed in 0.07 seconds =========================== ============================= test session starts ============================== platform linux2 -- Python 2.7.6 -- py-1.4.24 -- pytest-2.6.2 -- /usr/bin/python2.7 plugins: cov, timeout collecting ... collected 5 items src/test/python/apache/aurora/executor/test_thermos_task_runner.py::TestThermosTaskRunnerIntegration::test_integration_success Writing log files to disk in /tmp/tmppYnsfD Build operating on top level addresses: set([BuildFileAddress(<https://builds.apache.org/job/Aurora/ws/src/main/python/apache/aurora/executor/bin/BUILD,> thermos_runner)]) Building PythonBinary PythonBinary(BuildFileAddress(<https://builds.apache.org/job/Aurora/ws/src/main/python/apache/aurora/executor/bin/BUILD,> thermos_runner)): Wrote <https://builds.apache.org/job/Aurora/ws/dist/thermos_runner.pex> Writing log files to disk in /tmp/tmppYnsfD PASSED src/test/python/apache/aurora/executor/test_thermos_task_runner.py::TestThermosTaskRunnerIntegration::test_integration_failed Writing log files to disk in /tmp/tmppYnsfD PASSED src/test/python/apache/aurora/executor/test_thermos_task_runner.py::TestThermosTaskRunnerIntegration::test_integration_stop Writing log files to disk in /tmp/tmppYnsfD ERROR] Could not quitquitquit runner: Cannot take control of a task in terminal state. FAILEDERROR] Caught exception in self.control(): Cannot finalize task with no "active" record! ERROR] Traceback (most recent call last): File "<https://builds.apache.org/job/Aurora/ws/dist/thermos_runner.pex/apache/thermos/core/runner.py";,> line 556, in control yield File "<https://builds.apache.org/job/Aurora/ws/dist/thermos_runner.pex/apache/thermos/core/runner.py";,> line 890, in kill self._run() File "<https://builds.apache.org/job/Aurora/ws/dist/thermos_runner.pex/apache/thermos/core/runner.py";,> line 856, in _run self._set_task_status(runner.transition_to()) File "<https://builds.apache.org/job/Aurora/ws/dist/thermos_runner.pex/apache/thermos/core/runner.py";,> line 631, in _set_task_status self._dispatcher.dispatch(self._state, runner_ckpt, self._recovery) File "<https://builds.apache.org/job/Aurora/ws/dist/thermos_runner.pex/apache/thermos/common/ckpt.py";,> line 352, in dispatch self._run_task_dispatch(new_state, runner_ckpt.task_status) File "<https://builds.apache.org/job/Aurora/ws/dist/thermos_runner.pex/apache/thermos/common/ckpt.py";,> line 222, in _run_task_dispatch getattr(handler, handler_function)(task_update) File "<https://builds.apache.org/job/Aurora/ws/dist/thermos_runner.pex/apache/thermos/core/runner.py";,> line 201, in on_killed self._cleanup() File "<https://builds.apache.org/job/Aurora/ws/dist/thermos_runner.pex/apache/thermos/core/runner.py";,> line 219, in _cleanup TaskRunnerHelper.finalize_task(self._pathspec) File "<https://builds.apache.org/job/Aurora/ws/dist/thermos_runner.pex/apache/thermos/core/helper.py";,> line 394, in finalize_task raise cls.Error('Cannot finalize task with no "active" record!') Error: Cannot finalize task with no "active" record! =================================== FAILURES =================================== ____________ TestThermosTaskRunnerIntegration.test_integration_stop ____________ self = <test_thermos_task_runner.TestThermosTaskRunnerIntegration object at 0x7fa5e85c2650> def test_integration_stop(self): with self.yield_sleepy(ThermosTaskRunner, sleep=1000, exit_code=0) as task_runner: task_runner.start() task_runner.forked.wait() assert task_runner.status is None > task_runner.stop() src/test/python/apache/aurora/executor/test_thermos_task_runner.py:140: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = <apache.aurora.executor.thermos_task_runner.ThermosTaskRunner object at 0x7fa5e85c2290> timeout = Amount(1, mins) def stop(self, timeout=MAX_WAIT): """Stop the runner. If it's already completed, no-op. If it's still running, issue a kill.""" log.info('ThermosTaskRunner is shutting down.') if not self.forking.is_set(): raise TaskError('Failed to call TaskRunner.start.') log.info('Invoking runner HTTP teardown.') self._terminate_http() log.info('Invoking runner.kill') self.kill() waited = Amount(0, Time.SECONDS) while self.is_alive and waited < timeout: self._clock.sleep(self.POLL_INTERVAL.as_(Time.SECONDS)) waited += self.POLL_INTERVAL if not self.is_alive and self.task_state() != TaskState.ACTIVE: return log.info('Thermos task did not shut down cleanly, rebinding to kill.') self.quitquitquit() while not self._monitor.finished and waited < timeout: self._clock.sleep(self.POLL_INTERVAL.as_(Time.SECONDS)) waited += self.POLL_INTERVAL if not self._monitor.finished: > raise TaskError('Task did not stop within deadline.') E TaskError: Task did not stop within deadline. /tmp/tmpbhMlYW/apache/aurora/executor/thermos_task_runner.py:290: TaskError !!!!!!!!!!!!!!!!!!!! Interrupted: stopping after 1 failures !!!!!!!!!!!!!!!!!!!! ===================== 1 failed, 2 passed in 65.83 seconds ====================== Build operating on top level addresses: set([BuildFileAddress(<https://builds.apache.org/job/Aurora/ws/src/test/python/BUILD,> all)]) src.test.python.apache.aurora.admin.host_maintenance ..... SUCCESS src.test.python.apache.aurora.client.api.api ..... SUCCESS src.test.python.apache.aurora.client.api.disambiguator ..... SUCCESS src.test.python.apache.aurora.client.api.instance_watcher ..... SUCCESS src.test.python.apache.aurora.client.api.job_monitor ..... SUCCESS src.test.python.apache.aurora.client.api.mux ..... SUCCESS src.test.python.apache.aurora.client.api.restarter ..... SUCCESS src.test.python.apache.aurora.client.api.scheduler_client ..... SUCCESS src.test.python.apache.aurora.client.api.updater ..... SUCCESS src.test.python.apache.aurora.client.api.updater_util ..... SUCCESS src.test.python.apache.aurora.client.binding_helper ..... SUCCESS src.test.python.apache.aurora.client.cli.api ..... SUCCESS src.test.python.apache.aurora.client.cli.command_hooks ..... SUCCESS src.test.python.apache.aurora.client.cli.config ..... SUCCESS src.test.python.apache.aurora.client.cli.help ..... SUCCESS src.test.python.apache.aurora.client.cli.inspect ..... SUCCESS src.test.python.apache.aurora.client.cli.job ..... SUCCESS src.test.python.apache.aurora.client.cli.logging ..... SUCCESS src.test.python.apache.aurora.client.cli.plugins ..... SUCCESS src.test.python.apache.aurora.client.cli.quota ..... SUCCESS src.test.python.apache.aurora.client.cli.sla ..... SUCCESS src.test.python.apache.aurora.client.cli.supdate ..... SUCCESS src.test.python.apache.aurora.client.cli.task ..... SUCCESS src.test.python.apache.aurora.client.commands.admin ..... SUCCESS src.test.python.apache.aurora.client.commands.core ..... SUCCESS src.test.python.apache.aurora.client.commands.ssh ..... SUCCESS src.test.python.apache.aurora.client.config ..... SUCCESS src.test.python.apache.aurora.client.hooks.hooked_api ..... SUCCESS src.test.python.apache.aurora.client.hooks.non_hooked_api ..... SUCCESS src.test.python.apache.aurora.common.test_aurora_job_key ..... SUCCESS src.test.python.apache.aurora.common.test_cluster ..... SUCCESS src.test.python.apache.aurora.common.test_cluster_option ..... SUCCESS src.test.python.apache.aurora.common.test_clusters ..... SUCCESS src.test.python.apache.aurora.common.test_http_signaler ..... SUCCESS src.test.python.apache.aurora.common.test_shellify ..... SUCCESS src.test.python.apache.aurora.common.test_transport ..... SUCCESS src.test.python.apache.aurora.config.test_base ..... SUCCESS src.test.python.apache.aurora.config.test_loader ..... SUCCESS src.test.python.apache.aurora.config.test_thrift ..... SUCCESS src.test.python.apache.aurora.executor.common.announcer ..... SUCCESS src.test.python.apache.aurora.executor.common.directory_sandbox ..... SUCCESS src.test.python.apache.aurora.executor.common.executor_timeout ..... SUCCESS src.test.python.apache.aurora.executor.common.health_checker ..... SUCCESS src.test.python.apache.aurora.executor.common.task_info ..... SUCCESS src.test.python.apache.aurora.executor.executor_base ..... SUCCESS src.test.python.apache.aurora.executor.executor_vars ..... SUCCESS src.test.python.apache.aurora.executor.gc_executor ..... SUCCESS src.test.python.apache.aurora.executor.status_manager ..... SUCCESS src.test.python.apache.aurora.executor.thermos_task_runner ..... FAILURE src.test.python.apache.thermos.bin.test_thermos ..... SUCCESS src.test.python.apache.thermos.common.test_pathspec ..... SUCCESS src.test.python.apache.thermos.common.test_task_planner ..... SUCCESS src.test.python.apache.thermos.core.test_angry ..... SUCCESS src.test.python.apache.thermos.core.test_failing_runner ..... SUCCESS src.test.python.apache.thermos.core.test_failure_limit ..... SUCCESS src.test.python.apache.thermos.core.test_finalization ..... SUCCESS src.test.python.apache.thermos.core.test_helper ..... SUCCESS src.test.python.apache.thermos.core.test_runner_integration ..... SUCCESS src.test.python.apache.thermos.monitoring.test_disk ..... SUCCESS Build step 'Execute shell' marked build as failure Recording test results
