Public bug reported: 1. Exact version of Nova/OpenStack you are running: icehouse
2. Relevant log files: the log in /var/log/messages Oct 28 17:30:32 controller1 nova-api[4206]: Traceback (most recent call last): Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib/python2.7/site-packages/eventlet/greenpool.py", line 80, in _spawn_n_impl Oct 28 17:30:32 controller1 nova-api[4206]: func(*args, **kwargs) Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib/python2.7/site-packages/eventlet/wsgi.py", line 594, in process_request Oct 28 17:30:32 controller1 nova-api[4206]: proto.__init__(sock, address, self) Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib64/python2.7/SocketServer.py", line 649, in __init__ Oct 28 17:30:32 controller1 nova-api[4206]: self.handle() Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib64/python2.7/BaseHTTPServer.py", line 340, in handle Oct 28 17:30:32 controller1 nova-api[4206]: self.handle_one_request() Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib/python2.7/site-packages/eventlet/wsgi.py", line 285, in handle_one_request Oct 28 17:30:32 controller1 nova-api[4206]: self.handle_one_response() Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib/python2.7/site-packages/eventlet/wsgi.py", line 453, in handle_one_response Oct 28 17:30:32 controller1 nova-api[4206]: 'wall_seconds': finish - start, Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib/python2.7/site-packages/eventlet/wsgi.py", line 603, in log_message Oct 28 17:30:32 controller1 nova-api[4206]: self.log.write(message + '\n') Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib/python2.7/site-packages/nova/openstack/common/log.py", line 575, in write Oct 28 17:30:32 controller1 nova-api[4206]: self.logger.log(self.level, msg.rstrip()) Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib64/python2.7/logging/__init__.py", line 1471, in log Oct 28 17:30:32 controller1 nova-api[4206]: self.logger.log(level, msg, *args, **kwargs) Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib64/python2.7/logging/__init__.py", line 1213, in log Oct 28 17:30:32 controller1 nova-api[4206]: self._log(level, msg, args, **kwargs) Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib64/python2.7/logging/__init__.py", line 1268, in _log Oct 28 17:30:32 controller1 nova-api[4206]: self.handle(record) Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib64/python2.7/logging/__init__.py", line 1278, in handle Oct 28 17:30:32 controller1 nova-api[4206]: self.callHandlers(record) Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib64/python2.7/logging/__init__.py", line 1318, in callHandlers Oct 28 17:30:32 controller1 nova-api[4206]: hdlr.handle(record) Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib64/python2.7/logging/__init__.py", line 749, in handle Oct 28 17:30:32 controller1 nova-api[4206]: self.emit(record) Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib64/python2.7/logging/handlers.py", line 425, in emit Oct 28 17:30:32 controller1 nova-api[4206]: self.stream.flush() Oct 28 17:30:32 controller1 nova-api[4206]: ValueError: I/O operation on closed file 3. Reproduce steps: build many instances. ** Affects: nova Importance: Undecided Status: New -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1513733 Title: nova api wsgi request lost, system messages show 'ValueError: I/O operation on closed file' Status in OpenStack Compute (nova): New Bug description: 1. Exact version of Nova/OpenStack you are running: icehouse 2. Relevant log files: the log in /var/log/messages Oct 28 17:30:32 controller1 nova-api[4206]: Traceback (most recent call last): Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib/python2.7/site-packages/eventlet/greenpool.py", line 80, in _spawn_n_impl Oct 28 17:30:32 controller1 nova-api[4206]: func(*args, **kwargs) Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib/python2.7/site-packages/eventlet/wsgi.py", line 594, in process_request Oct 28 17:30:32 controller1 nova-api[4206]: proto.__init__(sock, address, self) Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib64/python2.7/SocketServer.py", line 649, in __init__ Oct 28 17:30:32 controller1 nova-api[4206]: self.handle() Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib64/python2.7/BaseHTTPServer.py", line 340, in handle Oct 28 17:30:32 controller1 nova-api[4206]: self.handle_one_request() Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib/python2.7/site-packages/eventlet/wsgi.py", line 285, in handle_one_request Oct 28 17:30:32 controller1 nova-api[4206]: self.handle_one_response() Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib/python2.7/site-packages/eventlet/wsgi.py", line 453, in handle_one_response Oct 28 17:30:32 controller1 nova-api[4206]: 'wall_seconds': finish - start, Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib/python2.7/site-packages/eventlet/wsgi.py", line 603, in log_message Oct 28 17:30:32 controller1 nova-api[4206]: self.log.write(message + '\n') Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib/python2.7/site-packages/nova/openstack/common/log.py", line 575, in write Oct 28 17:30:32 controller1 nova-api[4206]: self.logger.log(self.level, msg.rstrip()) Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib64/python2.7/logging/__init__.py", line 1471, in log Oct 28 17:30:32 controller1 nova-api[4206]: self.logger.log(level, msg, *args, **kwargs) Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib64/python2.7/logging/__init__.py", line 1213, in log Oct 28 17:30:32 controller1 nova-api[4206]: self._log(level, msg, args, **kwargs) Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib64/python2.7/logging/__init__.py", line 1268, in _log Oct 28 17:30:32 controller1 nova-api[4206]: self.handle(record) Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib64/python2.7/logging/__init__.py", line 1278, in handle Oct 28 17:30:32 controller1 nova-api[4206]: self.callHandlers(record) Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib64/python2.7/logging/__init__.py", line 1318, in callHandlers Oct 28 17:30:32 controller1 nova-api[4206]: hdlr.handle(record) Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib64/python2.7/logging/__init__.py", line 749, in handle Oct 28 17:30:32 controller1 nova-api[4206]: self.emit(record) Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib64/python2.7/logging/handlers.py", line 425, in emit Oct 28 17:30:32 controller1 nova-api[4206]: self.stream.flush() Oct 28 17:30:32 controller1 nova-api[4206]: ValueError: I/O operation on closed file 3. Reproduce steps: build many instances. To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1513733/+subscriptions -- Mailing list: https://launchpad.net/~yahoo-eng-team Post to : yahoo-eng-team@lists.launchpad.net Unsubscribe : https://launchpad.net/~yahoo-eng-team More help : https://help.launchpad.net/ListHelp