Ignore my previous email.... I see you are using 2.6 and the problem is with cron. I think the problem is a cron process that does not end and keeps restarting. Are you using cron?
On Jul 27, 7:33 am, Michael Ellis <michael.f.el...@gmail.com> wrote: > Not sure if this is related to Rocket or whether a new topic is needed. > > This morning I found several OSError reports about "Too many open files" in > a web2py development server that's been running locally for several days. > The app code isn't doing any explicit file i/o so I don't know what's going > on, but here are the tracebacks in case someone else is seeing anything > similar. > > Mike > > Exception in thread Thread-89: > Traceback (most recent call last): > File > "/System/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/threading.py", > line 522, in __bootstrap_inner > self.run() > File "/Users/mellis/w2ptip/gluon/newcron.py", line 206, in run > shell=self.shell) > File > "/System/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/subprocess.py", > line 595, in __init__ > errread, errwrite) > File > "/System/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/subprocess.py", > line 1018, in _execute_child > errpipe_read, errpipe_write = os.pipe() > OSError: [Errno 24] Too many open files > > ERROR:Rocket.Errors.ThreadPool:Traceback (most recent call last): > File "/Users/mellis/w2ptip/gluon/rocket.py", line 302, in start > sock = l.accept() > File > "/System/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/socket.py", > line 195, in accept > sock, addr = self._sock.accept() > error: [Errno 24] Too many open files > > ERROR:root:corrupted file: > /Users/mellis/w2ptip/applications/init/cache/cache.shelve > ERROR:root:Traceback (most recent call last): > File "/Users/mellis/w2ptip/gluon/restricted.py", line 178, in restricted > exec ccode in environment > File "/Users/mellis/w2ptip/applications/init/models/db.py", line 35, in > <module> > auth.define_tables() # creates all needed tables > File "/Users/mellis/w2ptip/gluon/tools.py", line 1106, in define_tables > format='%(first_name)s %(last_name)s (%(id)s)') > File "/Users/mellis/w2ptip/gluon/sql.py", line 1309, in define_table > File "/Users/mellis/w2ptip/gluon/sql.py", line 1715, in _create > IOError: [Errno 24] Too many open files: > '/Users/mellis/w2ptip/applications/init/databases/sql.log' > > On Tue, Jul 27, 2010 at 2:54 AM, Rahul <rahul.dhak...@gmail.com> wrote: > > Thanks everyone, for getting this issue resolved... > > Web2py rocks! > > Cheers, Rahul > > > On Jul 24, 6:25 pm, Phyo Arkar <phyo.arkarl...@gmail.com> wrote: > > > Yes , Since from start of web2py , Massimo and Us never recommend to use > > > built-in web2py server at production. They are mainly for development > > > purpose. > > > Since Very start of the project , since Cherrypy , Massimo always Suggest > > to > > > use Apache/Cherokee/LighHTTPD over fcgi/wsgi/uwsgi or mod_python in > > Serious > > > Production Server. > > > > Rocket tho tries quite hard to achieve production level Performance with > > all > > > Cool Comet/Threading Stuff . It still Quite Young .Lets give it a chance. > > > > On Sat, Jul 24, 2010 at 7:39 PM, Scott <blueseas...@gmail.com> wrote: > > > > Please allow me to preface my comments: I have nothing against Rocket; > > > > my opinions come from years of experience with Java EE deployments. > > > > > I think raising the max_threads to 1024 is a good idea. However, my > > > > opinion is that Rocket alone should not be used for a production > > > > deployment; much as I would not use the built-in Web server in JBoss, > > > > WebLogic, Geronimo, etc. as the front door. My suggestion for > > > > production would be to use an Apache front-end into Rocket. Apache is > > > > more battle-hardened in this area, and it's a lot easier to handle DoS > > > > attacks through modules such as mod_evasive. There are numerous other > > > > benefits too, such as easily enabling gzip compression and allowing > > > > you a better security model through Defense in Depth... but I digress. > > > > > On Jul 23, 5:41 pm, mdipierro <mdipie...@cs.depaul.edu> wrote: > > > > > On a second thought this open the door to more sever denial of > > service > > > > > attacks than caused by the original problem. How about, until there > > is > > > > > a better under understanding and solution, we just increase > > > > > max_threads from the original 128 to 1024. > > > > > > On Jul 22, 11:27 am, Timbo <tfarr...@owassobible.org> wrote: > > > > > > > Try one quick change for me please...rocketis constructed around > > line > > > > > > 655 in main.py > > > > > > > Add a parameter to the constructor call(s): max_threads=0 > > > > > > > Please let me know if that affects the problem. > > > > > > > -tim > > > > > > > On Jul 22, 10:34 am, mdipierro <mdipie...@cs.depaul.edu> wrote: > > > > > > > > I can reproduce the problem. I did on localhost with two > > different > > > > > > > browsers. > > > > > > > Using firebug I can see it takes 25seconds to download base.css > > (the > > > > > > > problem is not always with the same file). > > > > > > > While I did the test, I also monitored httpserver.log and I find > > that > > > > > > > it NEVER takes more than 1.2ms serve base.css. > > > > > > > This is what the log shows: > > > > > > > > .... > > > > > > > 127.0.0.1, 2010-07-22 10:16:38, GET, > > /michealellistest/static/images/ > > > > > > > header.png, HTTP/1.1, 304, 0.000563 > > > > > > > 127.0.0.1, 2010-07-22 10:16:38, GET, /favicon.ico, HTTP/1.1, 400, > > > > > > > 0.000631 > > > > > > > 127.0.0.1, 2010-07-22 10:16:55, GET, /michealellistest/static/ > > > > > > > base.css, HTTP/1.1, 304, 0.000791 #### locks firefox for 25secs > > > > > > > .... > > > > > > > 127.0.0.1, 2010-07-22 10:22:42, GET, /michealellistest/static/ > > > > > > > jquery.timers-1.2.js, HTTP/1.1, 304, 0.000552 > > > > > > > 127.0.0.1, 2010-07-22 10:22:42, GET, /favicon.ico, HTTP/1.1, 400, > > > > > > > 0.000497 > > > > > > > 127.0.0.1, 2010-07-22 10:23:02, GET, /michealellistest/static/ > > > > > > > superfish.js, HTTP/1.1, 304, 0.000914 #### locks chrome for > > 25secs > > > > > > > > Do you see the time gaps? > > > > > > > > There is a clear pattern. Under heavy load a request that results > > in > > > > a > > > > > > > HTTP 400 error locksRocket. > > > > > > > > Notice that the logging is done by a wsgi application that calls > > > > > > > web2py wsgibase, i.e it time how long it takes web2py to receive > > the > > > > > > > request and send the response. The extra time must be spent > > inside > > > > the > > > > > > > web server. > > > > > > > > It is also important that the times showed in the logs are the > > actual > > > > > > > time when the data is being written in the logs. You can see > > firefox > > > > > > > waiting for base.css, the server waiting to log base.css and > > nothing > > > > > > > else is being printed during the wait, signifying that web2py is > > not > > > > > > > running any request. > > > > > > > > We need Tim! This is a problem. > > > > > > > > Massimo > > > > > > > > On Jul 22, 9:22 am, Michael Ellis <michael.f.el...@gmail.com> > > wrote: > > > > > > > > > I've isolated the problem but absolutely do not understand it. > > I > > > > can > > > > > > > > reproduce it with a two-line change to web2py_ajax.html. Will > > > > someone with > > > > > > > > the time and equipment please attempt to replicate this as a > > > > sanity check? > > > > > > > > > Here's how: > > > > > > > > > In the welcome app's web2py_ajax.html, insert the following > > after > > > > line 3. > > > response.files.insert(3,URL(r=request,c='static',f='jquery.sparkline.js')) > > > response.files.insert(4,URL(r=request,c='static',f='jquery.timers-1.2.js')) > > > > > > > > > Copy the attached js files into welcome/static. They should be > > the > > > > same as > > > > > > > > the versions available online. > > > > > > > > > To reproduce the problem, serve web2py on your LAN. Open the > > > > welcome home > > > > > > > > page on two different machines. One of them can be on the > > server. > > > > Briskly > > > > > > > > reload the page 10 or more times on either machine then try to > > > > reload on the > > > > > > > > other. In my setup, the delay is reliably 25 seconds from the > > time > > > > I make > > > > > > > > the last click on the first machine. > > > > > > > > > I'm able to reproduce this in FF, Chrome, and Safari using the > > > > latest web2py > > > > > > > > from trunk. Haven't tried any other browsers yet. As noted > > > > previously both > > > > > > > > machines are MacBooks running Snow Leopard. > > > > > > > > > Mike > > > > > > > > > jquery.timers-1.2.js > > > > > > > > 4KViewDownload > > > > > > > > > jquery.sparkline.js > > > > > > > > 62KViewDownload
