As far as I know cron cannot lock. Only child processes can lock. As
far as I know cron works fine. Yet I am trying to isolate the problem
cron is one of those few things that may differ when running with
apache or its own web server.
Massimo
On Apr 5, 3:20 pm, AchipA wrote:
> Can you elaborate
Can you elaborate how can cron cause database locking issues (apart
from such issues being caused by child processes)?
The content of the crontab is irrelevant, whether you only have
@reboot or more makes no difference. If there would be no check, you
could not change cron parameters without resta
yes. good point.
Massimo
On Apr 5, 2:44 pm, Michael Toomim wrote:
> Thanks guys. Each time I run a test, though, it costs me money
> because I'm paying people on mechanical turk. And if it's slow, it
> gives me a bad reputation. So I don't want to run more slow tests
> unless we have good req
and I'm using postgres not sqlite.
On Apr 5, 12:44 pm, Michael Toomim wrote:
> Thanks guys. Each time I run a test, though, it costs me money
> because I'm paying people on mechanical turk. And if it's slow, it
> gives me a bad reputation. So I don't want to run more slow tests
> unless we hav
Thanks guys. Each time I run a test, though, it costs me money
because I'm paying people on mechanical turk. And if it's slow, it
gives me a bad reputation. So I don't want to run more slow tests
unless we have good request time logging in place and a good
hypothesis to test.
Wouldn't cron only
You are right, I was going to add that feature and then forgot about
it. Someone reported a PyPI bug over the weekend (it would not affect
web2py). I'll see if I can make the logging a bit more flexible and
release a 1.1 in the next few days.
In the meantime, look into the cron thing.
-tim
Since you have the problem with both cherrypy and rocket I suspect
that this may be a database locking issues caused by cron. Even it you
only have @reboot, still cron runs and every minute it check what
needs to be done. I suggest try disable it completely and see what
happens. In web2py.py replac
I started using apache with mod_wsgi, and now it's fast! So this
indicates it's a problem that only occurs when using rocket or
cherrypy, but again I'm only measuring it with firebug in my browser.
I have 768MB of ram, ~500MB free. I use cron for @reboot only.
I only run it on a remote machine
Some more questions:
how much ram?
can you check memory usage? A memory leak may cause slowness.
are you using cron? when cron starts it may spike memory usage.
are you experience the slowness from localhost or from remote
machines?
On Apr 4, 6:46 pm, Michael Toomim wrote:
> You are both right
Let us know if you discover anything or if we can help with tests.
Can anybody else reproduce this problem?
On Apr 4, 6:46 pm, Michael Toomim wrote:
> You are both right that I do not know where the slowness is coming
> from. My goal is to measure it so that I can narrow in on the
> problem. So
You are both right that I do not know where the slowness is coming
from. My goal is to measure it so that I can narrow in on the
problem. So far I know that it is external to web2py because it does
not show up in httpserver.log, so my reasoning is to look at rocket
which wraps the web2py part.
O
I see, thank you. I want to measure the web server's response time
when I deploy this on turk... Unfortunately the rocket log does not
report time to serve a request. Do you think it is easy to get that
information from rocket? Do you store the start and stop times for
each request? I see start
I don't think upgrading will help much since Cherrypy was also slow.
However, doing so would help cover all your bases.
If you want to use the http log from Rocket you can do this. I'm
assuming you invoke web2py.py from a bash script or just run it
manually. Paste the following code into th
On Mar 29, 7:59 pm, Michael Toomim wrote:
> Yes, this is on linux! Do you recommend upgrading and trying again?
>
> mturk doesn't affect anything, I am just serving webpages that appear
> in iframes on the mturk website. From our perspective, I'm serving
> webpages.
>
> Do you have a method of l
Yes, this is on linux! Do you recommend upgrading and trying again?
mturk doesn't affect anything, I am just serving webpages that appear
in iframes on the mturk website. From our perspective, I'm serving
webpages.
Do you have a method of logging how much time it takes to serve a page
with rock
On 3/29/2010 1:39 PM, Michael Toomim wrote:
I was having slowness problems with cherrypy too! That's why I
switched to rocket. So perhaps it's something common to cherrypy and
rocket, or perhaps they are both slow in their own ways?
This is using web2py from march 16th, so it's not the latest
I was having slowness problems with cherrypy too! That's why I
switched to rocket. So perhaps it's something common to cherrypy and
rocket, or perhaps they are both slow in their own ways?
This is using web2py from march 16th, so it's not the latest rocket.
Do you think something important chang
Perhaps a simpler set of questions:
Did you have this working with Cherrypy beforehand?
If so, is Rocket the only thing to have changed?
The latest changes to Rocket were committed to the Mercurial web2py repo
on March 18th. I'm assuming you've run a checkout since then.
-tim
On 3/28/2010 4
One more thing. You ask
> But a single process doing complex joins should not slow down
> all other simple selects and inserts, right?
no, except for sqlite. sqlite serializes all requests because locks
the db. That could explain the 0.20s if you have lots of queries per
request, but not the 54s
On Mar 28, 3:46 pm, Michael Toomim wrote:
> Any idea why there is a discrepancy between Firebug and
> httpserver.log?
httpserver.log logs the time spend in web2py, not including the time
for sending and receiving the http request/response.
firebug logs the the total time, including time spend b
Any idea why there is a discrepancy between Firebug and
httpserver.log?
I am using postgresql. What would indicate "model complexity"? I
have around 9 tables, but most of the requests just do single-object
selects and inserts. No complex joins are in public-facing pages, but
myself as an admini
Mind that if you use sqlite there is no concurrency. Still these
numbers are very low.
Are your models very complex?
On 27 Mar, 00:06, Michael Toomim wrote:
> I'm using web2py+rocket to serve jobs on mechanical turk. The server
> probably gets a hit per second or so by workers on mechanical turk
Actually it's handling about 5 requests per second, so there is def
some concurrency.
On Mar 26, 10:06 pm, Michael Toomim wrote:
> I'm using web2py+rocket to serve jobs on mechanical turk. The server
> probably gets a hit per second or so by workers on mechanical turk
> using it.
>
> When I have
23 matches
Mail list logo
