Re: Logging user's movements

2005-02-06 Thread ben syverson
On Feb 6, 2005, at 11:04 AM, Perrin Harkins wrote: Have you ever used an inverted word index? This is what full-text search usually is based on. Searching a million documents efficiently should be no big deal. You also only have to do this as part of the job of creating a new node. You don't

Re: Logging user's movements

2005-02-06 Thread Perrin Harkins
ben syverson wrote: That's not how it works. The entire cache IS invalidated when a new node is added. What I'm saying is that you only invalidate the entire cache right now because you have no way of telling which nodes are affected by the change. If you had a full-text index, you could effici

Re: Logging user's movements

2005-02-05 Thread ben syverson
On Feb 4, 2005, at 6:51 PM, Christian Hansen wrote: 1) Use a reverse proxy/cache and send proper Cache-Control and Etag/Content-Length headers, eg: 2) Use a 307 Temporary Redirect and let thttpd serve it. I tested this, and it works wonderfully. Thanks Christian! I'm still trying to figure out wh

Re: Logging user's movements

2005-02-05 Thread ben syverson
On Feb 5, 2005, at 5:38 PM, Perrin Harkins wrote: It sounds like the problem is not so much that mod_perl is serving cached HTML, since that is easily improved with a reverse proxy server, but rather that your entire cache gets invalidated whenever anyone creates a new node, and mod_perl has to

Re: Logging user's movements

2005-02-05 Thread Perrin Harkins
ben syverson wrote: The way the system works now, it is live. Every time a page is generated, it stores the most recent node ID along with the cached file. The next time the page is viewed, it checks to see what node is the most recent, and compares it against what was the newest when the file w

Re: Logging user's movements

2005-02-04 Thread Christian Hansen
ben syverson wrote: [...] The problem with this is that 99% of the time, the document won't contain any of the new node names, so mod_perl is wasting most of its time serving up cached HTML. I have two suggestions, 1) Use a reverse proxy/cache and send proper Cache-Control and Etag/Content-Lengt

Re: Logging user's movements

2005-02-04 Thread ben syverson
First of all, thanks for the suggestions, everyone! It's giving me a lot to chew on. I now realize (sound of hand smacking forehead) that the main problem is not the list of links and tracking users, but rather the inline Wiki links: On Feb 4, 2005, at 8:58 AM, Malcolm J Harwood wrote: What are

Re: AW: Logging user's movements

2005-02-04 Thread Leo Lapworth
On 4 Feb 2005, at 14:16, James Smith wrote: On Fri, 4 Feb 2005, Denis Banovic wrote: I have a very similar app running in mod_perl with about 1/2 mio hits a day. I need to do some optimisation, so I'm just interessted what optimisations that you are using brought you the best improvements. Was it

Re: Logging user's movements

2005-02-04 Thread Malcolm J Harwood
On Friday 04 February 2005 3:13 am, ben syverson wrote: > I'm curious how the "pros" would approach an interesting system design > problem I'm facing. I'm building a system which keeps track of user's > movements through a collection of information (for the sake of > argument, a Wiki). For example

Re: AW: Logging user's movements

2005-02-04 Thread James Smith
TECTED] > Gesendet: Freitag, 4. Februar 2005 10:37 > An: ben syverson > Cc: modperl@perl.apache.org > Betreff: Re: Logging user's movements > > > H > On 4 Feb 2005, at 08:13, ben syverson wrote: > > > Hello, > > > > I'm curious how the "pros

AW: Logging user's movements

2005-02-04 Thread Denis Banovic
EMAIL PROTECTED] Gesendet: Freitag, 4. Februar 2005 10:37 An: ben syverson Cc: modperl@perl.apache.org Betreff: Re: Logging user's movements H On 4 Feb 2005, at 08:13, ben syverson wrote: > Hello, > > I'm curious how the "pros" would approach an interesting system design

Re: Logging user's movements

2005-02-04 Thread Leo Lapworth
H On 4 Feb 2005, at 08:13, ben syverson wrote: Hello, I'm curious how the "pros" would approach an interesting system design problem I'm facing. I'm building a system which keeps track of user's movements through a collection of information (for the sake of argument, a Wiki). For example, if

Logging user's movements

2005-02-04 Thread ben syverson
Hello, I'm curious how the "pros" would approach an interesting system design problem I'm facing. I'm building a system which keeps track of user's movements through a collection of information (for the sake of argument, a Wiki). For example, if John moves from the "dinosaur" page to the "bird"