Reading more it sounds like the memory usage issue, particularly for those exploring Webfaction, is a typical rite of passage, and probably has more to do with httpdconf and mod_wsgi setup than it does with Django practices. Lots of discussion <a href ="http:// groups.google.ca/group/django-users/browse_thread/thread/ 2a82a6e2f0e457a5/b4d490773fddfe67?hl=en&lnk=gst&q=memory +usage#b4d490773fddfe67"> here.</a> (I hope this forum allows html, otherwise that's a messy link :)
On May 6, 3:14 pm, Javier Guerra Giraldez <jav...@guerrag.com> wrote: > On Thu, May 6, 2010 at 1:40 PM, Ross <scrodch...@yahoo.ca> wrote: > > Your thoughts appreciated. Is there a better way? I wouldn't want to > > stuff the XML-file resident content into a database and rebuild the > > XML element subsets because there are tons of files arriving and > > disappearing and it would become a huge background activity for > > another program. > > if your XML docs are too transient, then it's not a job for a > database. if you're getting repeated queries, or if several queries > need some xml elements repeatedly, you could simply use a cache to > avoid the repeats. > Thanks for the concurrence. You're prob right. I'll have to look into caching, but the recurrence of the same slice of the XML file could be fairly infrequent. But it's worth looking into. > If each xml element is used very few times, but you think a good > proportion of them is going to be required before becoming outdated, > then you could preprocess them as they arrive, instead of waiting for > the request. i guess that processing a whole document would produce > several results much faster than searching each individually. to > avoid the load on a RDBMS, you might find better to store the > preprocessed results on a key/value store, maybe even a > memory-resident one, like redis. > Yes, there might be some opportunity to pre-process as a backend process. Will keep that in mind as an option. > -- > Javier > -- You received this message because you are subscribed to the Google Groups "Django users" group. To post to this group, send email to django-us...@googlegroups.com. To unsubscribe from this group, send email to django-users+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/django-users?hl=en.
