On Thu, May 6, 2010 at 1:40 PM, Ross <scrodch...@yahoo.ca> wrote: > Your thoughts appreciated. Is there a better way? I wouldn't want to > stuff the XML-file resident content into a database and rebuild the > XML element subsets because there are tons of files arriving and > disappearing and it would become a huge background activity for > another program.
if your XML docs are too transient, then it's not a job for a database. if you're getting repeated queries, or if several queries need some xml elements repeatedly, you could simply use a cache to avoid the repeats. If each xml element is used very few times, but you think a good proportion of them is going to be required before becoming outdated, then you could preprocess them as they arrive, instead of waiting for the request. i guess that processing a whole document would produce several results much faster than searching each individually. to avoid the load on a RDBMS, you might find better to store the preprocessed results on a key/value store, maybe even a memory-resident one, like redis. -- Javier -- You received this message because you are subscribed to the Google Groups "Django users" group. To post to this group, send email to django-us...@googlegroups.com. To unsubscribe from this group, send email to django-users+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/django-users?hl=en.
