Hi all, i'm wondering if anyone has thoughts on how memory management works with regards to the the DAL and GAE.
i have some "taskqueue" tasks on GAE that are invoked via GAE cron to aggregate data for me on a daily basis. these operations can work on 500 or more records per invocation. sometimes i get messages in my logs like: Exceeded soft process size limit with 211.586 MB after servicing 1 requests total now i know i do a big query, but at the end of the request that object should go out of scope and be destroyed right? and why would 500 records take up that much space? are there technniques that i can use to not take up that much ram (other than query smaller sets, which doesn't seem to help if i do 5 queries of 100 and it takes more time) thanks for your thoughts! christian