Thanks for the reminder about the thread. I had read the initial couple of posts but hadn't noticed the follow-ups.
My procedure is pretty straightforward, and is similar to the "fast" one described: Kick off a task that does a keys-only query for n items and then deletes them (using the form where you just pass a list of keys), grabs the cursor, and kicks off another task that pulls in the cursor and gets n more, and so on. (I forget the value of n.) I don't know exactly how many items were being deleted, but I've got ~7.5 million entries in total, spread from July to today. Probably our largest number of entries actually comes from August, but I was just deleting July. So I guess "few hundred thousand" isn't accurate, and it was probably closer to 1-2 million. Hm. But reading that Bulk Delete thread, I agree it would be nice to mark an item as deletable and have some cheaper, belly-of-Google task sweep through them. Derrick On Sat, Nov 20, 2010 at 8:55 PM, Stephen Johnson <[email protected]>wrote: > Read post Bulk Deletion Woe that was posted this past week. It discusses > this. You should add what procedure you did to delete your entities, how > many etc. > > On Sat, Nov 20, 2010 at 9:21 PM, Derrick Schneider < > [email protected]> wrote: > >> One thing I've noticed as I'm purging older items in the datastore is that >> deletes are really CPU intensive. Granted, I was probably deleting a few >> hundred thousand entries, but I went from well under my free CPU threshold >> for the day to burning out the rest of our budgeted 14.5 hours over the >> course of about 40 minutes. >> >> Has anyone else noticed this? >> >> Derrick >> >> -- >> Writer. Programmer. Puzzle Designer. >> http://www.obsessionwithfood.com >> >> -- >> You received this message because you are subscribed to the Google Groups >> "Google App Engine" group. >> To post to this group, send email to [email protected]. >> To unsubscribe from this group, send email to >> [email protected]<google-appengine%[email protected]> >> . >> For more options, visit this group at >> http://groups.google.com/group/google-appengine?hl=en. >> > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to [email protected]. > To unsubscribe from this group, send email to > [email protected]<google-appengine%[email protected]> > . > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > -- Writer. Programmer. Puzzle Designer. http://www.obsessionwithfood.com -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
