in case it affects anyone else, one line fixes it:
Index: google/appengine/tools/bulkloader.py
===================================================================
--- google/appengine/tools/bulkloader.py (revision 142)
+++ google/appengine/tools/bulkloader.py (working copy)
@@ -698,6 +698,8 @@
transfer_time)
sys.stdout.write('.')
sys.stdout.flush()
+ # Since we had at least one successful transfer, we could
assume DNS errors are transient
+ non_fatal_error_codes.add(-2)
status = adaptive_thread_pool.WorkItem.SUCCESS
if transfer_time <= MAXIMUM_INCREASE_DURATION:
instruction = adaptive_thread_pool.ThreadGate.INCREASE
BTW, is there a nice constant for this kind of error? Adding a -2 to
the set seems dirty, to say the least.
2011/1/22 Ricardo Bánffy <[email protected]>:
> Hi.
>
> I have been, for the past couple days, to download data from the live
> app to my local development copy. Every time, sometimes a couple hours
> and gigabytes into the download, I get a
>
> .................[INFO ] An error occurred. Shutting down...
> ..[ERROR ] Error in Thread-8: <urlopen error (-2, 'Name or service
> not known')>
>
> [INFO ] Have 210 entities, 0 previously transferred
> [INFO ] 210 entities (2145028 bytes) transferred in 54.4 seconds
>
> message.
>
> I assume a try/except with a couple retries around it would fix the
> problem - as it looks like a transient DNS failure - and I'll dig
> deeper into appcfg.py's code tomorrow in order to fix this, but,
> before I do, has anyone fixed this before?
>
> BTW, I'm running 1.4.1 on Ubuntu 10.10 with a built-from-sources
> Python 2.5.5 (Ubuntu doesn't package it anymore).
--
Ricardo Bánffy
http://www.dieblinkenlights.com
http://twitter.com/rbanffy
--
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To post to this group, send email to [email protected].
To unsubscribe from this group, send email to
[email protected].
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
