In my experience, the reliability of URLFetch is rock-solid. The problem is the external server that you're connecting to. The external server can be relatively fast to respond (many web APIs, such as Google's goo.gl shortener and so forth) or relatively slow and error-prone (the Reddit API in particular is just absolutely terrible to access from AppEngine; since all GAE urlfetches come from the same pool of IPs, the Reddit servers deliberately throttle requests because they think all of the requests are coming from a single poorly-behaved app, not multiple apps. And no, the reddit api does not offer oauth or similar authentication).
There's a couple of ways to mitigate this; you can use task queues to keep retrying a urlfetch, backends to continuously urlfetch and cache the results, find a different 3rd party service, etc. -Vinny P On Thursday, October 25, 2012 11:58:26 AM UTC-5, Joshua Smith wrote: > > I use the python version, and get a couple failures a day. The easy answer > is to treat it just like mail: always use a task, so that if it fails, it > will retry. > > On Oct 25, 2012, at 12:12 PM, Deepak Singh > <[email protected]<javascript:>> > wrote: > > Hi Alll, > > I want to discuss here your experience about GAE Java URLFetchService. > > We are using async feature of this service to retrieve data from 3rd party > servers and our business mainly depends on the data received from their > servers. > I observe that UrlFetch fails many times with java.io exception and thus > we lose our business. > > So i would like to know your experience about its reliability, > DeadlineExceededException cases, ways to handle it and all. > > Let us know how reliable is URLFetchService(GAE Java) ? > > Regards > Deepak Singh > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to [email protected]<javascript:> > . > To unsubscribe from this group, send email to > [email protected] <javascript:>. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > > > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/RgAEOStwEtMJ. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
