Shannon Dealy <de...@deatech.com> writes:
> I installed python-dugong from experimental and proceeded to transfer
> a lot of data to my S3 file system.  Stopped it a couple of times,
> unmounted once (successfully), remounted and continued transferring
> data.  After around 13-15 GB total had been uploaded, the file system
> crashed again (no hang):
[...]
>
> See attached mount log file for more details.
>
[...]
> 2014-12-05 00:18:35.346 31446:Thread-3 (name)s.wrapped: Encountered 
> DNSUnavailable exception (Unable to resolve 
> server-external-2014-11-21-deatech-com-s3ql.s3.amazonaws.com, DNS server 
> unavailable.), retrying call to ObjectW.close for the 3-th time...
[...]
>   File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 1449, in 
> create_socket
>     raise HostnameNotResolvable(address[0])
> dugong.HostnameNotResolvable: Host 
> server-external-2014-11-21-deatech-com-s3ql.s3.amazonaws.com does not have 
> any ip addresses


Unfortunately Linux does not provide an easy way to distinguish between
an unavailable DNS server, and an un-resolvable host name. To
distinguish these cases, S3QL/Dugong attempts to resolve a number of
"test" hostnames. If these resolve, but the S3 hostname does not,
S3QL/Dugong concludes that this hostname is not resolvable and
terminates. Otherwise it assumes that the DNS server is currently not
reachable and retries.

Attempting to resolve hostnames on your system frequently fails
(sometimes 3 times in a row), and sometimes it's apparently sufficiently
flaky that

1. server-external-2014-11-21-deatech-com-s3ql.s3.amazonaws.com cannot
be resolved

2. Any of google.com, iana.org, or root-servers.net can be resolved

3. server-external-2014-11-21-deatech-com-s3ql.s3.amazonaws.com cannot
be resolved

in this order, and without any waiting times.


At this point, S3QL thus assumes that your bucket ceased to exist and
terminates. 

To avoid this, you'll have to fix the DNS resolution issues on your
system. Maybe install a caching proxy nameserver like dnsmasq?

Best,
-Nikolaus
-- 
GPG encrypted emails preferred. Key id: 0xD113FCAC3C4E599F
Fingerprint: ED31 791B 2C5C 1613 AF38 8B8A D113 FCAC 3C4E 599F

             »Time flies like an arrow, fruit flies like a Banana.«


--
To UNSUBSCRIBE, email to debian-bugs-dist-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org

Reply via email to