These are now fixed.
The problem started when I downsized the EC2 instance the download stats run on
from t2.medium to t2.small. The machine was I/O bound and the scripts did not
have enough time to complete before the next one started.
The 't' family of instances run on shared hardware and it's well documented
that they are burstable wrt CPU usage. In general, IOPs are determined by the
size and type of EBS back-end storage so I did not expect to see a difference
in IOPs when changing the instance type (EBS back-end was untouched). After
some digging, it appears AWS is also limiting disk I/O for this family because
it is a shared instance. Network throughput is throttled in a manner similar to
how they throttle CPU usage. So in this case it looks like it's the instance
type and not the back-end storage causing the problem.
AWS is ambiguous about network throughput for the 't' family stating only High,
Medium and Low instead of providing numbers. Finding the right combination of
minimal but sufficient resources can be a challenge. The download stats should
once again have the resources they need. Sorry for any inconvenience this
switch around caused.
Valerie
On 08/04/2017 10:28 AM, Obenchain, Valerie wrote:
Download stats have not updated for some time. I'm looking into this and hope
to have it sorted out soon.
Valerie
This email message may contain legally privileged and/or confidential
information. If you are not the intended recipient(s), or the employee or
agent responsible for the delivery of this message to the intended
recipient(s), you are hereby notified that any disclosure, copying,
distribution, or use of this email message is prohibited. If you have received
this message in error, please notify the sender immediately by e-mail and
delete this email message from your computer. Thank you.
[[alternative HTML version deleted]]
_______________________________________________
Bioc-devel@r-project.org<mailto:Bioc-devel@r-project.org> mailing list
https://stat.ethz.ch/mailman/listinfo/bioc-devel
This email message may contain legally privileged and/or confidential
information. If you are not the intended recipient(s), or the employee or
agent responsible for the delivery of this message to the intended
recipient(s), you are hereby notified that any disclosure, copying,
distribution, or use of this email message is prohibited. If you have received
this message in error, please notify the sender immediately by e-mail and
delete this email message from your computer. Thank you.
[[alternative HTML version deleted]]
_______________________________________________
Bioc-devel@r-project.org mailing list
https://stat.ethz.ch/mailman/listinfo/bioc-devel
