Hello, I wrote a PHP client script (using latest AWS S3 API lib) and this not solve my (hanging download) problem at all. So the problem not be in libs3/s3 tool. I changed MTU from 1500 to 9000 and back does not solved. Are there any apache (mpm-worker), fastcgi, rgw or librados tuning options to handle more concurrent download? (File sizes between 16K and 1024K).
Thank you, Mihaly 2013/9/17 Mihály Árva-Tóth <mihaly.arva-t...@virtual-call-center.eu> > Hello, > > I'm trying to download objects from one container (which contains 3 > million objects, file sizes between 16K and 1024K) parallel 10 threads. I'm > using "s3" binary comes from libs3. I'm monitoring download time, response > time of 80% lower than 50-80 ms. But sometimes download hanging up, up to > 17 secs; apache returns with error code 500. apache error log (lot of): > > [Tue Sep 17 11:33:11 2013] [error] [client 194.38.106.67] FastCGI: comm > with server "/var/www/radosgw.fcgi" aborted: idle timeout (30 sec) > [Tue Sep 17 11:33:11 2013] [error] [client 194.38.106.67] FastCGI: > incomplete headers (0 bytes) received from server "/var/www/radosgw.fcgi" > [Tue Sep 17 11:33:11 2013] [error] [client 194.38.106.67] Handler for > fastcgi-script returned invalid result code 1 > > I tried with native apache2/fastcgi ubuntu packages and Ceph built > apache2/fastcgi both. When I turn on "rgw print continue = true" with > modified build, the result is better very bit (less hungs). "FastCgiWrapper > Off" of course. > > And if I set parallel get requests only 3 (instead of 10) the result is > much better, the longest hang only 1500 ms. So I think this is depends with > some resource management. But I get no idea. > > Using ceph-0.67.4 with Ubuntu 12.04 x8_64. > > I found the following issue (more than 1 year): > http://tracker.ceph.com/issues/2027 > > But this closed with unable to reproduce. I can reproduce every time. > > Thank you, > Mihaly >
_______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
