Re: [ceph-users] Very slow S3 sync with big number of object.

2016-08-24 Thread jan hugo prins
Below is a part of a sync transfer. First it is fast, and then suddently it gets really slow. The stats for the bucket are: { "bucket": "testbucket", "pool": "nl.demo.rgw.buckets.data", "index_pool": "nl.demo.rgw.buckets.index", "id": "1adc4b51-3345-4a4b-bf6d-b5

[ceph-users] Very slow S3 sync with big number of object.

2016-08-23 Thread jan hugo prins
Hi, I'm testing S3 and I created a test where I sync a big part of my homedirectory, about 4GB of data in a lot of small objects, towards a S3 bucket. The first part of the sync was very fast but after some time it became a lot slower. What I basically see is this for every file: The file gets t