Hello Anthony,

The replicated index pool has about 20TiB of free space and we are using Intel 
P5510 NVMe Enterprise SSDs so I guess the HW shouldn’t be the issue.

Yes, I’m able to change the timeout on our LB, but I’m not sure if I want to 
set it to 40minutes+…

Ondrej

> On 5. 2. 2024, at 20:09, Anthony D'Atri <anthony.da...@gmail.com> wrote:
> 
> Do you have sufficient capacity in the non-ec pool?  Is it on fast media?
> 
> You should be able to increase the timeout on your LB.
> 
>> On Feb 5, 2024, at 13:51, Ondřej Kukla <ond...@kuuk.la> wrote:
>> 
>> Hello,
>> 
>> For some time now I’m struggling with the time it takes to 
>> CompleteMultipartUpload on one of my rgw clusters.
>> 
>> I have a customer with ~8M objects in one bucket uploading quite a large 
>> files. From 100GB to like 800GB.
>> 
>> 
>> I’ve noticed when they are uploading ~200GB files that the requests started 
>> timeouting on a LB we have infront of the rgw.
>> 
>> When I’ve started going through the logs I’ve noticed that the 
>> CompleteMultipartUpload request took like 700s to finish. Which seemed 
>> ok-ish, but the number seem quite large.
>> 
>> However, when they started uploading 750GB files the time to complete the 
>> multipart upload ended around 2500s -> more than 40minutes which seems like 
>> a way to much.
>> 
>> 
>> Do you have a similar experience? Is there anything we can do to improve 
>> this? How much time does the CompleteMultipartUpload takes on your clusters?
>> 
>> The cluster is running on version 17.2.6.
>> 
>> Regards,
>> 
>> Ondrej
>> _______________________________________________
>> ceph-users mailing list -- ceph-users@ceph.io
>> To unsubscribe send an email to ceph-users-le...@ceph.io
> 
_______________________________________________
ceph-users mailing list -- ceph-users@ceph.io
To unsubscribe send an email to ceph-users-le...@ceph.io

Reply via email to