Re: [ceph-users] Jewel Multisite RGW Memory Issues

2016-07-08 Thread Ben Agricola
es of the files in one of the buckets - probably 5000 lines total. The OP of the request that generated the bucket list was was '25RGWListBucket_ObjStore_S3', and appears to have been made by one of the RGW nodes in the other site. Any ideas? Ben. On Mon, 27 Jun 2016 at 10:47 Ben Agri

Re: [ceph-users] Jewel Multisite RGW Memory Issues

2016-06-27 Thread Ben Agricola
start back up and normal memory usage resumes. Cheers, Ben. On Mon, 27 Jun 2016 at 10:39 Ben Agricola wrote: > Hi Pritha, > > > At the time, the 'primary' cluster (i.e. the one with the active data set) > was receiving backup files from a small number of machines, prio

Re: [ceph-users] Jewel Multisite RGW Memory Issues

2016-06-27 Thread Ben Agricola
Hi Pritha, At the time, the 'primary' cluster (i.e. the one with the active data set) was receiving backup files from a small number of machines, prior to replication being enabled it was using ~10% RAM on the RadosGW boxes. Without replication enabled, neither cluster sees any spikes in memor

[ceph-users] Jewel Multisite RGW Memory Issues

2016-06-20 Thread Ben Agricola
I have 2 distinct clusters configured, in 2 different locations, and 1 zonegroup. Cluster 1 has ~11TB of data currently on it, S3 / Swift backups via the duplicity backup tool - each file is 25Mb and probably 20% are multipart uploads from S3 (so 4Mb stripes) - in total 3217kobjects. This cluster