[ceph-users] RadosGW Performance on Copy

Performance related data I found so far on RadosGW don't contain anything on Copy operation. Can anyone comment on the Copy operation? Is it basically just a GET + INSERT? Thanks, Eric ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.

Re: [ceph-users] RadosGW performance degradation on the 18 millions objects stored.

On 09/13/2016 08:17 AM, Stas Starikevich wrote: Hi All, Asking your assistance with the RadosGW performance degradation on the 18M objects placed (http://pasteboard.co/g781YI3J.png). Drops from 620 uploads\s to 180-190 uploads\s. I made list of tests and see that upload performance degrades i

[ceph-users] RadosGW performance degradation on the 18 millions objects stored.

Hi All, Asking your assistance with the RadosGW performance degradation on the 18M objects placed (http://pasteboard.co/g781YI3J.png ). Drops from 620 uploads\s to 180-190 uploads\s. I made list of tests and see that upload performance degrades in 3-4 times wh

[ceph-users] Radosgw performance degradation

Hi guys. I am currently encountering strange problem with radosgw. My setup is: 3 mons, 40OSD 4Tb hdd + 8G SSD journal each on 4 servers and 2 RGW. I have rgw_override_bucket_index_max_shards = 2048 in config and 100 buckets with ~3M objects each. Objects are relatively small: from 1k to 100k. S

Re: [ceph-users] RadosGW performance s3 many objects

Wade, I'm having the same problem as you do. We have currently 5+ million objects in a bucket and it is not even sharded, so we observe many problems with that. Did you manage to test RGW with tons of files? 2016-05-24 2:45 GMT+03:00 Wade Holler : > We (my customer ) are trying to test at Jewell

Re: [ceph-users] RadosGW performance s3 many objects

We (my customer ) are trying to test at Jewell now but I can say that the above behavior was also observed by my customer at Infernalis. After 300 million or so objects in a single bucket the cluster basically fell down as described above. Few hundred osds in this cluster. We are concerned that thi

Re: [ceph-users] RadosGW performance s3 many objects

Hello Guys Is several millions of object with Ceph ( for RGW use case ) still an issue ? Or is it fixed ? Thnx Vickey On Thu, Jan 28, 2016 at 12:55 AM, Krzysztof Księżyk wrote: > Stefan Rogge writes: > > > > > > > Hi, > > we are using the Ceph with RadosGW and S3 setting. > > With more and m

Re: [ceph-users] RadosGW performance s3 many objects

Stefan Rogge writes: > > > Hi, > we are using the Ceph with RadosGW and S3 setting. > With more and more objects in the storage the writing speed slows down significantly. With 5 million object in the storage we had a writing speed of 10MS/s. With 10 million objects in the storage its only 5M

Re: [ceph-users] RadosGW performance s3 many objects

On Sun, 2016-01-24 at 13:44 +0100, Stefan Rogge wrote: > Hi, > we are using the Ceph with RadosGW and S3 setting. > With more and more objects in the storage the writing speed slows down > significantly. With 5 million object in the storage we had a writing > speed of 10MS/s. With 10 million obj

[ceph-users] RadosGW performance s3 many objects

Hi,we are using the Ceph with RadosGW and S3 setting.With more and more objects in the storage the writing speed slows down significantly. With 5 million object in the storage we had a writing speed of 10MS/s. With 10 million objects in the storage its only 5MB/s. Is this a common issue?Is the

[ceph-users] RadosGW Performance

I'm trying to evaluate various object stores/distributed file systems for use in our company and have a little experience of using Ceph in the past. However I'm running into a few issues when running some benchmarks against RadosGW. Basically my script is pretty dumb, but it captures one of our p

Re: [ceph-users] radosgw performance with small files

My hardware setup One OSD host - EL6 - 10 spinning disks with configuration - sda (hpsa0): 450GB (0%) RAID-0 == 1 x 450GB 15K SAS/6 - 31GB Memory - 1Gb/s ethernet line Monitor and gateway hosts have the same configuration with just one disk. I am benchmarking newstore performance

Re: [ceph-users] radosgw performance with small files

On 05/19/2015 11:31 AM, Srikanth Madugundi wrote: Hi, I am seeing write performance hit with small files (60K) using radosgw. The radosgw is configured to run with 600 threads. Here is the write speed I get with file sizes of 60K # sudo ceph -s cluster e445e46e-4d84-4606-9923-16fff64446dc

[ceph-users] radosgw performance with small files

Hi, I am seeing write performance hit with small files (60K) using radosgw. The radosgw is configured to run with 600 threads. Here is the write speed I get with file sizes of 60K # sudo ceph -s cluster e445e46e-4d84-4606-9923-16fff64446dc health HEALTH_OK monmap e1: 1 mons at {osd

Re: [ceph-users] [RadosGW] Performance for Concurrency Connections

try >> connecting through the admin socket of the corresponding osds, see >> what are the specific requests to these osds that thrash. You could >> try to use also the radosgw admin socket (if you manage to set it up). >> >> Yehuda >> >> > >> >&g

Re: [ceph-users] [RadosGW] Performance for Concurrency Connections

hat thrash. You could > try to use also the radosgw admin socket (if you manage to set it up). > > Yehuda > > > > >> -Original Message- > >> From: Yehuda Sadeh [mailto:yeh...@inktank.com] > >> Sent: Donnerstag, 12. September 2013 06:38 > >> To:

Re: [ceph-users] [RadosGW] Performance for Concurrency Connections

ests to these osds that thrash. You could try to use also the radosgw admin socket (if you manage to set it up). Yehuda > >> -Original Message- >> From: Yehuda Sadeh [mailto:yeh...@inktank.com] >> Sent: Donnerstag, 12. September 2013 06:38 >> To: Kuo Hugo >>

Re: [ceph-users] [RadosGW] Performance for Concurrency Connections

.com > Subject: Re: [ceph-users] [RadosGW] Performance for Concurrency > Connections > > On Wed, Sep 11, 2013 at 9:34 PM, Kuo Hugo wrote: > > Hi Yehuda, > > > > Here's my ceph.conf > > > > root@p01:/tmp# cat /etc/ceph/ceph.conf [global] fsid = >

Re: [ceph-users] [RadosGW] Performance for Concurrency Connections

Thanks, I'll disable it later. perhaps that's related to another problem I had here. By my network topology plan. I expect that the max bandwidth could reach to 10Gb. I double checked every connection in this cluster by iperf. *[Iperf]* >From BM to RadosGW local 192.168.2.51 port 5001 connected

Re: [ceph-users] [RadosGW] Performance for Concurrency Connections

On Wed, Sep 11, 2013 at 10:37 PM, Kuo Hugo wrote: > Yes. I restart it by /etc/init.d/radosgw for times before. :D > > btw, I check several things here to prevent any permission issue. > > root@p01:/var/run# /etc/init.d/radosgw start > Starting client.radosgw.gateway... > root@p01:/var/run# ps aux

Re: [ceph-users] [RadosGW] Performance for Concurrency Connections

Yes. I restart it by /etc/init.d/radosgw for times before. :D btw, I check several things here to prevent any permission issue. root@p01:/var/run# /etc/init.d/radosgw start Starting client.radosgw.gateway... root@p01:/var/run# ps aux | grep rados root 25823 1.8 0.0 16436340 7096 ? Ss

Re: [ceph-users] [RadosGW] Performance for Concurrency Connections

On Wed, Sep 11, 2013 at 10:25 PM, Kuo Hugo wrote: > > thanks > > 1) I'm sure there's no asok socket filer for the radosgw in my RadosGW host. > 2) The rgw_thread_pool_size was set to 200 in my ceph.conf. So that the > radosgw is using the value now generally. > 3) If so, the tweaking of rgw_thread

Re: [ceph-users] [RadosGW] Performance for Concurrency Connections

thanks 1) I'm sure there's no asok socket filer for the radosgw in my RadosGW host. 2) The rgw_thread_pool_size was set to 200 in my ceph.conf. So that the radosgw is using the value now generally. 3) If so, the tweaking of rgw_thread_pool_size value from 100->200 was not help for improve the perf

Re: [ceph-users] [RadosGW] Performance for Concurrency Connections

On Wed, Sep 11, 2013 at 9:57 PM, Kuo Hugo wrote: > Hmm Interesting now. > > I have no admin socket opened around. Maybe your radosgw process doesn't have permissions to write into /var/run/ceph? > > root@p01:/var/run/ceph# ls /var/run/ceph -al > total 0 > drwxr-xr-x 2 root root 40 Sep 9 0

Re: [ceph-users] [RadosGW] Performance for Concurrency Connections

Hmm Interesting now. I have no admin socket opened around. root@p01:/var/run/ceph# ls /var/run/ceph -al total 0 drwxr-xr-x 2 root root 40 Sep 9 07:47 . drwxr-xr-x 17 root root 600 Sep 11 21:23 .. root@p01:/var/run/ceph# lsof | grep radosgw.asok root@p01:/var/run/ceph# I review the on-line

Re: [ceph-users] [RadosGW] Performance for Concurrency Connections

On Wed, Sep 11, 2013 at 9:34 PM, Kuo Hugo wrote: > Hi Yehuda, > > Here's my ceph.conf > > root@p01:/tmp# cat /etc/ceph/ceph.conf > [global] > fsid = 6e05675c-f545-4d88-9784-ea56ceda750e > mon_initial_members = s01, s02, s03 > mon_host = 192.168.2.61,192.168.2.62,192.168.2.63 > auth_supported = cep

Re: [ceph-users] [RadosGW] Performance for Concurrency Connections

Hi Yehuda, Here's my ceph.conf root@p01:/tmp# cat /etc/ceph/ceph.conf [global] fsid = 6e05675c-f545-4d88-9784-ea56ceda750e mon_initial_members = s01, s02, s03 mon_host = 192.168.2.61,192.168.2.62,192.168.2.63 auth_supported = cephx osd_journal_size = 1024 filestore_xattr_use_omap = true [client.

Re: [ceph-users] [RadosGW] Performance for Concurrency Connections

On Wed, Sep 11, 2013 at 7:57 AM, Kuo Hugo wrote: > > Hi Yehuda, > > I tried ... a question for modifying param. > How to make it effect to the RadosGW ? is it by restarting radosgw ? > The value was set to 200. I'm not sure if it's applied to RadosGW or not. > > Is there a way to check the runti