[ceph-users] Memory usage of librados

2013-12-24 Thread Potapov Sergey
Hi! I`am accessing to Ceph cluster via librados and found that memory usage (VSZ in ps) is extremely increases on writing/reading/removing objects. If I successively write+read+remove the object with the same name, then memory usage is not increased, but if I do the same operations with the dif

Re: [ceph-users] Upcoming Erasure coding

2013-12-24 Thread Mark Kirkwood
On 25/12/13 04:33, Loic Dachary wrote: On 24/12/2013 10:22, Wido den Hollander wrote: IIRC Erasure Encoding doesn't work well with RBD, if it even works at all due to the fact that you can't update a object, but you have to completely rewrite the whole object. So Erasure encoding works gre

Re: [ceph-users] [RadosGW] Does your RadosGW capable to handle 500+ concurrency connections?

2013-12-24 Thread Yehuda Sadeh
On Tue, Dec 24, 2013 at 8:16 AM, Kuo Hugo wrote: > Hi folks, > > After some more tests. I can not addressed the bottleneck currently. Never > hit CPU bound. > > > OSD op threads : 60 > rgw_thread_pool_size : 300 > pg = 2000 > pool size = 3 > > Try to find the max concurrency of 1KB write of this c

Re: [ceph-users] [RadosGW] Does your RadosGW capable to handle 500+ concurrency connections?

2013-12-24 Thread Kuo Hugo
Hi folks, After some more tests. I can not addressed the bottleneck currently. Never hit CPU bound. OSD op threads : 60 rgw_thread_pool_size : 300 pg = 2000 pool size = 3 Try to find the max concurrency of 1KB write of this cluster Rados bench 1000~5000+ about 3000 reqs/sec mon.0 [INF] 2053 k

Re: [ceph-users] Upcoming Erasure coding

2013-12-24 Thread Loic Dachary
On 24/12/2013 10:22, Wido den Hollander wrote: > On 12/24/2013 09:34 AM, Christian Balzer wrote: >> >> Hello Loic, >> >> On Tue, 24 Dec 2013 08:29:38 +0100 Loic Dachary wrote: >> >>> >>> >>> On 24/12/2013 05:42, Christian Balzer wrote: Hello, from what has been written on the

Re: [ceph-users] Upcoming Erasure coding

2013-12-24 Thread Loic Dachary
On 24/12/2013 09:34, Christian Balzer wrote: > > Hello Loic, > > On Tue, 24 Dec 2013 08:29:38 +0100 Loic Dachary wrote: > >> >> >> On 24/12/2013 05:42, Christian Balzer wrote: >>> >>> Hello, >>> >>> from what has been written on the roadmap page and here, I assume that >>> the erasure coding o

Re: [ceph-users] Upcoming Erasure coding

2013-12-24 Thread Wido den Hollander
On 12/24/2013 09:34 AM, Christian Balzer wrote: Hello Loic, On Tue, 24 Dec 2013 08:29:38 +0100 Loic Dachary wrote: On 24/12/2013 05:42, Christian Balzer wrote: Hello, from what has been written on the roadmap page and here, I assume that the erasure coding option with Firefly will be (un

Re: [ceph-users] Upcoming Erasure coding

2013-12-24 Thread Christian Balzer
Hello Loic, On Tue, 24 Dec 2013 08:29:38 +0100 Loic Dachary wrote: > > > On 24/12/2013 05:42, Christian Balzer wrote: > > > > Hello, > > > > from what has been written on the roadmap page and here, I assume that > > the erasure coding option with Firefly will be (unsurprisingly) a pool > > o