Re: [ceph-users] ceph program uses lots of memory

2017-01-03 Thread Bryan Henderson
I did some investigation and tracked the high usage down to librados. I don't think Python has anything to do with it. I also noticed that the memory usage was really unpredictable. Sometimes I could do a whole 'ceph -s' with only 256M; most of the time I couldn't, but the program crashed in var

Re: [ceph-users] ceph program uses lots of memory

2017-01-03 Thread Gregory Farnum
On Thu, Dec 29, 2016 at 2:31 PM, Bryan Henderson wrote: > Does anyone know why the 'ceph' program uses so much memory? If I run it with > an address space rlimit of less than 300M, it usually dies with messages about > not being able to allocate memory. > > I'm curious as to what it could be doin

Re: [ceph-users] ceph program uses lots of memory

2016-12-29 Thread David Turner
[ceph-users] ceph program uses lots of memory And we may be interested in your cluster's configuration. # ceph --show-config > $(hostname).$(date +%Y%m%d).ceph_conf.txt On Fri, Dec 30, 2016 at 7:48 AM, David Turner mailto:david.tur...@storagecraft.com>> wrote: Another thing that

Re: [ceph-users] ceph program uses lots of memory

2016-12-29 Thread Shinobu Kinjo
And we may be interested in your cluster's configuration. # ceph --show-config > $(hostname).$(date +%Y%m%d).ceph_conf.txt On Fri, Dec 30, 2016 at 7:48 AM, David Turner wrote: > Another thing that I need to make sure on is that your number of PGs in > the pool with 90% of the data is a power o

Re: [ceph-users] ceph program uses lots of memory

2016-12-29 Thread David Turner
Another thing that I need to make sure on is that your number of PGs in the pool with 90% of the data is a power of 2 (256, 512, 1024, 2048, etc). If that is the case, then I need the following information. 1) Pool replica size 2) The number of the pool with the data 3) A copy of your osdmap (c