[ceph-users] Re: MDS: obscene buffer_anon memory use when scanning lots of files

2020-05-29 Thread John Madden
quot;items": 50694, "bytes": 47343942094 } This is on a single active MDS with 2 standbys, scan for about a million files with about 20 parallel threads on two clients, open and read each if it exists. On Wed, Jan 22, 2020 at 8:25 AM John Madden wrote: > > > Couldn't

[ceph-users] MDS: obscene buffer_anon memory use when scanning lots of files (continued)

2020-02-11 Thread John Madden
Following the list migration I need to re-open this thread: http://lists.ceph.com/pipermail/ceph-users-ceph.com/2020-January/038014.html ... Upgraded to 14.2.7, doesn't appear to have affected the behavior. As requested: ~$ ceph tell mds.mds1 heap stats 2020-02-10 16:52:44.313 7fbda2cae700 0 c

[ceph-users] Re: MDS: obscene buffer_anon memory use when scanning lots of files

2020-02-19 Thread John Madden
Ah, no, I hadn't seen that. Patiently awaiting .8 then. Thanks! On Mon, Feb 17, 2020 at 8:52 AM Dan van der Ster wrote: > > On Mon, Feb 10, 2020 at 8:31 PM John Madden wrote: > > > > Upgraded to 14.2.7, doesn't appear to have affected the behavior. As > > requ

[ceph-users] Re: MDS: obscene buffer_anon memory use when scanning lots of files

2020-03-04 Thread John Madden
items": 27105, "bytes": 24262537939 } { "items": 33309, "bytes": 29754507505 } { "items": 36160, "bytes": 31803033733 } { "items": 56772, "bytes": 51062350351 } Is there further data/debug I can retrieve to help