Re: [GENERAL] Understanding Postgres Memory Usage

2016-09-08 Thread Theron Luhn
I've done the upgrade to 9.5. Memory bloat has reduced to a more manageable level. Most workers have an overhead of <20MB, with one outlier consuming 60MB. — Theron On Fri, Aug 26, 2016 at 5:41 AM, Tom Lane wrote: > Theron Luhn writes: > > Okay, I got a semi-repro

Re: [GENERAL] Understanding Postgres Memory Usage

2016-08-25 Thread Theron Luhn
it, I could probably find another test case. — Theron On Thu, Aug 25, 2016 at 5:27 PM, Tom Lane wrote: > Theron Luhn writes: > > Okay, here's the output: > > https://gist.github.com/luhn/a39db625ba5eed90946dd4a196d12220 > > Hm, well the only thing there that looks even

Re: [GENERAL] Understanding Postgres Memory Usage

2016-08-25 Thread Theron Luhn
Hi Ilya, > Are you talking about buffers/cache increased? AFAIK this memory is used by kernel as buffer before any block device (HDD for example). If I'm reading the output correctly, buffers/cached do not increase. I'm looking at the 248MB -> 312MB under the "used" column in the "-/+ buffers/ca

Re: [GENERAL] Understanding Postgres Memory Usage

2016-08-25 Thread Theron Luhn
Okay, here's the output: https://gist.github.com/luhn/a39db625ba5eed90946dd4a196d12220 — Theron On Thu, Aug 25, 2016 at 12:34 PM, Tom Lane wrote: > Theron Luhn writes: > >> It would be worth using plain old top to watch this process. We have > >> enough experie

Re: [GENERAL] Understanding Postgres Memory Usage

2016-08-25 Thread Theron Luhn
3#file-top-txt RES - SHR is showing a similar increase to what smem is reporting. — Theron On Thu, Aug 25, 2016 at 11:25 AM, Tom Lane wrote: > Theron Luhn writes: > >> If it's not an outright leak, it's probably consumption of cache space. > >> We cache stuff that

Re: [GENERAL] Understanding Postgres Memory Usage

2016-08-25 Thread Theron Luhn
rtain point but then plateaus. So... cache? It's ~100MB increase, though, which seems an excessive amount. What could be taking up that much cache? — Theron On Thu, Aug 25, 2016 at 9:27 AM, Tom Lane wrote: > Theron Luhn writes: > > I have an application that uses Postgres 9.3 as

[GENERAL] Understanding Postgres Memory Usage

2016-08-25 Thread Theron Luhn
I have an application that uses Postgres 9.3 as the primary datastore. Like any real-life application, it's not all roses—There are many ugly, convoluted, and inefficient queries. Some of these queries use quite a bit of memory. I've observed a "high-water mark" behavior in memory usage: running

[GENERAL] Full-text search: Problems with dictionaries and periods

2012-08-10 Thread Theron Luhn
I made a custom synonym dictionary for my full-text search, using the following code from the documentation. CREATE TEXT SEARCH DICTIONARY my_synonym ( TEMPLATE = synonym, SYNONYMS = my_synonyms ); ALTER TEXT SEARCH CONFIGURATION english ALTER MAPPING FOR asciiword WITH my_synonym, en