Postgers 9.3 - ubuntu 16.04 - Are clogs entires automatically deleted?

2019-07-18 Thread Cumer Cristiano
Hi List, Today I wanted to dump a database but pg_dump is complaining about missing clog files. I’m quite sure that nobody has deleted the files and that my filesystem is consistent. If I look in my clog directory I can see the files starting from 0013. The first ones are missing. I have check

Re: Postgers 9.3 - ubuntu 16.04 - Are clogs entires automatically deleted?

2019-07-18 Thread Luca Ferrari
On Thu, Jul 18, 2019 at 10:34 AM Cumer Cristiano wrote: > Today I wanted to dump a database but pg_dump is complaining about missing > clog files. > I’m quite sure that nobody has deleted the files and that my filesystem is > consistent. > > If I look in my clog directory I can see the files sta

Rearchitecting for storage

2019-07-18 Thread Matthew Pounsett
I've recently inherited a database that is dangerously close to outgrowing the available storage on its existing hardware. I'm looking for (pointers to) advice on scaling the storage in a financially constrained not-for-profit. The current size of the DB's data directory is just shy of 23TB. Whe

PostgreSQL as a Service

2019-07-18 Thread Dirk Riehle
Hello everyone! tl;dr: How well is PostgreSQL positioned to serve as the database of choice for a DBaaS operator? Specifically, how much open source is (may be) missing? Im un-lurking hoping to learn more about PostgreSQL in DBaaS land. You may have seen this announcement. https://blog

Re: Postgers 9.3 - ubuntu 16.04 - Are clogs entires automatically deleted?

2019-07-18 Thread Adrian Klaver
On 7/18/19 1:34 AM, Cumer Cristiano wrote: Hi List, Today I wanted to dump a database but pg_dump is complaining about missing clog files. I’m quite sure that nobody has deleted the files and that my filesystem is consistent. What is the exact message you get? What is the full version of Po

Re: PostgreSQL as a Service

2019-07-18 Thread Achilleas Mantzios
On 18/7/19 5:23 μ.μ., Dirk Riehle wrote: Hello everyone! tl;dr: How well is PostgreSQL positioned to serve as the database of choice for a DBaaS operator? Specifically, how much open source is (may be) missing? Im un-lurking hoping to learn more about PostgreSQL in DBaaS land. You may h

Re: PostgreSQL as a Service

2019-07-18 Thread Adrian Klaver
On 7/18/19 7:23 AM, Dirk Riehle wrote: Hello everyone! tl;dr: How well is PostgreSQL positioned to serve as the database of choice for a DBaaS operator? Specifically, how much open source is (may be) missing? Im un-lurking hoping to learn more about PostgreSQL in DBaaS land. You may h

Re: Corrupt index stopping autovacuum system wide

2019-07-18 Thread Aaron Pelz
> Can you tell us more about this index? Can you share its definition > (i.e. what does \d show in psql)? > Is it an expression index, or a partial index? A composite? What > datatypes are indexed? It's a simple btree expression on a geometry(Point,4326) , no expression no partial no composite.

Re: PostgreSQL as a Service

2019-07-18 Thread Dirk Riehle
Thanks for the pointer to BDR! As to CitusData, you are right. The Microsoft acquisition does not seem to have led to absorption. Rather, it remains an open core play. This also means its DBaaS layer is not open source. Cheers, Dirk On Thu, Jul 18, 2019, 16:50 Achilleas Mantzios wrote: > On 18

Re: Corrupt index stopping autovacuum system wide

2019-07-18 Thread Peter Geoghegan
On Thu, Jul 18, 2019 at 9:06 AM Aaron Pelz wrote: > It's a simple btree expression on a geometry(Point,4326) , no expression no > partial no composite. The cause of the corruption may be a bug in a Postgis B-Tree operator class. I reported a bug in the Geography type that could lead to corrupt B

Re: PostgreSQL as a Service

2019-07-18 Thread Adrian Klaver
On 7/18/19 9:06 AM, Dirk Riehle wrote: Please reply to list also. Ccing list. On Thu, Jul 18, 2019, 16:56 Adrian Klaver > wrote: > So, back to my main question above. If I wanted to run a DBaaS shop with > only PostgreSQL open source, how far a

Re: Rearchitecting for storage

2019-07-18 Thread Kenneth Marshall
Hi Matt, On Thu, Jul 18, 2019 at 09:44:04AM -0400, Matthew Pounsett wrote: > I've recently inherited a database that is dangerously close to outgrowing > the available storage on its existing hardware. I'm looking for (pointers > to) advice on scaling the storage in a financially constrained > no

Possible Values of Command Tag in PG Log file

2019-07-18 Thread Kumar, Virendra
Hello Team, Can somebody redirect me to document which lists all possible value of command tag in instance log of PostgreSQL instance. Regards, Virendra This message is intended only for the use of the addressee and may contain information that is PRIVILEGED AN

Re: Rearchitecting for storage

2019-07-18 Thread Matthew Pounsett
On Thu, 18 Jul 2019 at 13:34, Kenneth Marshall wrote: > Hi Matt, > Hi! Thanks for your reply. > Have you considered using the VDO compression for tables that are less > update intensive. Using just compression you can get almost 4X size > reduction. For a database, I would forgo the deduplica

Re: Corrupt index stopping autovacuum system wide

2019-07-18 Thread shauncutts
On 17.07.2019 18:14, Andres Freund wrote: To me that means that we need prioritization across databases, and between tables, and probably by multiple criteria. I suspect there need to be multiple criteria how urgent vacuuming is, and autovacuum ought to try to make progress on all of them.

Re: Possible Values of Command Tag in PG Log file

2019-07-18 Thread Adrian Klaver
On 7/18/19 12:58 PM, Kumar, Virendra wrote: Hello Team, Can somebody redirect me to document which lists all possible value of command tag in instance log of PostgreSQL instance. Can you show example of a command tag in the log? Regards, Virendra

RE: Possible Values of Command Tag in PG Log file

2019-07-18 Thread Kumar, Virendra
Here is it: -- https://www.postgresql.org/docs/10/protocol-message-formats.html CommandComplete (B), string value of this section. I loaded log file (csv format) into postgres_log table as per below document and can see entries like: https://www.postgresql.org/docs/10/runtime-config-logging.html

Re: Possible Values of Command Tag in PG Log file

2019-07-18 Thread Melvin Davidson
The values and explanations are listed here: https://www.postgresql.org/docs/11/protocol-message-formats.html Or simply INSERT, UPDATE, DELETE, SELECT, MOVE, FETCH and/or COPY On Thu, Jul 18, 2019 at 5:04 PM Kumar, Virendra wrote: > Here is it: > -- > https://www.postgresql.org/docs/10/protocol

Re: Possible Values of Command Tag in PG Log file

2019-07-18 Thread Adrian Klaver
On 7/18/19 2:13 PM, Melvin Davidson wrote: The values and explanations are listed here: https://www.postgresql.org/docs/11/protocol-message-formats.html Or simply INSERT, UPDATE, DELETE, SELECT, MOVE, FETCH and/or COPY Except the OP shows a command that is not in the above, authentication. A

Re: Possible Values of Command Tag in PG Log file

2019-07-18 Thread Tom Lane
"Kumar, Virendra" writes: > I loaded log file (csv format) into postgres_log table as per below document > and can see entries like: > https://www.postgresql.org/docs/10/runtime-config-logging.html > postgres=# select command_tag from postgres_log where command_tag is not null > limit 5; > co

Re: Rearchitecting for storage

2019-07-18 Thread Rob Sargent
> > That would likely keep the extra storage requirements small, but still > non-zero. Presumably the upgrade would be unnecessary if it could be done > without rewriting files. Is there any rule of thumb for making sure one has > enough space available for the upgrade? I suppose that wou

Re: Rearchitecting for storage

2019-07-18 Thread Andy Colson
On 7/18/19 8:44 AM, Matthew Pounsett wrote: I've recently inherited a database that is dangerously close to outgrowing the available storage on its existing hardware.  I'm looking for (pointers to) advice on scaling the storage in a financially constrained not-for-profit. The current size of

maximum distance vs fixed distance for tsquery_phrase

2019-07-18 Thread Where is Where
Hello the tsquery_phrase is searching a fixed distance, is there way to search maximum distance so the search returns query1 followed by query2 up to a certain distance? eg distance=100 return result from query1 <1> query2 ... query1 <100> query2 ? Thanks! tsquery_phrase(query1 tsquery, query2 ts