Postgres Security Patches Question

2019-04-24 Thread Patil, Prashant
Hi Team, We have a question related to security patches. Following is our server specification:- OS-RedHat 7 Postgres - 9.3 (planning to upgrade to 11.2) and 11.2 We have installed postgres using source code and moved postgres data, config and share default install directories to custom directo

Re: Postgres Security Patches Question

2019-04-24 Thread Adrian Klaver
On 4/24/19 7:30 AM, Patil, Prashant wrote: Hi Team, We have a question related to security patches. Following is our server specification:- OS-RedHat 7 Postgres – 9.3 (planning to upgrade to 11.2) and 11.2 We have installed postgres using source code and moved postgres data, config and shar

RE: Postgres Security Patches Question

2019-04-24 Thread Patil, Prashant
Thanks Adrian for quick reply. So what would be best options here to apply security patches? Using RPM? Regards, Prashant -Original Message- From: Adrian Klaver Sent: Wednesday, April 24, 2019 10:38 AM To: Patil, Prashant ; secur...@postgresql.org; pgsql-general@lists.postgresql.org;

Re: Postgres Security Patches Question

2019-04-24 Thread Tom Lane
[ removing security list, since this is not a security bug report ] Adrian Klaver writes: > On 4/24/19 7:30 AM, Patil, Prashant wrote: >> ... If there is any security patch that need to apply on postgres >> database in future, 1. Would security patch available in form of source >> code/zip file

RE: Postgres Security Patches Question

2019-04-24 Thread Patil, Prashant
Thanks Tom. So since security patches is not release separately, they are part of minor releases. Is this correct statement? If they are part minor releases, we need to download source code for that release and perform upgrade and while performing upgrade, we can point install directories to ou

Re: Postgres Security Patches Question

2019-04-24 Thread Alvaro Herrera
On 2019-Apr-24, Patil, Prashant wrote: > Thanks Tom. So since security patches is not release separately, they > are part of minor releases. Is this correct statement? It is correct. > If they are part minor releases, we need to download source code for > that release and perform upgrade and whi

Re: Postgres Security Patches Question

2019-04-24 Thread Adrian Klaver
On 4/24/19 8:09 AM, Patil, Prashant wrote: Thanks Tom. So since security patches is not release separately, they are part of minor releases. Is this correct statement? Yes. See below for the reasoning and schedule: https://www.postgresql.org/support/versioning/ https://www.postgresql.org/dev

how to add more than 1600 columns in a table?

2019-04-24 Thread pabloa98
Hello Sadly today we hit the 1600 columns limit of Postgresql 11. How could we add more columns? Note: Tables are OK. We truly have 2400 columns now. Each column represents a value in a matrix. We have millions of rows so I would prefer not to transpose each row to (x, y, column_value) triplets

Re: how to add more than 1600 columns in a table?

2019-04-24 Thread Thomas Kellerer
pabloa98 schrieb am 24.04.2019 um 22:17: Sadly today we hit the 1600 columns limit of Postgresql 11. How could we add more columns? Note: Tables are OK. We truly have 2400 columns now. Each column represents a value in a matrix. We have millions of rows so I would prefer not to transpose each

Re: how to add more than 1600 columns in a table?

2019-04-24 Thread Ron
On 4/24/19 3:17 PM, pabloa98 wrote: Hello Sadly today we hit the 1600 columns limit of Postgresql 11. How could we add more columns? Note: Tables are OK. We truly have 2400 columns now. Each column represents a value in a matrix. We have millions of rows so I would prefer not to transpose e

Re: how to add more than 1600 columns in a table?

2019-04-24 Thread Adrian Klaver
On 4/24/19 1:17 PM, pabloa98 wrote: Hello Sadly today we hit the 1600 columns limit of Postgresql 11. How could we add more columns? Note: Tables are OK. We truly have 2400 columns now. Each column represents a value in a matrix. Not sure how hit 1600 column limit = having 2400 columns? O

Re: how to add more than 1600 columns in a table?

2019-04-24 Thread Ron
On 4/24/19 3:22 PM, Adrian Klaver wrote: On 4/24/19 1:17 PM, pabloa98 wrote: Hello Sadly today we hit the 1600 columns limit of Postgresql 11. How could we add more columns? Note: Tables are OK. We truly have 2400 columns now. Each column represents a value in a matrix. Not sure how hit 16

Re: how to add more than 1600 columns in a table?

2019-04-24 Thread Alvaro Herrera
On 2019-Apr-24, pabloa98 wrote: > How could we add more columns? Sorry. > Note: Tables are OK. We truly have 2400 columns now. Each column represents > a value in a matrix. Maybe you could use arrays? -- Álvaro Herrerahttps://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 S

Re: how to add more than 1600 columns in a table?

2019-04-24 Thread Tom Lane
pabloa98 writes: > Sadly today we hit the 1600 columns limit of Postgresql 11. > How could we add more columns? You can't, at least not without some pretty fundamental changes; that value is limited by field sizes within tuple headers. You'd also, more than likely, find yourself hitting problems

Re: how to add more than 1600 columns in a table?

2019-04-24 Thread David G. Johnston
On Wed, Apr 24, 2019 at 1:17 PM pabloa98 wrote: > Hello > > Sadly today we hit the 1600 columns limit of Postgresql 11. > > How could we add more columns? > Add a second table and relate them together via a one-to-one-required relationship? I'm unsure whether a final result set is limited or ju

Re: how to add more than 1600 columns in a table?

2019-04-24 Thread Joe Conway
On 4/24/19 4:17 PM, pabloa98 wrote: > Sadly today we hit the 1600 columns limit of Postgresql 11. > > How could we add more columns? > > Note: Tables are OK. We truly have 2400 columns now. Each column > represents a value in a matrix. As everyone else has mentioned, your use case sounds like ar

Re: Forcing index usage

2019-04-24 Thread Jeff Janes
On Wed, Apr 3, 2019 at 12:13 PM Jonathan Marks wrote: Is there a way to tell Postgres “please don’t use index X when queries that > could use index Y instead occur?” > Late to the party here, but... Not directly. I've had luck in changing the procost of functions (or the functions which back t

Re: how to add more than 1600 columns in a table?

2019-04-24 Thread pabloa98
Tom, We are using currently 32kb pages. It was working fine with our 1200 columns tables. The new table design has around 2400 columns and it does not fit in our modified postgresql11. We are ready (meaning, all the ready we could be with java and python but not too much C background) to modify t

Re: how to add more than 1600 columns in a table?

2019-04-24 Thread pabloa98
Thank you Joe! I will take a look Pablo On Wed, Apr 24, 2019 at 1:47 PM Joe Conway wrote: > On 4/24/19 4:17 PM, pabloa98 wrote: > > Sadly today we hit the 1600 columns limit of Postgresql 11. > > > > How could we add more columns? > > > > Note: Tables are OK. We truly have 2400 columns now. Eac

Re: how to add more than 1600 columns in a table?

2019-04-24 Thread pabloa98
Arrays could work, but it will make our code less clear. It is good to read the column name (meaningful) than a number. We could use constants, but then we should maintain them... Pablo On Wed, Apr 24, 2019 at 1:24 PM Alvaro Herrera wrote: > On 2019-Apr-24, pabloa98 wrote: > > > How could we ad

Re: how to add more than 1600 columns in a table?

2019-04-24 Thread pabloa98
if there is some no-SQL database supporting ACID + generic queries like a SQL database, I would consider it. However, the column limit is the problem, no the database. 1200 cols are reasonable for standard problems. Having a Postgresql supporting thousands of columns will be useful in Machine Lear

Re: how to add more than 1600 columns in a table?

2019-04-24 Thread Gavin Flower
On 25/04/2019 10:11, pabloa98 wrote: Thank you Joe! I will take a look Pablo On Wed, Apr 24, 2019 at 1:47 PM Joe Conway > wrote: [...] Hi Pablo, The convention here is to bottom post, or to intersperse comments, like in all the replies to you. So it would be ap

Re: how to add more than 1600 columns in a table?

2019-04-24 Thread pabloa98
On Wed, Apr 24, 2019 at 3:28 PM Gavin Flower wrote: The convention here is to bottom post, or to intersperse comments, like > in all the replies to you. > > So it would be appreciated if you did that, rather than top post as you > have been doing. > > Thanks for the advice. I will follow the conv

Re: how to add more than 1600 columns in a table?

2019-04-24 Thread Alvaro Herrera
On 2019-Apr-24, pabloa98 wrote: > Regarding to (2), We are good by adding a patch and recompile a patched > version for our server databases. > > But we are open on helping to add thousands of columns support as a > compile-time parameter if there are other people interested. It's hard to say wh

Re: how to add more than 1600 columns in a table?

2019-04-24 Thread Alvaro Herrera
On 2019-Apr-24, Alvaro Herrera wrote: > Note that with pg12 you could have your own table AM that supported > wider ItemIds as a (small?) change on heapam, rather than supplant it > for all tables. That way you would only pay the (probably considerable) > cost of the wider line pointers on all t

Re: how to add more than 1600 columns in a table?

2019-04-24 Thread Ron
On 4/24/19 5:55 PM, Alvaro Herrera wrote: On 2019-Apr-24, pabloa98 wrote: Regarding to (2), We are good by adding a patch and recompile a patched version for our server databases. But we are open on helping to add thousands of columns support as a compile-time parameter if there are other peop

Re: how to add more than 1600 columns in a table?

2019-04-24 Thread Gavin Flower
On 25/04/2019 10:55, Alvaro Herrera wrote: On 2019-Apr-24, pabloa98 wrote: Regarding to (2), We are good by adding a patch and recompile a patched version for our server databases. But we are open on helping to add thousands of columns support as a compile-time parameter if there are other peo

Re: how to add more than 1600 columns in a table?

2019-04-24 Thread Michel Pelletier
On Wed, Apr 24, 2019 at 3:11 PM pabloa98 wrote: > We used tables because we have 2 types of queries on this table: > > SELECT * FROM table_wih_lots_of_columns WHERE condition involving a lot of > columns. > These type of queries read lot of rows. > > or > > SELECT columnX FROM table_wih_lots_of_c