Re: [PERFORM] Improving PostgreSQL insert performance

2017-06-09 Thread John Gorman
You need to be careful with the setFetchSize we have tables with over 10 million rows and many columns and the PostgreSQL JDBC driver silently fails, ignores the fetch size and tries to read the entire table content into memory. I spent many agonizing days on this. ps.setFetchSize(65536); Rega

Re: [PERFORM] Auto generate number in Postgres-9.1.

2017-03-20 Thread John Gorman
Sequences are stored as a separate object in PostgreSQL. Here in this example table and you can see that rec_id is a sequence number and that the object name is: whiteboards_rec_id_seq mydb=> \d whiteboards Table "public.whiteboards" Column |

Re: [PERFORM] How Can I check PostgreSQL backup is successfully or not ?

2017-02-27 Thread John Gorman
Even though it's not listed in any of the documentation or “pg_dump --help” you can check the return code of the process. A return code greater than 0 (zero) usually indicates a failure ./bin >pg_dump -U dummy_user dummy_database; echo $? 1 From: pgsql-performance-ow...@postgresql.org [mailto

Re: [PERFORM] Correct use of cursors for very large result sets in Postgres

2017-02-23 Thread John Gorman
Yes of course that’s all verified and taken into account during code initialization From: Vitalii Tymchyshyn [mailto:v...@tym.im] Sent: Wednesday, February 22, 2017 8:14 PM To: John Gorman; pgsql-performance@postgresql.org Subject: Re: [PERFORM] Correct use of cursors for very large result sets

Re: [PERFORM] Correct use of cursors for very large result sets in Postgres

2017-02-21 Thread John Gorman
My experience with cursors in PostgreSQL with Java has been to stay away from them. We support 2 databases with our product, PostgreSQL (default) and SQL Server. While re-encrypting data in a database the application used cursors with a fetch size of 1000. Worked perfectly on SQL Server and on

Re: [PERFORM] Index not used

2016-06-16 Thread John Gorman
When you run psql, are you running that on the application server or the database server? Does the application run on the same server as the database and how is the application connecting to the database (JDBC, ODBC, etc)? In other words is there a difference in network time between the 2? Also

Re: [PERFORM] Database transaction with intermittent slow responses

2016-05-16 Thread John Gorman
should know more after tonight. Thanks again for your feedback and responses Regards John -Original Message- From: Gerardo Herzig [mailto:gher...@fmed.uba.ar] Sent: Friday, May 13, 2016 4:11 PM To: John Gorman Cc: pgsql-performance@postgresql.org Subject: Re: [PERFORM] Database transaction

Re: [PERFORM] Database transaction with intermittent slow responses

2016-05-13 Thread John Gorman
172.20.0.86 | batchb.eldocomp.com | 55055 | 2016-05-11 07:17:52.292909-07 | 2016-05-11 07:40:50.525528-07 | 2016-05-11 07:51:08.359281-07 | f | SELECT * FROM Employee WHERE EmployeeID BETWEEN $1 AND $2 ORDER BY EmployeeID LIMIT 1001 Regards John -Original Message- From: Gerardo

[PERFORM] Database transaction with intermittent slow responses

2016-05-13 Thread John Gorman
| 1 vacuum_cost_page_miss | 10 vacuum_defer_cleanup_age| 0 vacuum_freeze_min_age | 5000 vacuum_freeze_table_age | 15000 John Gorman | Manager of Production Support, Architecture, Release Engineering | Eldorado | a Division of MPHASIS | www.eldoinc.com/ | 5353 North 16th Street, Suite 400, Phoenix, Arizona 85016-3228 | Tel 602.604.3100 | Fax: 602.604.3115