Re: [GENERAL] Error: "Out of memory while reading tuples." in pushing table from SAS to PostgreSQL on Mac

2014-12-14 Thread Andy Colson
On 12/13/2014 10:03 PM, wetter wetterana wrote: Hi, I'm passing rows from SAS to PostgreSQL (I assign a libname and use a PROC APPEND). This works fine with smaller tables (~below 1 million rows). However, as tables get larger I receive the following error messages: "ERROR: CLI describe er

Re: [GENERAL] Error: "Out of memory while reading tuples." in pushing table from SAS to PostgreSQL on Mac

2014-12-14 Thread Adrian Klaver
On 12/14/2014 07:44 AM, Andy Colson wrote: On 12/13/2014 10:03 PM, wetter wetterana wrote: Hi, I'm passing rows from SAS to PostgreSQL (I assign a libname and use a PROC APPEND). This works fine with smaller tables (~below 1 million rows). However, as tables get larger I receive the following

Re: [GENERAL] Error: "Out of memory while reading tuples." in pushing table from SAS to PostgreSQL on Mac

2014-12-14 Thread Andy Colson
On 12/14/2014 09:51 AM, Adrian Klaver wrote: On 12/14/2014 07:44 AM, Andy Colson wrote: On 12/13/2014 10:03 PM, wetter wetterana wrote: Hi, I'm passing rows from SAS to PostgreSQL (I assign a libname and use a PROC APPEND). This works fine with smaller tables (~below 1 million rows). However

Re: [GENERAL] Error: "Out of memory while reading tuples." in pushing table from SAS to PostgreSQL on Mac

2014-12-14 Thread Andy Colson
Ah! That would explain it. Welp, this search was more helpful: "Out of memory while reading tuples" http://stackoverflow.com/questions/22532149/vba-and-postgresql-connection It says: include UseDeclareFetch=1 in connect string, which sounds like its part of odbc. How does SAS connect to PG?

Re: [GENERAL] Error: "Out of memory while reading tuples." in pushing table from SAS to PostgreSQL on Mac

2014-12-14 Thread wetter wetterana
Apologies, I am using SAS, a statistical package/database management system. SAS has the feature of connecting to a PostgreSQL server. It does so by assigning what is called a libname (a 'library' connection telling SAS that a particular folder is a data storage). In this assignment, you specify

Re: [GENERAL] Database and OS monitoring

2014-12-14 Thread Vick Khera
On Sat, Dec 13, 2014 at 1:55 PM, Edson Carlos Ericksson Richter < edsonrich...@hotmail.com> wrote: > > I've been searching in web for guidelines on OS (Linux) and PostgreSQL > (9.3.5) active monitoring best practices. > Recent trends are more toward monitoring response latency by first establishin

Re: [GENERAL] Blocking access by remote users for a specific time period

2014-12-14 Thread Vick Khera
On Sun, Dec 14, 2014 at 1:38 AM, Michael Nolan wrote: > > Yeah, a cron job to swap pg_hba.conf files is the best solution I've come > up with so far. It's not one web app, it's closer to two dozen of them, on > multiple sites. > Use time-based firewall rules to block them?

Re: [GENERAL] Error: "Out of memory while reading tuples." in pushing table from SAS to PostgreSQL on Mac

2014-12-14 Thread Adrian Klaver
On 12/14/2014 08:14 AM, wetter wetterana wrote: Apologies, I am using SAS, a statistical package/database management system. SAS has the feature of connecting to a PostgreSQL server. It does so by assigning what is called a libname (a 'library' connection telling SAS that a particular folder i

Re: [GENERAL] Error: "Out of memory while reading tuples." in pushing table from SAS to PostgreSQL on Mac

2014-12-14 Thread Tom Lane
wetter wetterana writes: > Help much appreciated! The out-of-memory situation is definitely happening on the client side, not the server side. A problem happening in the server would not result in a message spelled quite that way, and it would not use an HY000 error code either. A plausible gue

Re: [GENERAL] Database and OS monitoring

2014-12-14 Thread Tim Smith
Try http://brendangregg.com/ Lots of great tidbits there from a guy who really knows his performance stuff (ex-Sun, now Netflix) On Sunday, 14 December 2014, Vick Khera wrote: > > On Sat, Dec 13, 2014 at 1:55 PM, Edson Carlos Ericksson Richter < > edsonrich...@hotmail.com > > wrote: >> >> I've

Re: [GENERAL] Blocking access by remote users for a specific time period

2014-12-14 Thread Steve Atkins
On Dec 13, 2014, at 10:38 PM, Michael Nolan wrote: > Yeah, a cron job to swap pg_hba.conf files is the best solution I've come up > with so far. It's not one web app, it's closer to two dozen of them, on > multiple sites. If they use persistent connections you'll also have to kill existin

Re: [GENERAL] Error: "Out of memory while reading tuples." in pushing table from SAS to PostgreSQL on Mac

2014-12-14 Thread Gavin Flower
On 15/12/14 04:44, Andy Colson wrote: On 12/13/2014 10:03 PM, wetter wetterana wrote: Hi, I'm passing rows from SAS to PostgreSQL (I assign a libname and use a PROC APPEND). This works fine with smaller tables (~below 1 million rows). However, as tables get larger I receive the following er