Re: [GENERAL] When adding millions of rows at once, getting out of disk space errors

2009-02-19 Thread Mike Christensen
Yea sorry good point.. It's probably at least safe to say the process should not just hang though, and there should be more info in the log as to what it's doing.. John R Pierce wrote: Mike Christensen wrote: First off, when Postgres starts and sees that your database was not closed properly

Re: [GENERAL] When adding millions of rows at once, getting out of disk space errors

2009-02-19 Thread Sam Mason
On Thu, Feb 19, 2009 at 02:58:02AM -0800, Mike Christensen wrote: > I would assume if the account the service is running under has limited > disk space, it won't really matter what OS you're running under. > Postgres will throw an "out of disk space" error. Similarly to Scott, every time I've c

Re: [GENERAL] When adding millions of rows at once, getting out of disk space errors

2009-02-19 Thread John R Pierce
Mike Christensen wrote: First off, when Postgres starts and sees that your database was not closed properly, it should tell you there's pending transactions and ask if you want to dump them or try to process them (or maybe save them for later). If you process them, there should be clear status

Re: [GENERAL] When adding millions of rows at once, getting out of disk space errors

2009-02-19 Thread Geoffrey
Mike Christensen wrote: I have well over 50 gigs free on that drive.. I doubt it. out of inodes. Scott Marlowe wrote: On Wed, Feb 18, 2009 at 1:39 PM, Mike Christensen wrote: Hi all - ERROR: could not extend relation 1663/41130/41177: No space left on device HINT: Check free disk sp

Re: [GENERAL] When adding millions of rows at once, getting out of disk space errors

2009-02-19 Thread Mike Christensen
I would assume if the account the service is running under has limited disk space, it won't really matter what OS you're running under. Postgres will throw an "out of disk space" error. The problem for me is I was in the middle of a transaction which inserted about 50,000 rows into a table, a

Re: [GENERAL] When adding millions of rows at once, getting out of disk space errors

2009-02-19 Thread Scott Marlowe
On Thu, Feb 19, 2009 at 3:11 AM, Mike Christensen wrote: > Actually I'm writing emails on my Mac > > However, the Postgres service is running on my Windows 2003 machine.. > > The disk space issue turned out to be a disk quota which was easy to solve. > Unfortunately, the fact it crashed Postgres

Re: [GENERAL] When adding millions of rows at once, getting out of disk space errors

2009-02-19 Thread Mike Christensen
Actually I'm writing emails on my Mac However, the Postgres service is running on my Windows 2003 machine.. The disk space issue turned out to be a disk quota which was easy to solve. Unfortunately, the fact it crashed Postgres and with a massive transaction log left the server in a state wh

Re: [GENERAL] When adding millions of rows at once, getting out of disk space errors

2009-02-19 Thread Grzegorz Jaƛkiewicz
I bet it is on windows (judging by html in that email), but if isn't: open a console and issue: watch -n 0.5 df -h and run that insert again ;) -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-gene

Re: [GENERAL] When adding millions of rows at once, getting out of disk space errors

2009-02-18 Thread Mike Christensen
I just changed the account manually and did not set a disk quota.. However, now I have bigger problems since the service will not start up anymore. I tried re-booting twice. First I get: 2009-02-18 21:24:25 GMT FATAL: lock file "postmaster.pid" already exists 2009-02-18 21:24:25 GMT HINT:

Re: [GENERAL] When adding millions of rows at once, getting out of disk space errors

2009-02-18 Thread John R Pierce
Mike Christensen wrote: Ooo good call, the account is part of the "Users" group which has a quota: The users will have the following disk quota: Disk space limited to 1024 MB Warning sent at 900 MB Which is the exact size of the database.. However, anyone have a clue on how to change t

Re: [GENERAL] When adding millions of rows at once, getting out of disk space errors

2009-02-18 Thread Mike Christensen
Ooo good call, the account is part of the "Users" group which has a quota: The users will have the following disk quota: Disk space limited to 1024 MB Warning sent at 900 MB Which is the exact size of the database.. However, anyone have a clue on how to change this? This is Windows Serv

Re: [GENERAL] When adding millions of rows at once, getting out of disk space errors

2009-02-18 Thread Sam Mason
On Wed, Feb 18, 2009 at 12:39:50PM -0800, Mike Christensen wrote: > I'm doing some perf testing and need huge amounts of data. So I have a > program that is adding data to a few tables ranging from 500,000 to 15M > rows. I assume you're repeatedly inserting data and then deleting it? If so, PG

Re: [GENERAL] When adding millions of rows at once, getting out of disk space errors

2009-02-18 Thread Bill Moran
In response to Mike Christensen : > I have well over 50 gigs free on that drive.. I doubt it. I'm not aware of that error having false-positives associated with it. Common confusion on this point could result from having quotas enabled, or possibly you're running out of space, then when you che

Re: [GENERAL] When adding millions of rows at once, getting out of disk space errors

2009-02-18 Thread Scott Marlowe
On Wed, Feb 18, 2009 at 1:55 PM, Mike Christensen wrote: > I have well over 50 gigs free on that drive.. I doubt it. Quotas? Something's making the OS think the drive is full. -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://ww

Re: [GENERAL] When adding millions of rows at once, getting out of disk space errors

2009-02-18 Thread Mark Roberts
On Wed, 2009-02-18 at 12:55 -0800, Mike Christensen wrote: > I have well over 50 gigs free on that drive.. I doubt it. Are you sure the pg data directory is on the drive you think it is? Are you doing alot of deletes or are you merely inserting? Are you doing any sorting and therefore running

Re: [GENERAL] When adding millions of rows at once, getting out of disk space errors

2009-02-18 Thread Alan Hodgson
On Wednesday 18 February 2009, Mike Christensen wrote: > > ERROR: could not extend relation 1663/41130/41177: No space left on > device HINT: Check free disk space. > It seems to me there's some sort of "max table size" before you have to > allocate more space on the disk, however I can't seem

Re: [GENERAL] When adding millions of rows at once, getting out of disk space errors

2009-02-18 Thread Tom Lane
Mike Christensen writes: > I'm doing some perf testing and need huge amounts of data. So I have a > program that is adding data to a few tables ranging from 500,000 to 15M > rows. The program is just a simply C# program that blasts data into the > DB, but after about 3M rows or so I get an er

Re: [GENERAL] When adding millions of rows at once, getting out of disk space errors

2009-02-18 Thread Mike Christensen
I have well over 50 gigs free on that drive.. I doubt it. Scott Marlowe wrote: On Wed, Feb 18, 2009 at 1:39 PM, Mike Christensen wrote: Hi all - ERROR: could not extend relation 1663/41130/41177: No space left on device HINT: Check free disk space. You're running out of disk space

Re: [GENERAL] When adding millions of rows at once, getting out of disk space errors

2009-02-18 Thread Scott Marlowe
On Wed, Feb 18, 2009 at 1:39 PM, Mike Christensen wrote: > Hi all - > ERROR: could not extend relation 1663/41130/41177: No space left on device > HINT: Check free disk space. You're running out of disk space. -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make chang

[GENERAL] When adding millions of rows at once, getting out of disk space errors

2009-02-18 Thread Mike Christensen
Hi all - I'm doing some perf testing and need huge amounts of data. So I have a program that is adding data to a few tables ranging from 500,000 to 15M rows. The program is just a simply C# program that blasts data into the DB, but after about 3M rows or so I get an errror: ERROR: could n