Re: [GENERAL] Scalability with large numbers of tables

2005-02-24 Thread Thomas F.O'Connell
To me, the issues of scalability come from a management perspective. I'm dealing with a schema that has tens of thousands of tables, but they are inherited from a relatively small set of superclass tables. I imagine there are similar issues to managing schemas as there are to managing subclass

Re: [GENERAL] Scalability with large numbers of tables

2005-02-21 Thread Tom Lane
"Greg Sabino Mullane" <[EMAIL PROTECTED]> writes: > Christopher Browne replied: >> If you've got tens of thousands of relations, the tab completion code >> has to draw the whole list of relations from pg_class into memory and >> "marshal" it into a form usable by GNU Readline. > Well, it's actuall

Re: [GENERAL] Scalability with large numbers of tables

2005-02-21 Thread Phil Endecott
Thanks to all who've responded to my concern about scalability with large numbers of tables. I am reasonably reassured. I don't really care about the tab-completion speed - it's just that its slowness was my "heads-up" to the fact that there could be something related to number of tables to wo

Re: [GENERAL] Scalability with large numbers of tables

2005-02-21 Thread Greg Sabino Mullane
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Phil Endecott wrote: > For example I find that tab-completion in psql is now unusably slow ... Christopher Browne replied: > If you've got tens of thousands of relations, the tab completion code > has to draw the whole list of relations from pg_clas

Re: [GENERAL] Scalability with large numbers of tables

2005-02-21 Thread Florian G. Pflug
Christopher Browne wrote: Oops! [EMAIL PROTECTED] (Phil Endecott) was seen spray-painting on a wall: I have a single database with one schema per user. Each user has a handful of tables, but there are lots of users, so in total the database has thousands of tables. If you've got tens of thousands

Re: [GENERAL] Scalability with large numbers of tables

2005-02-21 Thread Christopher Browne
I'm pretty sure that slowness of tab completion has little to do with the performance of the filesystems. If you've got tens of thousands of relations, the tab completion code has to draw the whole list of relations from pg_class into memory and "marshal" it into a form usable by GNU Readline. TH

Re: [GENERAL] Scalability with large numbers of tables

2005-02-21 Thread Christopher Browne
Oops! [EMAIL PROTECTED] (Phil Endecott) was seen spray-painting on a wall: > Dear Postgresql experts, > > I have a single database with one schema per user. Each user has a > handful of tables, but there are lots of users, so in total the > database has thousands of tables. > > I'm a bit concerned

Re: [GENERAL] Scalability with large numbers of tables

2005-02-21 Thread Marco Colombo
On Sun, 20 Feb 2005, Phil Endecott wrote: Dear Postgresql experts, I have a single database with one schema per user. Each user has a handful of tables, but there are lots of users, so in total the database has thousands of tables. I'm a bit concerned about scalability as this continues to grow

Re: [GENERAL] Scalability with large numbers of tables

2005-02-20 Thread Scott Marlowe
On Sun, 2005-02-20 at 10:45, Lincoln Yeoh wrote: > I'm not an expert. > > Turn off tab completion? It's probably scanning through all the possible > table names and the algorithm used is probably not designed for that > number. And with 42000 tables, tab completion may not be that helpful. > >

Re: [GENERAL] Scalability with large numbers of tables

2005-02-20 Thread Larry Rosenman
Lincoln Yeoh wrote: > I'm not an expert. > > Turn off tab completion? It's probably scanning through all the > possible table names and the algorithm used is probably not designed > for that number. And with 42000 tables, tab completion may not be > that helpful. > > Don't use ext2/ext3? There

Re: [GENERAL] Scalability with large numbers of tables

2005-02-20 Thread Lincoln Yeoh
I'm not an expert. Turn off tab completion? It's probably scanning through all the possible table names and the algorithm used is probably not designed for that number. And with 42000 tables, tab completion may not be that helpful. Don't use ext2/ext3? There are other filesystems on Linux which

[GENERAL] Scalability with large numbers of tables

2005-02-20 Thread Phil Endecott
Dear Postgresql experts, I have a single database with one schema per user. Each user has a handful of tables, but there are lots of users, so in total the database has thousands of tables. I'm a bit concerned about scalability as this continues to grow. For example I find that tab-completion