Re: [PERFORM] Performance with temporary table

2008-04-10 Thread valgog
I see, I am having practically the same problem... utilizing partitioning idea http://www.postgresql.org/docs/8.3/interactive/ddl-partitioning.html by table inheritance. I have prepared a post with some trigger and rule examples for you http://valgogtech.blogspot.com/2008/04/table-partitioning-a

Re: [PERFORM] Performance with temporary table

2008-04-09 Thread samantha mahindrakar
We store traffic data in the partitioned tables. But the problem is that all this data is not correct. The data is corrupt, hence they need to be corrected. On Wed, Apr 9, 2008 at 10:31 PM, Erik Jones <[EMAIL PROTECTED]> wrote: > > On Apr 9, 2008, at 6:41 PM, samantha mahindrakar wrote: > > > Hi

Re: [PERFORM] Performance with temporary table

2008-04-09 Thread Erik Jones
On Apr 9, 2008, at 6:41 PM, samantha mahindrakar wrote: Hi The reason for using the temporary table is that i need this data buffered somewhere so that i can use it for later computation. And the fact that for each imputation i need to have historical data from 10 previous weeks makes it necessa

Re: [PERFORM] Performance with temporary table

2008-04-09 Thread samantha mahindrakar
Hi The reason for using the temporary table is that i need this data buffered somewhere so that i can use it for later computation. And the fact that for each imputation i need to have historical data from 10 previous weeks makes it necessary to create something that can hold the data. However once

Re: [PERFORM] Performance with temporary table

2008-04-09 Thread samantha mahindrakar
The partitions are used to separate the data according to months. I have run a query o find bad data from each such partition. The imputation algorithm that i use requires data from 10 previous weeks in order to impute the data. This historical data i store in a temporary table, the i query this da

Re: [PERFORM] Performance with temporary table

2008-04-09 Thread Decibel!
On Apr 8, 2008, at 2:43 PM, Alvaro Herrera wrote: samantha mahindrakar escribió: Well instead of creating a temp table everytime i just created a permanant table and insert the data into it everytime and truncate it. I created indexes on this permanent table too. This did improve the performa

Re: [PERFORM] Performance with temporary table

2008-04-09 Thread valgog
On Apr 7, 8:27 pm, [EMAIL PROTECTED] ("samantha mahindrakar") wrote: > Hi > I have written a program that imputes(or rather corrects data) with in > my database. > Iam using a temporary table where in i put data from other partitoined > table. I then query this table to get the desired data.But the

Re: [PERFORM] Performance with temporary table

2008-04-08 Thread Alvaro Herrera
samantha mahindrakar escribió: > Well instead of creating a temp table everytime i just created a > permanant table and insert the data into it everytime and truncate it. > I created indexes on this permanent table too. This did improve the > performance to some extent. > > Does using permanant ta

Re: [PERFORM] Performance with temporary table

2008-04-08 Thread samantha mahindrakar
Well instead of creating a temp table everytime i just created a permanant table and insert the data into it everytime and truncate it. I created indexes on this permanent table too. This did improve the performance to some extent. Does using permanant tables also bloat the catalog or hinder the p

Re: [PERFORM] Performance with temporary table

2008-04-08 Thread Alvaro Herrera
samantha mahindrakar escribió: > So the program necessarily creates a temporary table evrytime it has > to correct a record. However this table is dropeed after each record > is corrected. Perhaps it would be better to truncate the temp table instead. > Iam not sure if i can use a cursor to repl

Re: [PERFORM] Performance with temporary table

2008-04-08 Thread Richard Huxton
samantha mahindrakar wrote: Iam using a temporary table where in i put data from other partitoined table. I then query this table to get the desired data.But the thing is this temporary table has to be craeted for every record that i need to correct and there are thousands of such records that ne

[PERFORM] Performance with temporary table

2008-04-07 Thread samantha mahindrakar
Hi I have written a program that imputes(or rather corrects data) with in my database. Iam using a temporary table where in i put data from other partitoined table. I then query this table to get the desired data.But the thing is this temporary table has to be craeted for every record that i need t