Re: [GENERAL] Finding Duplicate Rows during INSERTs

2012-07-09 Thread Darren Duncan
Rich Shepard wrote: Source data has duplicates. I have a file that creates the table then INSERTS INTO the table all the rows. When I see errors flash by during the 'psql -d -f ' I try to scroll back in the terminal to see where the duplicate rows are located. Too often they are too far back

Re: [GENERAL] Finding Duplicate Rows during INSERTs

2012-07-09 Thread Rich Shepard
On Mon, 9 Jul 2012, Rob Sargent wrote: psql -d -f file.sql > file.log 2>&1 would give you a logfile Rob, Ah, yes. I forgot about redirecting stdout to a file. sort -u file.raw > file.uniq might give you clean data? Not when it has the SQL on each line. I thought that I had eliminated

Re: [GENERAL] Finding Duplicate Rows during INSERTs

2012-07-09 Thread Rob Sargent
On 07/09/2012 04:48 PM, Rich Shepard wrote: Source data has duplicates. I have a file that creates the table then INSERTS INTO the table all the rows. When I see errors flash by during the 'psql -d -f ' I try to scroll back in the terminal to see where the duplicate rows are located. Too ofte