Correction: my sever is running 8.1.3
Jaime Silvela wrote:
Just bringing back to life a message I sent last July.
The problem I was having was that when importing very large data sets,
COPY seemed to drop some data. I built a script to use INSERTs, and
same problem. My server runs 8.1.3 on Li
Just bringing back to life a message I sent last July.
The problem I was having was that when importing very large data sets,
COPY seemed to drop some data. I built a script to use INSERTs, and same
problem. My server runs 8.1.3 on Linux. Several people investigated,
Reece Hart was unable to r
"Silvela, Jaime \(Exchange\)" <[EMAIL PROTECTED]> writes:
> I have a pretty big file, around 2 million rows, in tab-separated
> format, with 4 columns, that I read into a table in Postgres using the
> copy command.
> I've started to notice missing info sometimes. I'll truncate the table,
> read fr
On Wed, 2006-07-26 at 13:38 -0700, Reece Hart wrote:
If you can release the data and get it to me (e.g., compressed email attachment, http, ftp), I volunteer to try a run on 8.1.4 on suse 10.0/x86_64.
Jaime-
I cannot replicate your observations.
There were 1915733 lines in the file yo
[My ISP has had a power failure and my outgoing mail appears to bouncing, but I'm unsure -- apologies if you receive multiple copies.]
On Wed, 2006-07-26 at 13:38 -0700, Reece Hart wrote:
If you can release the data and get it to me (e.g., compressed email attachment, http, ftp), I volunt
"Silvela, Jaime \(Exchange\)" <[EMAIL PROTECTED]> writes:
> Tom, how and why would INSERTs be dropped on the client side?
[ shrug... ] I don't know your code; I was thinking about garden variety
bugs in your ruby script. However, if you can make it happen just
through psql \copy then that theory
ar(20),
msa varchar(3),
"year" int4,
"month" int2,
freq varchar(2),
geog varchar(6)
)
Thanks
Jaime
-Original Message-
From: Tom Lane [mailto:[EMAIL PROTECTED]
Sent: Wednesday, July 26, 2006 5:05 PM
To: Alvaro Herrera
Cc: Silvela, Jaime (Exchange); pgsql-gen
Alvaro Herrera <[EMAIL PROTECTED]> writes:
> Silvela, Jaime (Exchange) wrote:
>> No lines contain quotes. And the same file will sometimes be fully
>> imported, and sometimes lose data. I'm thinking that under heavy loads,
>> the database is discarding INSERTS.
> I don't think that's very likely.
On Wed, 2006-07-26 at 12:48 -0400, Silvela, Jaime (Exchange) wrote:
This is the first time I post to the list. I’ve done a brief search and didn’t find my issue treated already, so here it goes. Apologies if this has been reported before.
What PG version and environment? How about sendi
Silvela, Jaime (Exchange) wrote:
> No lines contain quotes. And the same file will sometimes be fully
> imported, and sometimes lose data. I'm thinking that under heavy loads,
> the database is discarding INSERTS.
I don't think that's very likely.
How are you checking that the data is there? Do
PM
To: Silvela, Jaime (Exchange)
Cc: pgsql-general@postgresql.org
Subject: Re: [GENERAL] copy losing information
"Silvela, Jaime \(Exchange\)" <[EMAIL PROTECTED]> writes:
> I've started to notice missing info sometimes. I'll truncate the
table,
> read from the file, and
"Silvela, Jaime \(Exchange\)" <[EMAIL PROTECTED]> writes:
> I've started to notice missing info sometimes. I'll truncate the table,
> read from the file, and notice that sometimes there are less rows in the
> table than in the file.
Have you made any attempt to determine *which* rows are missing?
This is the first time I post to the list. I’ve done a
brief search and didn’t find my issue treated already, so here it goes. Apologies
if this has been reported before.
I have a pretty big file, around 2 million rows, in
tab-separated format, with 4 columns, that I read into a table i
13 matches
Mail list logo
