Re: new FAQ entry (was:Re: [GENERAL] UTF8 problem)

2006-08-21 Thread Bruce Momjian
Instead of adding an FAQ entry, which might not be found when the error is generated, I added a HINT for 8.2 that will appear with the error message: errmsg("invalid byte sequence for encoding \"%s\": 0x%s", pg_enc2name_tbl[encoding].name,

Re: [GENERAL] UTF8 problem

2006-06-15 Thread Stephane Bortzmeyer
On Thu, Jun 08, 2006 at 07:25:35AM -0400, Douglas McNaught <[EMAIL PROTECTED]> wrote a message of 29 lines which said: > I would think it would (at least potentially) vary with each > message. The dbmail software should really set client_encoding > based on the Content-Transfer-Encoding header

Re: [GENERAL] UTF8 problem

2006-06-08 Thread Matthew T. O'Connor
Tom Lane wrote: "Matthew T. O'Connor" writes: They have talked about changing the messageblks to binary instead of text. They said that one of their main objections is that bytea data is not compressed. I'm not sure that's true, but I don't see anything in the docs about it. I think they

Re: [GENERAL] UTF8 problem

2006-06-08 Thread Tom Lane
"Matthew T. O'Connor" writes: > They have talked about changing the messageblks to binary instead of > text. They said that one of their main objections is that bytea data is > not compressed. I'm not sure that's true, but I don't see anything in > the docs about it. I think they would move

Re: [GENERAL] UTF8 problem

2006-06-08 Thread Matthew T. O'Connor
Daniel Verite wrote: IMHO they fail to draw the proper conclusion, which is that either the raw mail should be stored as either as a binary object, or as a text field in a database with SQL_ASCII encoding, in both cases providing the level of transparency that they need by design, their purpose b

Re: [GENERAL] UTF8 problem

2006-06-08 Thread Matthew T. O'Connor
Daniel Verite wrote: Matthew T. O'Connor wrote: The basic setup is that Postfix hands the email to a program called dbmail-smtp which parses and insert the message into the database. DBMail doesn't know anything about encoding. That's precisely what SQL_ASCII is for. Why not st

Re: [GENERAL] UTF8 problem

2006-06-08 Thread Matthew T. O'Connor
Tino Wildenhain wrote: Matthew T. O'Connor schrieb: Well, to answer my own question, I hacked the source code of DBMail and had it set the client encoding to LATIN1 immediately after database connect, this seems to have fixed the problem. You could also just have set the client_encoding as a

Re: [GENERAL] UTF8 problem

2006-06-08 Thread Daniel Verite
Douglas McNaught wrote: > I would think it would (at least potentially) vary with each message. > The dbmail software should really set client_encoding based on the > Content-Transfer-Encoding header in the message (or whatever it's > called). That would be the "charset" parameter of the

Re: [GENERAL] UTF8 problem

2006-06-08 Thread Douglas McNaught
Tino Wildenhain <[EMAIL PROTECTED]> writes: > Alban Hertroys schrieb: >> Matthew T. O'Connor wrote: >> >>> Well, to answer my own question, I hacked the source code of DBMail >>> and had it set the client encoding to LATIN1 immediately after >>> database connect, this seems to have fixed the probl

Re: [GENERAL] UTF8 problem

2006-06-08 Thread Daniel Verite
Matthew T. O'Connor wrote: > The basic setup is that Postfix hands the email to a program called > dbmail-smtp which parses and insert the message into the database. > DBMail doesn't know anything about encoding. That's precisely what SQL_ASCII is for. Why not stay with it? -- Daniel

Re: [GENERAL] UTF8 problem

2006-06-08 Thread Tino Wildenhain
Alban Hertroys schrieb: Matthew T. O'Connor wrote: Well, to answer my own question, I hacked the source code of DBMail and had it set the client encoding to LATIN1 immediately after database connect, this seems to have fixed the problem. LATIN1 != UTF-8. Your problem isn't solved yet. We

Re: [GENERAL] UTF8 problem

2006-06-08 Thread Alban Hertroys
Matthew T. O'Connor wrote: Well, to answer my own question, I hacked the source code of DBMail and had it set the client encoding to LATIN1 immediately after database connect, this seems to have fixed the problem. LATIN1 != UTF-8. Your problem isn't solved yet. You should either tell your cli

new FAQ entry (was:Re: [GENERAL] UTF8 problem)

2006-06-08 Thread Tim Allen
Matthew T. O'Connor wrote: Well, to answer my own question, I hacked the source code of DBMail and had it set the client encoding to LATIN1 immediately after database connect, this seems to have fixed the problem. Sorry for the noise, Matt I've seen this sort of problem asked about in the m

Re: [GENERAL] UTF8 problem

2006-06-07 Thread Tino Wildenhain
Matthew T. O'Connor schrieb: Well, to answer my own question, I hacked the source code of DBMail and had it set the client encoding to LATIN1 immediately after database connect, this seems to have fixed the problem. You could also just have set the client_encoding as an user-option in postgr

Re: [GENERAL] UTF8 problem

2006-06-07 Thread Matthew T. O'Connor
Well, to answer my own question, I hacked the source code of DBMail and had it set the client encoding to LATIN1 immediately after database connect, this seems to have fixed the problem. Sorry for the noise, Matt Matthew T. O'Connor wrote: I'm using DBMail running against PostgreSQL as my m

[GENERAL] UTF8 problem

2006-06-07 Thread Matthew T. O'Connor
I'm using DBMail running against PostgreSQL as my mailstore for our company network. I recently converted our company database from SQL_ASCII to UTF8 as I thought this would be a *good thing*. The problem now is that I think I'm loosing emails because in my postgresql logs I get this: 2006-0