Re: [GENERAL] Using psql -f to load a UTF8 file

2012-09-23 Thread Jasen Betts
On 2012-09-21, Craig Ringer wrote: > I strongly disagree. The BOM provides a useful and standard way to > differentiate UTF-8 encoded text files what is stopping non utf8 files from starting with something that looks like a BOM? -- ⚂⚃ 100% natural -- Sent via pgsql-general mailing list

Re: [GENERAL] Using psql -f to load a UTF8 file

2012-09-21 Thread Adrian Klaver
On 09/20/2012 10:27 AM, Alan Millington wrote: Thank you for the link. I am using Notepad, which inserts the byte order mark. Following the links a bit further, I gather that the version of Notepad that I am using may not identify a UTF8 file correctly if the byte order mark is omitted. Also, as

Re: [GENERAL] Using psql -f to load a UTF8 file

2012-09-21 Thread Roger Leigh
On Fri, Sep 21, 2012 at 09:21:36AM +0800, Craig Ringer wrote: > On 09/20/2012 11:44 PM, Leif Biberg Kristensen wrote: > > Torsdag 20. september 2012 16.56.16 skrev Alan Millington : > >>psql". But how am I supposed to remove the byte order mark from a UTF8 > >>file? I thought that the whole point

Re: [GENERAL] Using psql -f to load a UTF8 file

2012-09-21 Thread Alban Hertroys
> I strongly disagree. The BOM provides a useful and standard way to > differentiate UTF-8 encoded text files from the random pile of encodings that > any given file could be. I agree on the concept, but I'm having a bit of trouble understanding how a "Byte Order Marker" is useful to an 8-bit

Re: [GENERAL] Using psql -f to load a UTF8 file

2012-09-20 Thread Chris Angelico
On Fri, Sep 21, 2012 at 2:39 PM, John R Pierce wrote: > On 09/20/12 10:27 AM, Alan Millington wrote: >> >> I am using Notepad, which inserts the byte order mark. Following the links >> a bit further, I gather that the version of Notepad that I am using may not >> identify a UTF8 file correctly if

Re: [GENERAL] Using psql -f to load a UTF8 file

2012-09-20 Thread John R Pierce
On 09/20/12 10:27 AM, Alan Millington wrote: I am using Notepad, which inserts the byte order mark. Following the links a bit further, I gather that the version of Notepad that I am using may not identify a UTF8 file correctly if the byte order mark is omitted. Also, as I mentioned, Python make

Re: [GENERAL] Using psql -f to load a UTF8 file

2012-09-20 Thread Alan Millington
itor for Python, and another for Postgres.   From: Leif Biberg Kristensen To: Postgres general mailing list Cc: Alan Millington Sent: Thursday, 20 September 2012, 16:44 Subject: Re: [GENERAL] Using psql -f to load a UTF8 file Torsdag 20. september 2012

Re: [GENERAL] Using psql -f to load a UTF8 file

2012-09-20 Thread Chris Angelico
On Fri, Sep 21, 2012 at 11:21 AM, Craig Ringer wrote: > I strongly disagree. The BOM provides a useful and standard way to > differentiate UTF-8 encoded text files from the random pile of encodings > that any given file could be. The only reliable way to ascertain the encoding of a hunk of data i

Re: [GENERAL] Using psql -f to load a UTF8 file

2012-09-20 Thread Craig Ringer
On 09/20/2012 11:44 PM, Leif Biberg Kristensen wrote: Torsdag 20. september 2012 16.56.16 skrev Alan Millington : psql". But how am I supposed to remove the byte order mark from a UTF8 file? I thought that the whole point of the byte order mark was to tell programs what the file encoding is. O

Re: [GENERAL] Using psql -f to load a UTF8 file

2012-09-20 Thread John R Pierce
On 09/20/12 7:56 AM, Alan Millington wrote: I discovered a long time ago that psql does not like UTF8 files: it complains about the byte order mark on the first line. in case it wasn't clear from previous replies, Windows native Unicode format is NOT UTF8, its UTF16, where every character is s

Re: [GENERAL] Using psql -f to load a UTF8 file

2012-09-20 Thread Leif Biberg Kristensen
Torsdag 20. september 2012 16.56.16 skrev Alan Millington : > psql". But how am I supposed to remove the byte order mark from a UTF8 > file? I thought that the whole point of the byte order mark was to tell > programs what the file encoding is. Other programs, such as Python, rely > on this. http

Re: [GENERAL] Using psql -f to load a UTF8 file

2012-09-20 Thread Adrian Klaver
On 09/20/2012 10:44 AM, Leif Biberg Kristensen wrote: Torsdag 20. september 2012 19.27.22 skrev Alan Millington : Thank you for the link. I am using Notepad, which inserts the byte order mark. Following the links a bit further, I gather that the version of Notepad that I am using may not ident

Re: [GENERAL] Using psql -f to load a UTF8 file

2012-09-20 Thread Leif Biberg Kristensen
Torsdag 20. september 2012 19.27.22 skrev Alan Millington : > Thank you for the link. I am using Notepad, which inserts the byte order > mark. Following the links a bit further, I gather that the version of > Notepad that I am using may not identify a UTF8 file correctly if the byte > order mark i

Re: [GENERAL] Using psql -f to load a UTF8 file

2012-09-20 Thread Tom Lane
Alan Millington writes: > I am running Postgres 8.4.1 on Windows XP Professional Service Pack 3. My > database is UTF8. I use psql -f to load files containing DDL and DML > commands. I discovered a long time ago that psql does not like UTF8 files: it > complains about the byte order mark on the