problem parsing utf-8 encoded xml - minidom

[ashmir . d]

Hi,
I am trying to parse an xml file using the minidom parser.


from xml.dom import minidom
xmlfilename = "sample.xml"
xmldoc = minidom.parse(xmlfilename)


The parser is failing on this line:

Heinrich Kèufner, Norbert Nedopil, Heinz Schèoch (Hrsg.).

This is the error message I get:

Traceback (most recent call last):
  File "readXML.py", line 11, in 
xmldoc = minidom.parse(xmlfilename)
  File "C:\Python25\lib\xml\dom\minidom.py", line 1913, in parse
return expatbuilder.parse(file)
  File "C:\Python25\lib\xml\dom\expatbuilder.py", line 924, in parse
result = builder.parseFile(fp)
  File "C:\Python25\lib\xml\dom\expatbuilder.py", line 207, in
parseFile
parser.Parse(buffer, 0)
xml.parsers.expat.ExpatError: not well-formed (invalid token): line
2254, column 21

It seems to me that it is having an issue with the 'è' character. I
have even tried the following to make sure it recognises the file as
utf-8 file:


from xml.dom import minidom
import codecs

xmlfilename = "sample.xml"
xmlfile = codecs.open(xmlfilename,"r","utf-8")
xmlstring = xmlfile.read()
xmldoc = minidom.parse(xmlfilename)


However, this doesn't work either and I get the following error
message:

Traceback (most recent call last):
  File "readXML.py", line 9, in 
xmlstring = xmlfile.read()
  File "C:\Python25\lib\codecs.py", line 618, in read
return self.reader.read(size)
  File "C:\Python25\lib\codecs.py", line 424, in read
newchars, decodedbytes = self.decode(data, self.errors)
UnicodeDecodeError: 'utf8' codec can't decode bytes in position
69343-69345: invalid data

I'm assuming here that it is failing at the same place...

Can someone please point me in the right direction?
Thanks,
Ashmir
--
http://mail.python.org/mailman/listinfo/python-list

Re: problem parsing utf-8 encoded xml - minidom

[ashmir . d]

On Jul 4, 2:36 pm, "Martin v. Löwis" <[EMAIL PROTECTED]> wrote:
> > The parser is failing on this line:
>
> > Heinrich Kèufner, Norbert Nedopil, Heinz Schèoch (Hrsg.). > mrcb245-c>
>
> If it is literally this line, it's no surprise: there must not be a line
> break between the slash and the closing element name.
>
> However, since you are getting the error in a different column, it's
> indeed more likely that there is a problem with the encoding.
>
> Given that the Python UTF-8 codec refuses the data, most likely, the
> data is *not* encoded in UTF-8 (but perhaps in Latin-1). If so, you
> need to prefix the XML document with a proper XML declaration, such
> as
>
> 
>
> Alternatively, make sure that the file is really encoded in UTF-8.
>
> Regards,
> Martin


There is no line break in the xml file. It was just a formatting issue
on this forum.

However, you were right about the encoding not being
utf-8. The xml file is autogenerated by a different script so that's
probably where it is going wrong.
The parser works fine if I change the first line to


Thank you very much
--
http://mail.python.org/mailman/listinfo/python-list