Hey all.

I'm facing a strange problem concerning special characters.

Using web2py shell, through command line (linux shell), I do this:

# ----------------  start
$ python web2py.py -S welcome
web2py Web Framework
Created by Massimo Di Pierro, Copyright 2007-2013
Version 2.6.4-stable+timestamp.2013.09.22.01.43.37
Database drivers available: SQLite(sqlite3), MySQL(pymysql),
PostgreSQL(pg8000), IMAP(imaplib)
WARNING:web2py:import IPython error; use default python shell
Python 2.7.3 (default, Apr 10 2013, 06:20:15)
[GCC 4.6.3] on linux2
Type "help", "copyright", "credits" or "license" for more information.
(InteractiveConsole)
>>> print "áéíóú"   # note the strange chars!
áéíóú
>>> from unicodedata import normalize
>>> normalize("NFKD", "áéuíóú".decode("utf-8")).encode("ASCII", "ignore") # 
>>> again!
'AAuAA3Ao'
# ----------------  end

Note the noisy characters on the last line.


Then, at the same machine, I enter into the naked Python shell and:
# ----------------  start
$ python
Python 2.7.3 (default, Apr 10 2013, 06:20:15)
[GCC 4.6.3] on linux2
Type "help", "copyright", "credits" or "license" for more information.
>>> print "áéíóú" # looks ok
áéíóú
>>> from unicodedata import normalize
>>> normalize("NFKD", "áéuíóú".decode("utf-8")).encode("ASCII", "ignore") # ok 
>>> again.
'aeiou'
# ----------------  end

Everything works fine.

The same code.

I found this problem because I'm working to strip special characters
off of names, with unicodedata.normalize().

If it wan't strange enough, the unicodedata.normalize() works fine
from web environment, throug app admin. There the normalization works
as expected (the same way as the standard naked Python shell).

What could be the root of this situation?

-- 
Resources:
- http://web2py.com
- http://web2py.com/book (Documentation)
- http://github.com/web2py/web2py (Source code)
- https://code.google.com/p/web2py/issues/list (Report Issues)
--- 
You received this message because you are subscribed to the Google Groups 
"web2py-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to web2py+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

Reply via email to