Hey guys, 2.10.3 doesn't seem ready for prime time :-( In fact this bug makes 2.10.3 unusable for postgres users with need for non ASCII-characters..
For reference let's link to the corresponding issue here too: https://github.com/web2py/web2py/issues/910 Is there any solution yet? Bodo Am Samstag, 11. April 2015 16:38:13 UTC+2 schrieb Ian W. Scott: > Thanks Richard. My production server is working fine with 2.9.11. I'll > open an issue on the web2py github repo, since it sounds like that's the > better forum for this. > > Ian > > > On Friday, April 10, 2015 at 3:40:16 PM UTC-4, Richard wrote: >> >> Ok, ok, I guess there is an issue with web2py or pyDAL... Can you test >> this with an earlier version of web2py? If it works consider open an issue >> in web2py on github with condition to reproduce the error and if it coming >> form pyDAL the issue will be migrate to pyDAL repo once the origin of the >> issue is found. >> >> Richard >> >> On Fri, Apr 10, 2015 at 3:24 PM, Ian W. Scott <scot...@gmail.com> wrote: >> >>> Also, as I pointed out in my question I can insert the same string (with >>> the same encoding) directly into the postgre database using the raw SQL >>> code that is being sent by pydal to the postgre adapter. I inserted a print >>> statement into adapters/base.py to give me the exact SQL command, copied >>> that SQL command (data and all), then ran it in pgAdmin with no problem. So >>> it can't be a problem with the encoding of the string being received by the >>> pydal. >>> >>> Ian >>> >>> On Friday, April 10, 2015 at 2:05:25 PM UTC-4, Richard wrote: >>>> >>>> Can you please show the code that lead to this error? >>>> >>>> If you hard code this you can't use a regular string (str()) which is >>>> ascii characters only you have to pass by unicode something like this : >>>> >>>> string = u'ἀγοραζε'.decode(utf-8) >>>> >>>> http://stackoverflow.com/questions/6289474/working- >>>> with-utf-8-encoding-in-python-source >>>> >>>> If the greek character come form user input web2py deal with this to my >>>> knowledge... So I am pretty sure you hard code greek character in your >>>> code... So you need to read about encoding in python... >>>> >>>> Richard >>>> >>>> >>>> >>>> On Fri, Apr 10, 2015 at 1:29 PM, Ian W. Scott <scot...@gmail.com> >>>> wrote: >>>> >>>>> Hi folks, >>>>> >>>>> I'm running into an error with 2.10.3 when I try to write unicode text >>>>> (outside the Latin ranges) to a regular string field in a postgre >>>>> database. >>>>> Since my app is a greek language-learning application this error breaks >>>>> things completely for me. >>>>> >>>>> When I try, for example, to insert the string 'ἀγοραζε' I get the >>>>> following error: >>>>> >>>>> Traceback (most recent call last): >>>>> >>>>> File "applications/paideia/modules/paideia.py", line 168, in start >>>>> pre_bug_step_id=pre_bug_step_id) >>>>> File "applications/paideia/modules/paideia.py", line 384, in reply >>>>> response_string) >>>>> File "applications/paideia/modules/paideia.py", line 655, in >>>>> _record_step >>>>> log_record_id = db.attempt_log.insert(**log_args) >>>>> File "/home/ian/web/web2py/gluon/packages/dal/pydal/objects.py", >>>>> line 745, in insert >>>>> ret = self._db._adapter.insert(self, self._listify(fields)) >>>>> File "/home/ian/web/web2py/gluon/packages/dal/pydal/adapters/ >>>>> base.py", line 729, in insert >>>>> raise e >>>>> UnicodeDecodeError: 'ascii' codec can't decode byte 0xe1 in position >>>>> 105: ordinal not in range(128) >>>>> >>>>> >>>>> The SQL being sent to the postgre adapter in this case was this: >>>>> >>>>> INSERT INTO attempt_log(name,user_response,step,score,modified_on,dt_ >>>>> attempted,in_path,uuid) VALUES (19,'ἀγοραζε',773,1.0,'2015-04-10 >>>>> 12:33:25','2015-04-10 16:33:26',657,'5918a65a-6d6f- >>>>> 42c6-9af2-f5d0e313701e') RETURNING id; >>>>> >>>>> When I execute that SQL command directly on the postgre database it >>>>> doesn't raise any errors and the new row is created fine. >>>>> >>>>> I've created a simple app that duplicates the error and attached the >>>>> packed app here. Since the error doesn't happen with sqlite, I've set up >>>>> the app db for a postgre database with the following connection details: >>>>> >>>>> username = 'postgres' >>>>> postgre host = 'localhost' >>>>> postgre db_name = 'unicode_bug_test' >>>>> >>>>> I've left the db password field empty in the db.py file for obvious >>>>> reasons (i.e., my local password wouldn't do anyone any good anyway). >>>>> >>>>> If you try to create a new record in the 'lemmas' table using appadmin >>>>> with non-Latin text in the 'lemma' field (something like 'βλα') you >>>>> should >>>>> get the same error. >>>>> >>>>> Ian >>>>> >>>>> -- >>>>> Resources: >>>>> - http://web2py.com >>>>> - http://web2py.com/book (Documentation) >>>>> - http://github.com/web2py/web2py (Source code) >>>>> - https://code.google.com/p/web2py/issues/list (Report Issues) >>>>> --- >>>>> You received this message because you are subscribed to the Google >>>>> Groups "web2py-users" group. >>>>> To unsubscribe from this group and stop receiving emails from it, send >>>>> an email to web2py+un...@googlegroups.com. >>>>> For more options, visit https://groups.google.com/d/optout. >>>>> >>>> >>>> -- >>> Resources: >>> - http://web2py.com >>> - http://web2py.com/book (Documentation) >>> - http://github.com/web2py/web2py (Source code) >>> - https://code.google.com/p/web2py/issues/list (Report Issues) >>> --- >>> You received this message because you are subscribed to the Google >>> Groups "web2py-users" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to web2py+un...@googlegroups.com. >>> For more options, visit https://groups.google.com/d/optout. >>> >> >> -- Resources: - http://web2py.com - http://web2py.com/book (Documentation) - http://github.com/web2py/web2py (Source code) - https://code.google.com/p/web2py/issues/list (Report Issues) --- You received this message because you are subscribed to the Google Groups "web2py-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to web2py+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
