Ian, better make sure you can reproduce the problem... You may pack an app that allow developper to test the issue and attach it to your ticket...
Richard On Sat, Apr 11, 2015 at 10:38 AM, Ian W. Scott <scotti...@gmail.com> wrote: > Thanks Richard. My production server is working fine with 2.9.11. I'll > open an issue on the web2py github repo, since it sounds like that's the > better forum for this. > > Ian > > > On Friday, April 10, 2015 at 3:40:16 PM UTC-4, Richard wrote: >> >> Ok, ok, I guess there is an issue with web2py or pyDAL... Can you test >> this with an earlier version of web2py? If it works consider open an issue >> in web2py on github with condition to reproduce the error and if it coming >> form pyDAL the issue will be migrate to pyDAL repo once the origin of the >> issue is found. >> >> Richard >> >> On Fri, Apr 10, 2015 at 3:24 PM, Ian W. Scott <scot...@gmail.com> wrote: >> >>> Also, as I pointed out in my question I can insert the same string (with >>> the same encoding) directly into the postgre database using the raw SQL >>> code that is being sent by pydal to the postgre adapter. I inserted a print >>> statement into adapters/base.py to give me the exact SQL command, copied >>> that SQL command (data and all), then ran it in pgAdmin with no problem. So >>> it can't be a problem with the encoding of the string being received by the >>> pydal. >>> >>> Ian >>> >>> On Friday, April 10, 2015 at 2:05:25 PM UTC-4, Richard wrote: >>>> >>>> Can you please show the code that lead to this error? >>>> >>>> If you hard code this you can't use a regular string (str()) which is >>>> ascii characters only you have to pass by unicode something like this : >>>> >>>> string = u'ἀγοραζε'.decode(utf-8) >>>> >>>> http://stackoverflow.com/questions/6289474/working-with-utf- >>>> 8-encoding-in-python-source >>>> >>>> If the greek character come form user input web2py deal with this to my >>>> knowledge... So I am pretty sure you hard code greek character in your >>>> code... So you need to read about encoding in python... >>>> >>>> Richard >>>> >>>> >>>> >>>> On Fri, Apr 10, 2015 at 1:29 PM, Ian W. Scott <scot...@gmail.com> >>>> wrote: >>>> >>>>> Hi folks, >>>>> >>>>> I'm running into an error with 2.10.3 when I try to write unicode text >>>>> (outside the Latin ranges) to a regular string field in a postgre >>>>> database. >>>>> Since my app is a greek language-learning application this error breaks >>>>> things completely for me. >>>>> >>>>> When I try, for example, to insert the string 'ἀγοραζε' I get the >>>>> following error: >>>>> >>>>> Traceback (most recent call last): >>>>> >>>>> File "applications/paideia/modules/paideia.py", line 168, in start >>>>> pre_bug_step_id=pre_bug_step_id) >>>>> File "applications/paideia/modules/paideia.py", line 384, in reply >>>>> response_string) >>>>> File "applications/paideia/modules/paideia.py", line 655, in >>>>> _record_step >>>>> log_record_id = db.attempt_log.insert(**log_args) >>>>> File "/home/ian/web/web2py/gluon/packages/dal/pydal/objects.py", >>>>> line 745, in insert >>>>> ret = self._db._adapter.insert(self, self._listify(fields)) >>>>> File "/home/ian/web/web2py/gluon/packages/dal/pydal/adapters/base >>>>> .py", line 729, in insert >>>>> raise e >>>>> UnicodeDecodeError: 'ascii' codec can't decode byte 0xe1 in position >>>>> 105: ordinal not in range(128) >>>>> >>>>> >>>>> The SQL being sent to the postgre adapter in this case was this: >>>>> >>>>> INSERT INTO attempt_log(name,user_response,step,score,modified_on,dt_ >>>>> attempted,in_path,uuid) VALUES (19,'ἀγοραζε',773,1.0,'2015-04-10 >>>>> 12:33:25','2015-04-10 16:33:26',657,'5918a65a-6d6f-4 >>>>> 2c6-9af2-f5d0e313701e') RETURNING id; >>>>> >>>>> When I execute that SQL command directly on the postgre database it >>>>> doesn't raise any errors and the new row is created fine. >>>>> >>>>> I've created a simple app that duplicates the error and attached the >>>>> packed app here. Since the error doesn't happen with sqlite, I've set up >>>>> the app db for a postgre database with the following connection details: >>>>> >>>>> username = 'postgres' >>>>> postgre host = 'localhost' >>>>> postgre db_name = 'unicode_bug_test' >>>>> >>>>> I've left the db password field empty in the db.py file for obvious >>>>> reasons (i.e., my local password wouldn't do anyone any good anyway). >>>>> >>>>> If you try to create a new record in the 'lemmas' table using appadmin >>>>> with non-Latin text in the 'lemma' field (something like 'βλα') you should >>>>> get the same error. >>>>> >>>>> Ian >>>>> >>>>> -- >>>>> Resources: >>>>> - http://web2py.com >>>>> - http://web2py.com/book (Documentation) >>>>> - http://github.com/web2py/web2py (Source code) >>>>> - https://code.google.com/p/web2py/issues/list (Report Issues) >>>>> --- >>>>> You received this message because you are subscribed to the Google >>>>> Groups "web2py-users" group. >>>>> To unsubscribe from this group and stop receiving emails from it, send >>>>> an email to web2py+un...@googlegroups.com. >>>>> For more options, visit https://groups.google.com/d/optout. >>>>> >>>> >>>> -- >>> Resources: >>> - http://web2py.com >>> - http://web2py.com/book (Documentation) >>> - http://github.com/web2py/web2py (Source code) >>> - https://code.google.com/p/web2py/issues/list (Report Issues) >>> --- >>> You received this message because you are subscribed to the Google >>> Groups "web2py-users" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to web2py+un...@googlegroups.com. >>> For more options, visit https://groups.google.com/d/optout. >>> >> >> -- > Resources: > - http://web2py.com > - http://web2py.com/book (Documentation) > - http://github.com/web2py/web2py (Source code) > - https://code.google.com/p/web2py/issues/list (Report Issues) > --- > You received this message because you are subscribed to the Google Groups > "web2py-users" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to web2py+unsubscr...@googlegroups.com. > For more options, visit https://groups.google.com/d/optout. > -- Resources: - http://web2py.com - http://web2py.com/book (Documentation) - http://github.com/web2py/web2py (Source code) - https://code.google.com/p/web2py/issues/list (Report Issues) --- You received this message because you are subscribed to the Google Groups "web2py-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to web2py+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
