# New Ticket Created by  Rúbio Terra 
# Please include the string:  [perl #127075]
# in the subject line of all future correspondence about this issue. 
# <URL: https://rt.perl.org/Ticket/Display.html?id=127075 >


I can declare non-ascii tokens without problems on a grammar but I get an 
encoding error if I refer to the token using the <> syntax. This happens on 
MoarVM, it works fine on JVM.

This runs OK:

  perl6 -c -e 'grammar { token TOP { <numero>+ }; token número {<< \d+ >>} }'
  Syntax OK

Now, if I reference the new token (número) I get an error:

  perl6 -c -e 'grammar { token TOP { <número>+ }; token número {<< \d+ >>} }'
  ===SORRY!===
  Error encoding ASCII string: could not encode codepoint 250

The same code on JVM runs OK:

  perl6-j -c -e 'grammar { token TOP { <número>+ }; token número {<< \d+ >>} }'
  Syntax OK

I'm running Linux Fedora 22. Both Rakudo 2015.11 and 2015.12 exhibit the error.

Reply via email to