Re: Bug#959474: Issues with Chinese language (all variants) when building some pages in buster

2020-05-05 Thread Jakub Wilk
* Damyan Ivanov , 2020-05-05, 08:45: Strangely, replacing -CS with a call to STDIN->binmode("UTF-8") doesn't help: echo 包 | perl -E 'STDIN->binmode("UTF-8"); while(<>) { s|\s+\n|\n|sg; print }' � That's because "UTF-8" is not a valid argument for binmode(). You want: $ echo 包 | perl -E 'ST

Re: Bug#959761: Bug#959474: Issues with Chinese language (all variants) when building some pages in buster

2020-05-05 Thread Axel Beckert
Hi Damyan, Damyan Ivanov wrote: > (not a Perl maintainer here) Did help nevertheless. Just didn't want to spam the whole Perl Team with potential Perl bugs. ;-) > -=| Axel Beckert, 05.05.2020 03:34:28 +0200 |=- > > → echo 包 | perl -pe 's|\s+\n|\n|sg;' > > 包 > > → echo 包 | perl -M"feature unicode

Re: Bug#959761: Bug#959474: Issues with Chinese language (all variants) when building some pages in buster

2020-05-05 Thread gregor herrmann
On Tue, 05 May 2020 10:53:29 +0200, Axel Beckert wrote: > > Perhaps the strings in wml need to be decoded from UTF-8 so that they > > aren't treated as a sequence of independent bytes? > ... and would have expect "use feature unicode_strings;" already > activates all of this. (I haven't read the