Indeed, it seems that the message gets encoded properly when coding=2 is added, tested manually, which implies my application causes issues. I know where to look now.
Thank you all for the quick response! On Wed, May 6, 2020 at 9:41 PM Milos Savic <sav...@gmail.com> wrote: > Thank you, Davor. > It makes sense. I have checked the code of the application used to > communicate with kannel, however, it is written in golang, which I am not > very familiar with. There is coding mentioned there, but there is also a > branch to choose. Is there a way for me to find out from the logs what is > being requested? I have debug logs on, and haven't noticed anything, but > maybe I am missing something. > > On Wed, May 6, 2020 at 9:28 PM Davor Spasoski <davor.spaso...@a1.mk> > wrote: > >> You have to do that when calling the send-url from the application >> sending the text. >> You don’t need to url encode utf-8 characters (apart from the special url >> signs) as kannel expects utf-8. Your application should ne set to >> communicate in utf-8 as well, whic it probably does because you see the >> text properly in the log files, only kannel doesn’t know that you want to >> use ucs-2 and is thus transcoding and replacing anything outside GSM 7-bit >> with ? >> >> On May 6, 2020, at 21:18, Milos Savic <sav...@gmail.com> wrote: >> >> Hi Davor, >> >> Thank you for you reply. >> >> I tried to add &coding=2 to send-url under smsc http group, but nothing >> happens. The coding parameter does end up in the dummy service. If you >> meant to add that to the application sending the request - unfortunately, I >> am not able to do that. >> >> >> On Wed, May 6, 2020 at 9:05 PM Davor Spasoski <davor.spaso...@a1.mk> >> wrote: >> >>> Hi, >>> >>> You also need to set coding=2 and charset to utf-8. Only in that case >>> kannel will know that you are submitting something outside the gsm 7-bit >>> alphabet. >>> >>> BR, >>> Davor >>> >>> On May 6, 2020, at 20:44, Milos Savic <sav...@gmail.com> wrote: >>> >>> Hi, >>> >>> I am testing a kannel installation which is supposed to send sms between >>> a python service and a sms aggregator. Regular SMSs work, so I replaced the >>> receiver with a service for testing purposes, which only logs outgoing >>> messages. >>> >>> I am using kannel from Ubuntu repositories, version 1.4.4-5, with a >>> generic type smsc, directed to my dummy receiving service, with >>> >>> send-url = http://proxy:9999/send?from=%P&to=&p&text=%b&message_id=%I >>> >>> What happens is that I send a test message with utf-8 characters, such >>> as šđčćžшђчћж, and at the end I get a message "????? ?????", with all >>> characters replaced with question marks. >>> >>> smsbox log shows a valid message, "sendsms sender:____ (<ip address>) >>> to: <recipient> msg:<šđčćž шђчћж>, all charactes valid and shown properly. >>> >>> the matching bearerbox log entry states: >>> Parsing URL `http://proxy:9999/send?from=8088&to=<encoded >>> recipient>&text=%3F%3F%3F%3F%3F+%3F%3F%3F%3F%3F&message_id=<uuid of the >>> message' >>> >>> The request at the proxy is, of course, equivalent to the parsed query. >>> >>> What happens to UTF8 characters? I tried alt-charset on smsc, but that >>> made no changes at all. It seems to me that they get lost somewhere in >>> communication between smsbox and smsc (according to logs). >>> >>> Any hints on solving this would be highly appreciated. Thank you! >>> >>> >>> >>> >>> ------------------------------ >>> >>> Disclaimer: A1 Makedonija DOOEL Skopje >>> This e-mail (including any attachments) is confidential and may be >>> protected by legal privilege. If you are not the intended recipient, you >>> should not copy it, re-transmit it, use it or disclose its contents, but >>> should return it to the sender immediately and delete your copy from your >>> system. Any unauthorized use or dissemination of this message in whole or >>> in part is strictly prohibited. Please note that e-mails are susceptible to >>> change. A1 Makedonija DOOEL Skopje shall not be liable for the improper or >>> incomplete transmission of the information contained in this communication >>> nor for any delay in its receipt or damage to your system. >>> Please, do not print this e-mail unless it is necessary! Think about >>> saving the environment! >>> >>> Напомена: А1 Македонија ДООЕЛ Скопје >>> Оваа електронска порака (вклучувајќи ги и прилозите) е доверлива и може >>> да биде заштитена со правни привилегии. Доколку не сте лицето на кое таа му >>> е наменета пораката, не треба да ја копирате, дистрибуирате или да ја >>> откривате нејзината содржина, туку веднаш да ја препратите до испраќачот и >>> да ја избришете оригиналната порака и сите нејзини копии од Вашиот >>> компјутерски систем. Секое неовластено користење на оваа порака во целост >>> или делови од истата е строго забрането. Ве молиме да забележите дека >>> електронските пораки се подложни на промени. А1 Македонија ДООЕЛ Скопје не >>> презема одговорност за несоодветно или нецелосно пренесување на >>> информациите содржани во оваа комуникација, ниту пак за било какво >>> задоцнување на приемот или оштетувања на вашиот систем. >>> Ве молиме не ја печатете оваа порака освен ако не е неопходно! Зачувајте >>> ја природата! >>> >> >> >> ------------------------------ >> >> Disclaimer: A1 Makedonija DOOEL Skopje >> This e-mail (including any attachments) is confidential and may be >> protected by legal privilege. If you are not the intended recipient, you >> should not copy it, re-transmit it, use it or disclose its contents, but >> should return it to the sender immediately and delete your copy from your >> system. Any unauthorized use or dissemination of this message in whole or >> in part is strictly prohibited. Please note that e-mails are susceptible to >> change. A1 Makedonija DOOEL Skopje shall not be liable for the improper or >> incomplete transmission of the information contained in this communication >> nor for any delay in its receipt or damage to your system. >> Please, do not print this e-mail unless it is necessary! Think about >> saving the environment! >> >> Напомена: А1 Македонија ДООЕЛ Скопје >> Оваа електронска порака (вклучувајќи ги и прилозите) е доверлива и може >> да биде заштитена со правни привилегии. Доколку не сте лицето на кое таа му >> е наменета пораката, не треба да ја копирате, дистрибуирате или да ја >> откривате нејзината содржина, туку веднаш да ја препратите до испраќачот и >> да ја избришете оригиналната порака и сите нејзини копии од Вашиот >> компјутерски систем. Секое неовластено користење на оваа порака во целост >> или делови од истата е строго забрането. Ве молиме да забележите дека >> електронските пораки се подложни на промени. А1 Македонија ДООЕЛ Скопје не >> презема одговорност за несоодветно или нецелосно пренесување на >> информациите содржани во оваа комуникација, ниту пак за било какво >> задоцнување на приемот или оштетувања на вашиот систем. >> Ве молиме не ја печатете оваа порака освен ако не е неопходно! Зачувајте >> ја природата! >> >