On 06/26/2018 08:20 AM, Arthur Zakirov wrote:
Hello hackers, I'd like to propose the patch which syncs PostgreSQL snowball stemmers. As Tom pointed [1] stemmers haven't synced for a very long time. I copied all source files without changes, except replacing '#include "../runtime/header.h"' with '#include "header.h"' and removing includes of standard headers from utilities.c. Hungarian language uses ISO-8859-1 and UTF-8 charsets in Postgres HEAD. But in Snowball HEAD it is ISO-8859-2 per commit [2]. This patch changes hungarian's charset from ISO-8859-1 to ISO-8859-2 too. Additionally updated files in the patch are: - utilities.c - header.h Will add to the next commitfest. Any comments? 1 - https://www.postgresql.org/message-id/5689.1519054983%40sss.pgh.pa.us 2 - https://github.com/snowballstem/snowball/commit/4bcae97db044253ea2edae1dd3ca59f3cddd4b9d
I agree with Tom that we should sync with the upstream before we do anything else. This is a very large patch but with fairly limited impact. I think now at the start of a dev cycle is the right time to apply it.
I don't know if we have a buildfarm animal testing Hungarian. Maybe we need a buildfarm animal or two testing a large number of locales.
cheers andrew -- Andrew Dunstan https://www.2ndQuadrant.com PostgreSQL Development, 24x7 Support, Remote DBA, Training & Services