Re: Correct usage of synonyms with Japanese

2021-05-18 Thread Michael McCandless
Hi Geoffrey, [Disclaimer: Geoffrey and I both work at Amazon on customer-facing product search] We absolutely must get SynonymGraphFilter consuming input graphs! This is just a (serious) bug in it! But it's just software, let's fix it :) That is clearly the right fix, it is just rather fun and

Correct usage of synonyms with Japanese

2021-05-18 Thread Geoffrey Lawson
Hello, I'm working on a project that involves search in Japanese and uses synonyms. The Japanese tokenizer creates an analysis graph, but the SynonymGraphFilter states it cannot take a graph as input. After a few tests I've seen it can create some unusual outputs if given a graph as input. The Syn