Ok, it does data deduplication if it is set to true.
Best
On 9/10/18 1:11 PM, Michael McCandless wrote:
The SynonymMap.Builder constructor takes a dedup parameter to tell it what
to do in that case (when input and output are identical across added rules).
Mike McCandless
https://urldefense.p
The SynonymMap.Builder constructor takes a dedup parameter to tell it what
to do in that case (when input and output are identical across added rules).
Mike McCandless
http://blog.mikemccandless.com
On Thu, Sep 6, 2018 at 2:06 PM, Baris Kazar wrote:
> Hi,-
> how does SynonymMap deal with repea
Currently, no. Patches welcome!
The synonyms are compiled into a compact FST, which is RAM resident
(but, GC efficient: it's a massive byte[], or several if your FST is
really large). Just how large is the FST in your case?
Mike McCandless
http://blog.mikemccandless.com
On Mon, Mar 3, 2014 a