Re: SynonymMap

2018-09-10 Thread baris . kazar
Ok, it does data deduplication if it is set to true. Best On 9/10/18 1:11 PM, Michael McCandless wrote: The SynonymMap.Builder constructor takes a dedup parameter to tell it what to do in that case (when input and output are identical across added rules). Mike McCandless https://urldefense.p

Re: SynonymMap

2018-09-10 Thread Michael McCandless
The SynonymMap.Builder constructor takes a dedup parameter to tell it what to do in that case (when input and output are identical across added rules). Mike McCandless http://blog.mikemccandless.com On Thu, Sep 6, 2018 at 2:06 PM, Baris Kazar wrote: > Hi,- > how does SynonymMap deal with repea

Re: SynonymMap through filesystem

2014-03-03 Thread Michael McCandless
Currently, no. Patches welcome! The synonyms are compiled into a compact FST, which is RAM resident (but, GC efficient: it's a massive byte[], or several if your FST is really large). Just how large is the FST in your case? Mike McCandless http://blog.mikemccandless.com On Mon, Mar 3, 2014 a