IndexWriter concurrent flushing

2019-02-15 Thread Michael Sokolov
I noticed that commit() was taking an inordinately long time. It turned out IndexWriter was flushing using only a single thread because it relies on its caller to supply it with threads (via updateDocument, deleteDocument, etc), which it then "hijacks" to do flushing. If (as we do) a caller indexes

Re: SynonymGraphFilter can't consume an incoming graph

2019-02-15 Thread Michael Sokolov
I wonder what happens if you ensure that none of your synonyms contains a character that WDGF cares about. Then they would operate on a disjoint set of tokens, and maybe they would (or could be made to) play nicely together? Even if they hate each other (maybe they detect token graphs and fail even