Re: JapaneseAnalyzer's system vs user dict

2019-05-25 Thread Michael Sokolov
Thank you for the detailed responses! What Tomoko is saying seems consistent with my cursory reading of the code. The reason I asked is I have a customer that thinks they want to replace the system dictionary, and I am trying to see if that is necessary. It seems as if for the most part, we can sup

Re: JapaneseAnalyzer's system vs user dict

2019-05-25 Thread Tomoko Uchida
Hi, > If I provide entries in the user dictionary is it just as if I had included them in the system dictionary? If the same entry occurs in both, do the user dictionary weights supersede those in the system dictionary? Is there some way to suppress entries in the system dict? User dictionary is

Re: JapaneseAnalyzer's system vs user dict

2019-05-25 Thread 김남규
Hi, Mike :D Japanese Analyzer does not load dictionaries by default. If you look at the constructor, you can see that it is created as null if not set parameters. (check testUserDict3() in TestJapaneseAnalyzer.java) In JapaneseTokenizer, = if (userDicti

JapaneseAnalyzer's system vs user dict

2019-05-25 Thread Michael Sokolov
I'm trying to understand the relationship between the system and user dictionaries that JapaneseAnalyzer uses. The API allows a user to provide a user dictionary; the system one is built in. Are they otherwise the same kind of thing? If I provide entries in the user dictionary is it just as if I ha