Highligheter fails using JapaneseAnalyzer

2009-06-30 Thread k.sayama
hello. i've tried to highlight string using Highligheter(2.4.1) and JapaneseAnalyzer but the following code extract show the problem String F = "f"; String CONTENTS = "AAA :BBB CCC"; JapaneseAnalyzer analyzer = new JapaneseAnalyzer(); QueryParser qp = new QueryParser( F, analyzer ); Query quer

Re: Highligheter fails using JapaneseAnalyzer

2009-07-01 Thread k.sayama
might need to do something about the :. Matt k.sayama wrote: hello. i've tried to highlight string using Highligheter(2.4.1) and JapaneseAnalyzer but the following code extract show the problem String F = "f"; String CONTENTS = "AAA :BBB CCC"; JapaneseAnalyzer a

Re: Highligheter fails using JapaneseAnalyzer

2009-07-01 Thread k.sayama
te offsets produced by this particular analyzer are correct? - Original Message ---- From: k.sayama To: java-user@lucene.apache.org Sent: Wednesday, 1 July, 2009 15:22:37 Subject: Re: Highligheter fails using JapaneseAnalyzer hi I verified it by using SimpleAnalyzer, StandardAnalyzer, and C

Re: Highligheter fails using JapaneseAnalyzer

2009-07-01 Thread k.sayama
ails using JapaneseAnalyzer How should I verify it? Make sure the Token.startOffset and endOffset properties of Tokens produced by your TokenStream correctly define the location of Token.termBuffer in the original text. - Original Message ---- From: k.sayama To: java-user@lucene.apach

Re: Highligheter fails using JapaneseAnalyzer

2009-07-02 Thread k.sayama
AM Subject: Re: Highligheter fails using JapaneseAnalyzer On 1 Jul 2009, at 17:39, k.sayama wrote: I could verify Token byte offsets The sytsem outputs aaa:0:3 bbb:0:3 ccc:4:7 That explains the highlighter behaviour. Clearly BBB is not at position 0-3 in the String you supplied Strin