Re: Lucene 4.0 tokenstream logic

2014-07-10 Thread Falakh TE
Hi, I have the same problem for(String str2:split) { TokenStream stream = analyzer.tokenStream("field", new StringReader(str2)); CharTermAttribute termAtt =

RE: Lucene 4.0 tokenstream logic

2013-07-16 Thread zzT
Hi Uwe, Thanks for your immediate response and sorry for my late reply. I managed to solve my problem. Your comment was enough to "guide" me in the right direction. The problem was indeed inside my custom Analyzers/Tokenizers. The key point here is that createComponents() is called only once whil

RE: Lucene 4.0 tokenstream logic

2013-07-11 Thread Uwe Schindler
Please post the code of your TokenStream(s) thats behind this analyzer? The bug is there (and it is a bug, if it is not working correctly). The Lucene internal analyzers don't have this problem, as the TokenStreams behind that are implemented and tested. In most cases those problems appear, if t