RE: Lucene 4.0 tokenstream logic

2013-07-16 Thread zzT
Hi Uwe, Thanks for your immediate response and sorry for my late reply. I managed to solve my problem. Your comment was enough to "guide" me in the right direction. The problem was indeed inside my custom Analyzers/Tokenizers. The key point here is that createComponents() is called only once whil

Lucene 4.0 tokenstream logic

2013-07-11 Thread zzT
Hi all, I'm migrating from Lucene 3.6.1 to 4.3.1 and there seems to be a major change in how analyzers work Given the code example below (which is almost copied from http://lucene.apache.org/core/4_3_1/core/index.html) @Test public void testAnalysis() throws IOException { final Strin