Re: Looking for a MappingCharFilter that accepts regular expressions

2009-12-15 Thread Koji Sekiguchi
Paul Taylor wrote: CharStream.Found it at http://svn.apache.org/viewvc/lucene/solr/trunk/src/java/org/apache/solr/analysis/PatternReplaceFilter.java?revision=804726&view=markup, BTW why not ad this to the Lucene coebase rather than solr code base. Unfortunately it doesn't address my problem be

Re: Looking for a MappingCharFilter that accepts regular expressions

2009-12-14 Thread Paul Taylor
Paul Taylor wrote: Koji Sekiguchi wrote: Koji Sekiguchi wrote: Paul Taylor wrote: I want my search to treat 'No. 1' and 'No.1' the same, because in our context its one token I want 'No. 1' to become 'No.1', I need to do this before tokenizing because the tokenizer would split one value into

Re: Looking for a MappingCharFilter that accepts regular expressions

2009-12-14 Thread Paul Taylor
Koji Sekiguchi wrote: Koji Sekiguchi wrote: Paul Taylor wrote: I want my search to treat 'No. 1' and 'No.1' the same, because in our context its one token I want 'No. 1' to become 'No.1', I need to do this before tokenizing because the tokenizer would split one value into two terms and one i

Re: Looking for a MappingCharFilter that accepts regular expressions

2009-12-13 Thread Weiwei Wang
All solr souce downloaded, and I found PatternReplaceCharFilter is very useful for my project. Thanks On Mon, Dec 14, 2009 at 11:14 AM, Weiwei Wang wrote: > I need the source file not the patch file, where can i download it? > > > On Mon, Dec 14, 2009 at 1:15 AM, Koji Sekiguchi wrote: > >> Koji

Re: Looking for a MappingCharFilter that accepts regular expressions

2009-12-13 Thread Weiwei Wang
I need the source file not the patch file, where can i download it? On Mon, Dec 14, 2009 at 1:15 AM, Koji Sekiguchi wrote: > Koji Sekiguchi wrote: > >> Paul Taylor wrote: >> >>> I want my search to treat 'No. 1' and 'No.1' the same, because in our >>> context its one token I want 'No. 1' to beco

Re: Looking for a MappingCharFilter that accepts regular expressions

2009-12-13 Thread Koji Sekiguchi
Koji Sekiguchi wrote: Paul Taylor wrote: I want my search to treat 'No. 1' and 'No.1' the same, because in our context its one token I want 'No. 1' to become 'No.1', I need to do this before tokenizing because the tokenizer would split one value into two terms and one into just one term. I al

Re: Looking for a MappingCharFilter that accepts regular expressions

2009-12-13 Thread Koji Sekiguchi
Paul Taylor wrote: I want my search to treat 'No. 1' and 'No.1' the same, because in our context its one token I want 'No. 1' to become 'No.1', I need to do this before tokenizing because the tokenizer would split one value into two terms and one into just one term. I already use a NormalizeM

Looking for a MappingCharFilter that accepts regular expressions

2009-12-07 Thread Paul Taylor
I want my search to treat 'No. 1' and 'No.1' the same, because in our context its one token I want 'No. 1' to become 'No.1', I need to do this before tokenizing because the tokenizer would split one value into two terms and one into just one term. I already use a NormalizeMapFilter to map &' t