Re: Strange tokenization with StandardFilter

2005-11-23 Thread yahootintin . 11533894
Yes, this is a repeat... I mailed this a few days before and it never made it to the list so I reposted. Now it suddenly appears... weird! --- java-user@lucene.apache.org wrote: > On 21 Nov 2005, at 18:54, [EMAIL PROTECTED] wrote: > > > I'm using a StandardFilter and seeing some strange tokeni

Re: Strange tokenization with StandardFilter

2005-11-23 Thread Erik Hatcher
On 21 Nov 2005, at 18:54, [EMAIL PROTECTED] wrote: I'm using a StandardFilter and seeing some strange tokenization. Here's the input: apache.org hosts lucene at apache.org. Here's the tokens it outputs: apache.org hosts lucene at apacheorg Is this a bug that apache.org and apache.org. d

Strange tokenization with StandardFilter

2005-11-23 Thread yahootintin . 11533894
I'm using a StandardFilter and seeing some strange tokenization. Here's the input: apache.org hosts lucene at apache.org. Here's the tokens it outputs: apache.org hosts lucene at apacheorg Is this a bug that apache.org and apache.org. don't convert to the same token? -