Re: Special characters prevent entity being indexed

2008-11-19 Thread Erick Erickson
I'm going to have to punt on what Hibernate does/doesn't do since I have no experience there. But in general analyzers are very important. StandardAnalyzer, for instance, tries to recognize e-mail addresses. So it'll create some very interesting tokens, some that are unexpected unless you really k

Re: Special characters prevent entity being indexed

2008-11-19 Thread Pekka Nykyri
Thanks for the quick answer! I haven't specified the analyzer so it should be the StandardAnalyzer. I forgot to mention that I'm using Lucene via Hibernate seach where I can easily define the fields in the hibernate POJO-classes. But as far as I know this shouldn't change things that much bec

Re: Special characters prevent entity being indexed

2008-11-18 Thread Erick Erickson
What analyzer are you using at index and search time? Typical problems include: using an analyzer that doesn't understand accented chars (StandardAnalyzer for instance) using a different anlyzer during search and index. Search the user list for "accent" and you'll find this kind of problem discuss