Custom tokens creation in Lucene/Solr

2011-09-04 Thread Lior Barnea
Hi all, I want to add user created tokens to a text field at index time, I want to pass some metadata to a custom filter I wrote that adds tokens to the tokenstream. I tried to add the metadata to the text and strip it with a custom tokenizer but I didn't find a good way to pass it to my filter

Custom tokens creation in Lucene/Solr

2011-09-04 Thread Lior Barnea
Hi all, I want to add user created tokens to a text field at index time, I want to pass some metadata to a custom filter I wrote that adds tokens to the tokenstream. I tried to add the metadata to the text and strip it with a custom tokenizer but I didn't find a good way to pass it to my filter

Re: Custom tokens creation in Lucene/Solr

2011-09-04 Thread Saar Carmi
Have you tried to look at Payloads ? Saar On Sun, Sep 4, 2011 at 10:45 AM, Lior Barnea wrote: > Hi all, > > I want to add user created tokens to a text field at index time, I want to > pass some metadata to a custom filter I wrote that adds tokens to the > tokenstream. > > I tried to add the me

RE: Custom tokens creation in Lucene/Solr

2011-09-04 Thread Lior Barnea
I can add the metadata to a token's payload BUT there is not guarantee that other filters wont mess/delete the payload or the token itself in the analyzer chain... -Original Message- From: Saar Carmi [mailto:saarca...@gmail.com] Sent: Sunday, September 04, 2011 5:00 PM To: java-user@lu

Re: Castle for Lucene/Solr?

2011-09-04 Thread Glen Newton
"Caste" --> Castle https://bitbucket.org/acunu http://support.acunu.com/entries/20216797-castle-build-instructions It looks very promising. It is a kernel module and I'm not sure it can run in user space, which I'd prefer. -Glen Newton On Sat, Sep 3, 2011 at 9:21 PM, Otis Gospodnetic wrote: >