Re: Implementing indexing of Versioned Document Collections

2010-11-16 Thread Alex vB
Hi again, my Payloads are working fine as I figured out now (haven't seen the nextPosition method). I really have problems with adding the bitvectors. Currently I am creating them during tokenization. Therefore, as already mentioned, they are only completely created when all fields are tokenized

Re: Implementing indexing of Versioned Document Collections

2010-11-16 Thread Alex vB
Hello Pulkit, thank you for your answer and excuse me for my late reply. I am currently working on the payload stuff and have implemented my own Analyzer and Tokenfilter for adding custom payloads. As far as I understand I can add Payload for every term occurence and write this into the posting l

Re: Implementing indexing of Versioned Document Collections

2010-11-10 Thread Pulkit Singhal
1) You can attach byte array "Payloads" for every occurrence of a term during indexing. It will be stored at each term position, during indexing, and then can be retrieved during searching. You may want to consider taking this approach rather than writing bitvectors to a text file. If you feel that