Re: Adding custom weights to individual terms

2014-02-14 Thread Rune Stilling
Hi Lukai That was a great help. Thank you. I’m continuing reading about payloads: http://searchhub.org/2009/08/05/getting-started-with-payloads/ Didn’t know that concept at all. Regards, Rune Den 13/02/2014 kl. 23.12 skrev lukai : > Hi, Rune: > Per your requirement, you can generate a separ

Re: Adding custom weights to individual terms

2014-02-13 Thread lukai
Hi, Rune: Per your requirement, you can generate a separated filed for the document before send document to lucene. Let's say the name is: score_field. The content of this field in this way: Doc 1#score_field: Lucence:0.7 is:0 ... Doc 2#score_field: Lucene:0.5 is:0 ... Store the field with

Re: Adding custom weights to individual terms

2014-02-13 Thread Rune Stilling
Den 13/02/2014 kl. 12.36 skrev Michael McCandless : > You could stuff your custom weights into a payload, and index that, > but this is per term per document per position, while it sounds like > you just want one float for each term regardless of which > documents/positions where that term occurre

Re: Adding custom weights to individual terms

2014-02-13 Thread Rune Stilling
I’m not sure how I would do that, when Lucene is meant to use my custom weights when calculating document weights when executing a search query. Doc 1 Lucene(0.7) is(0) a(0) powerful(0.9) indexing(0.62) and(0) search(0.99) API(0.3) Doc 2 Lucene(0.5) is(0) used by(0) a(0) lot of(0) smart(0) peopl

Re: Adding custom weights to individual terms

2014-02-13 Thread Rune Stilling
Den 13/02/2014 kl. 12.36 skrev Michael McCandless : > You could stuff your custom weights into a payload, and index that, > but this is per term per document per position, while it sounds like > you just want one float for each term regardless of which > documents/positions where that term occurre

Re: Adding custom weights to individual terms

2014-02-13 Thread Shai Erera
I often prefer to manage such weights outside the index. Usually managing them inside the index leads to problems in the future when e.g the weights change. If they are encoded in the index, it means re-indexing. Also, if the weight changes then in some segments the weight will be different than ot

Re: Adding custom weights to individual terms

2014-02-13 Thread Michael McCandless
You could stuff your custom weights into a payload, and index that, but this is per term per document per position, while it sounds like you just want one float for each term regardless of which documents/positions where that term occurred? Doing your own custom attribute would be a challenge: not

Adding custom weights to individual terms

2014-02-12 Thread Rune Stilling
Hi list I’m trying to figure out how customizable scoring and weighting is in the Lucene API. I read about the API’s but still can’t figure out if the following is possible. I would like to do normal document text indexing, but I would like to control the weight added to tokens my self, also I