Ways to store and search tens of billions of text document content in one lucene index

2017-06-22 Thread Ranganath B N
Hi, Two ways I know to accomplish this is 1, append several text documents (say 100) along with the text document number using demarcators for them in to one field of lucene document andsearch using SpanNearQuery for search terms to retrieve the matching text documents. Bu

Re: Updating the DocValues field doesn't seem to update its associated StoredField value

2017-06-22 Thread Joe Ye
Thanks a lot Mike! I still don't get any emails from the mailing list :( Note that I am new to docValues and tried to google examples to retrieve docValues from search results but I didn't find much info. I experimented with the below code using Lucene 6.2.1: for (ScoreDoc scoreDoc

Re: Get matching fields from a BooleanQuery

2017-06-22 Thread Frederik Van Hoyweghen
Thanks for the tip, Adrien! Ranganath, you can call isMatch() on your explanation. That way you know your query (for a specific field) matched a certain document. Query query = // create your query as you normally would, for 1 specific field Explanation ex = searcher.explain(query, docID); if (ex

RE: Get matching fields from a BooleanQuery

2017-06-22 Thread Ranganath B N
Hi Adrien, Using Explanation object, how do you get know which are the matching fields in a document for a query. In my case, I tried DisjunctionMaxQuery with tiebreaking matcher as 0.01f. what is the meaning of this argument?. After searching with the DisjunctionMaxQuery, I tried explain

Re: Get matching fields from a BooleanQuery

2017-06-22 Thread Adrien Grand
Hi Frederik, Using explain should be fine for that use-case since you will only apply it to the top hits. Otherwise you could use the low-level search APIs in order to do this. It would look something like that if you want to find which query among `queries` matches document `docID` (I did not che