[Suggestions Required] 110 Concurrency users indexing on Lucene dont finish in 200 ms.

2014-02-10 Thread Umashanker, Srividhya
Group - We have an Indexing and Searching Service (using Lucene 4.0) implemented over REST as part of our framework, which all the related modules will use to publish data that make it available for the UI. Moreover, every rest call that our service receives has a proxy timeout limit of 20

Re: Faceting and Query-time Joins

2014-02-10 Thread Jon Stewart
Child values. There really isn't a true parent, other than to refer to the collection of children. However, the children are all of different types and I'd expect that a given facet would only pertain to a given child, i.e., you're not going to get a second child which involves the same facet. A b

Re: New to Apache Lucene: Need help in querying data - text with wildCards

2014-02-10 Thread gudiseashok
Hi Michael Thank you very much for your response, before I am trying your solution (writing my own analyzer) I am just using Standard Analyzer which is available in the example in lucene documentation, please see here my code which is writing to lucene, [code] File indexDirFile = new File(this

Re: New to Apache Lucene: Need help in querying data - text with wildCards

2014-02-10 Thread Michael McCandless
Likely your analyzer (which one are you using?) is breaking up your text into tokens you don't expect? If you use QueryParser, passing the same analyzer, then it will also tokenize your query into the same tokens, and you should get the expected hits. But you may need your own analyzer to "proper

New to Apache Lucene: Need help in querying data - text with wildCards

2014-02-10 Thread gudiseashok
I have an application which is a log-analyzer, and I am using Apache Lucene to index my data, and I am storing only message in it (I am not storing all other fields in my object), and I am not using any database so I am using store for message though its huge) but I am taking care of deleting this

Re: Faceting and Query-time Joins

2014-02-10 Thread Michael McCandless
Are you faceting on parent values or child values? Parent values should be easy; child values is not. Mike McCandless http://blog.mikemccandless.com On Mon, Feb 10, 2014 at 9:05 AM, Jon Stewart wrote: > Hello, > > tl;dr: I'd like to know how to do faceting over the result set of a > query-tim

Re: Regarding DrillDown search

2014-02-10 Thread Shai Erera
You're welcome. And I suggest that you upgrade to 4.7 as soon as it's out! :) Shai On Mon, Feb 10, 2014 at 5:48 PM, Jebarlin Robertson wrote: > Hi Shai, > > Yeah exactly the same way I want to display. > > Then I will do the same way of stored field. > > It is not about lack of creativity, I mi

Re: Regarding DrillDown search

2014-02-10 Thread Jebarlin Robertson
Hi Shai, Yeah exactly the same way I want to display. Then I will do the same way of stored field. It is not about lack of creativity, I might have not explained you in the proper way :) Thank you for all the support :) On Tue, Feb 11, 2014 at 12:23 AM, Shai Erera wrote: > What you want sou

Re: Regarding DrillDown search

2014-02-10 Thread Shai Erera
What you want sounds like grouping more like faceting? So e.g. if you have an Author field with values A1, A2, A3, and the user searches for 'love', then if I understand correctly, you want to display something like: Author/A1 Doc1 Doc2 Author/A2 Doc3 Doc4 Author/A3 Doc5 Doc6 Is that

Re: Regarding DrillDown search

2014-02-10 Thread Jebarlin Robertson
Hi Shai, Thanks for the explanation :) For my requirement, I just want to display the list of resulted documents to the user. In Facet search case also, I already have the resulted documents list in TopDoc and the FacetResults have only the count of documents contributed to each Catagory, Accord

Faceting and Query-time Joins

2014-02-10 Thread Jon Stewart
Hello, tl;dr: I'd like to know how to do faceting over the result set of a query-time join (JoinUtils). If it's not currently supported by Lucene, I'd appreciate some pointers about what needs to be done. I'm working on a greenfields project with Lucene 4.6. The application treats its primary obj

Re: Regarding DrillDown search

2014-02-10 Thread Shai Erera
Ahh I see ... so given a single FacetResultNode, you would like to know which documents contributed to its weight (count in your case). This is not available immediately, that's why you need to do a drill-down query. So if you return the user a list of categories, when he clicks one of them, you pe

Re: Regarding DrillDown search

2014-02-10 Thread Jebarlin Robertson
Hi Shai, Thanks, I am using the same way of BooleanQuery only with list of PrefixQuery only. I think I confused you sorry :) . I am using the same above code to get the result of documents. I am getting the TopDocs and retrieving the Documents also, If I don't even try that for the basic you wil

Re: Regarding DrillDown search

2014-02-10 Thread Shai Erera
Hi You will need to build a BooleanQuery which comprises a list of PrefixQuery. The relation between each PrefixQuery should be OR or AND, as you see fit (I believe OR?). In order to get documents' attributes you should execute searcher.search() w/ e.g. MultiCollector which wraps a FacetsCollecto

Re: Regarding DrillDown search

2014-02-10 Thread Jebarlin Robertson
Dear Shai, Thank you for the quick response :) I have checked with PrefixQuery and term, it is working fine, But I think I cannot pass multiple Category path in it. I am calling the DrillDown.term() method 'N' number of times based on the number of Category Path list. And I have one more questio