Re: Lucene 4 - Faceted Search with Sorting

2013-08-01 Thread Sanket Paranjape
Hi Shai, Thanks for helping out. It worked. :) I also want to add pagination feature. This can be done via searchAfter method in IndexSearcher. But, this does not have Collector (I want facets from this). I think this has been done intentionally because facets would remain same while pagin

Re: Did you Mean search on Indexes created by Different Files. -Completed.

2013-08-01 Thread Ankit Murarka
This may sound bit akward but I am now able to implement Did you mean search on Indexes. The only help came from the "Lucene In Action" book. It occured to me that Once I create index of my documents, I need to pass these indexes to SpellCheck to create his own Index.(in a new directory obvio

Re: Lucene 4.3.1 CheckIndex limitation 100 trillion tokens?

2013-08-01 Thread Robert Muir
On Thu, Aug 1, 2013 at 6:40 PM, Tom Burton-West wrote: > Hi all, > > OK, I really should have titled the post, "CheckIndex limit with large tvd > files?" > > I started a new CheckIndex run about 1:00 pm on Tuesday and it seems to be > stuck again looking at termvectors. > I gave CheckIndex 32GB o

Re: Lucene 4.3.1 CheckIndex limitation 100 trillion tokens?

2013-08-01 Thread Tom Burton-West
Hi all, OK, I really should have titled the post, "CheckIndex limit with large tvd files?" I started a new CheckIndex run about 1:00 pm on Tuesday and it seems to be stuck again looking at termvectors. I gave CheckIndex 32GB of memory, turned on GC logging, and echoed STDERR and STDOUT to a file

Join Util with Filter Queries

2013-08-01 Thread Shane Strasser
Hey All, We're currently looking into using the Join Utility (we're on version 4.0 and are in the process of moving to 4.3) and have started to prototype some of the tools. One thing we'll need to be able to do is add filter queries. The question I have is that based on the documentation it almos

Re: lucene 4.3 seems to be much slower in indexing than lucene 3.6?

2013-08-01 Thread Simon Willnauer
one thing I wonder is if you could just publish your benchmark code? simon On Thu, Aug 1, 2013 at 7:45 PM, Michael McCandless wrote: > On Wed, Jul 31, 2013 at 7:17 PM, Zhang, Lisheng > wrote: >> >> Hi Mike, >> >> I retested and results are the same: >> >> 1/ I did not use sort (so FieldCache sh

Re: Lucene 4 - Faceted Search with Sorting

2013-08-01 Thread Shai Erera
Hi You should do the following: TopFieldCollector tfc = TopFieldCollector.create(); FacetsCollector fc = FacetsCollector.create(); searcher.search(query, MultiCollector.wrap(tfc, fc)); Basically IndexSearcher.search(..., Sort) creates TopFieldCollector internally, so you need to create it outsid

Re: lucene 4.3 seems to be much slower in indexing than lucene 3.6?

2013-08-01 Thread Michael McCandless
On Wed, Jul 31, 2013 at 7:17 PM, Zhang, Lisheng wrote: > > Hi Mike, > > I retested and results are the same: > > 1/ I did not use sort (so FieldCache should not enter picture?) No grouping or joining either (they will use FieldCache, if it's not against a doc values field). What sort of queries

Lucene 4 - Faceted Search with Sorting

2013-08-01 Thread Sanket Paranjape
I am trying to move from lucene 2.4 to 4.4. I had used bobo-browse for faceting in 2.4. I used below code (from Lucene examples) to query documents and get facets. List categories = new ArrayList(); categories.add(new CountFacetRequest(new CategoryPath("CATEGORY_PATH", '/'), 10)); Fac

Re: Did you Mean search on Indexes created by Different Files.

2013-08-01 Thread Ankit Murarka
Hi, I might be sounding confusing. I will list down the problem. a. Example takes the reader and I supply my own index path. b. I am analyzing the string with the same analyzer used for indexing. Dont worry. I know its a common pitfall and I have avoided it from the day 1. :) c. The sugges