Re: Numeric Ranges Faceting

2017-02-20 Thread Chitra R
r each dim using the implementation that dim used (taxonomy, sorted > set, or range). The TestRangeFacetCounts shows another example of > this. > > Mike McCandless > > http://blog.mikemccandless.com > > > On Sat, Feb 18, 2017 at 6:33 AM, Chitra R wrote: > > Hi, > >

Re: Numeric Ranges Faceting

2017-02-18 Thread Chitra R
e-solr/diff/1e4463e3 > > Mike McCandless > > http://blog.mikemccandless.com > > > On Fri, Feb 17, 2017 at 11:15 AM, Chitra R wrote: > > Hey, > > I have indexed "author","module_id" fields as > > SortedSetDocValuesFacetFie

Re: Searcher Performance

2017-02-17 Thread Chitra R
e you want to warm the filesystem cache explicitly, which could be a > good idea if you have plenty of filesystem cache for your index (ie. the > unused memory of the system is larger than the index), you can look into > using MMapDirectory.setPreload. > > Le ven. 17 févr. 2017 à 15:13,

Re: Numeric Ranges Faceting

2017-02-17 Thread Chitra R
> For DrillSideways, I think you must subclass, and then override > buildFacetResult to compute your range facets, because that class > assumes it's either indexed facets or sorted set doc values facets. > > Mike McCandless > > http://blog.mikemccandless.com > > > On

Re: Numeric Ranges Faceting

2017-02-17 Thread Chitra R
Any suggestions Kindly help me to move forward. Regards, Chitra On Wed, Feb 15, 2017 at 9:23 PM, Chitra R wrote: > Hi, > Thanks for the suggestion. But in the case of drill sideways > search, retrieving allDimensions (using Facets.getAllDimension()) threw an > exc

Re: Searcher Performance

2017-02-17 Thread Chitra R
lly mostly depends on the total number of matches since Lucene needs to > call the collector on every match. > > Le ven. 17 févr. 2017 à 10:09, Chitra R a écrit : > > > Hi, > > While working with Searcher.Search, I have noticed a difference in > > their performan

Searcher Performance

2017-02-17 Thread Chitra R
Hi, While working with Searcher.Search, I have noticed a difference in their performance. I have 10 lakh documents and 30 fields in my index. I have performed three searches using different queries in a sequential manner. At search time, I used MMapDirectory and index is opened. *case1: *

Re: Numeric Ranges Faceting

2017-02-15 Thread Chitra R
.java under the lucene/demo > module... it shows how to do this. > > Mike McCandless > > http://blog.mikemccandless.com > > > On Tue, Feb 14, 2017 at 12:07 PM, Chitra R wrote: > > Hi, > >We have planned to implement both string and numeric faceting using > d

Numeric Ranges Faceting

2017-02-14 Thread Chitra R
Hi, We have planned to implement both string and numeric faceting using docvalues field. For string faceting, we have added pathtraversed dimensions in drilldownquery. But for numeric faceting , how and where can we add pathtraversed ranges during nextlevel faceted search.? And which is the

DocValues statistics helper

2017-02-09 Thread Chitra R
Hi, Great to see DocValuesStatsCollector is available in Lucene 6.4. It helps to compute statistics on DocValues Field. Hope, it has been achieved using GlobalOrdinalsCollector. My doubt is For statistics, > Global ordinals are computed only for query matching ordinals of a specific > field

Re: Maintain SortedSetDocValuesReaderState in Cache

2017-02-07 Thread Chitra R
hitra On Fri, Feb 3, 2017 at 11:32 AM, Chitra R wrote: > Hi, > > We are going to implement faceted search (for both string & numeric) > based on DocValuesField. For better performance, we decided to put the > SortedSetDocValuesReaderState in cache ie >

Maintain SortedSetDocValuesReaderState in Cache

2017-02-02 Thread Chitra R
Hi, We are going to implement faceted search (for both string & numeric) based on DocValuesField. For better performance, we decided to put the SortedSetDocValuesReaderState in cache ie *During first faceted search - new DocValuesReaderState will be opened and "$facets" values will be loade

Re: Faceting : what are the limitations of Taxonomy (Separate index and hierarchical facets) and SortedSetDocValuesFacetField ( flat facets and no sidecar index) ?

2016-11-30 Thread Chitra R
> > But before that, we could have a StatsFacets in Lucene which provide some > statistics about a numeric field (min/max/avg etc.). > > On Wed, Nov 30, 2016 at 7:50 AM Chitra R wrote: > > > Thank you so much, mike... Hope, gained a lot of stuff on Doc > > Values facet

Re: Faceting : what are the limitations of Taxonomy (Separate index and hierarchical facets) and SortedSetDocValuesFacetField ( flat facets and no sidecar index) ?

2016-11-29 Thread Chitra R
ome small > index structures are. > > When you use those fields, the bytes (for just the one doc values > field you are using) are pulled from disk, and the OS will cache them > in memory if available. > > Mike McCandless > > http://blog.mikemccandless.com > > &

DocValues Field - Memory consumption

2016-11-28 Thread Chitra R
Hi, I would like to enable doc values on all fields that I need to sort or aggregate on. At search time, I am performing sort for a single field, whether the whole doc value files (.dvd & .dvm) information are loaded in memory or a particular field information from that file(say a single

Re: Faceting : what are the limitations of Taxonomy (Separate index and hierarchical facets) and SortedSetDocValuesFacetField ( flat facets and no sidecar index) ?

2016-11-28 Thread Chitra R
2016 at 5:47 PM, Chitra R wrote: > > Kindly post your suggestions. > > Regards, > Chitra > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Sat, Nov 19, 2016 at 1:38 PM, Chitra

Min/Max values on DocValuesField

2016-11-25 Thread Chitra R
Hi, For matching documents, Is there any way to calculate mix and max values on NumericDocValuesField ( say date field)? *Case:* I would like to implement it in numeric range faceting by splitting the numeric values( from result documents) into ranges. Kindly help me to move forward.

Re: Faceting : what are the limitations of Taxonomy (Separate index and hierarchical facets) and SortedSetDocValuesFacetField ( flat facets and no sidecar index) ?

2016-11-22 Thread Chitra R
Kindly post your suggestions. Regards, Chitra On Sat, Nov 19, 2016 at 1:38 PM, Chitra R wrote: > Hey, I got it clearly. Thank you so much. Could you please help us to > implement it in our use case? > > > In our case, we are having dynamic index and

Re: Faceting : what are the limitations of Taxonomy (Separate index and hierarchical facets) and SortedSetDocValuesFacetField ( flat facets and no sidecar index) ?

2016-11-19 Thread Chitra R
ll-down on the left, on > our dog-food server > http://jirasearch.mikemccandless.com/search.py?index=jira > > Mike McCandless > > http://blog.mikemccandless.com > > > On Fri, Nov 18, 2016 at 1:43 AM, Chitra R wrote: > > case 1: > > In taxonomy, for each indexed d

Re: Faceting : what are the limitations of Taxonomy (Separate index and hierarchical facets) and SortedSetDocValuesFacetField ( flat facets and no sidecar index) ?

2016-11-17 Thread Chitra R
suggestions... Regards, Chitra On Thu, Nov 17, 2016 at 6:40 PM, Chitra R wrote: > Okay. I agree with you, Taxonomy maintains and supports hierarchical > facets during indexing. Hope hierarchical in the sense, we might index the > field > Publish date : 2010/10/15 as Publish date: 20

Re: Faceting : what are the limitations of Taxonomy (Separate index and hierarchical facets) and SortedSetDocValuesFacetField ( flat facets and no sidecar index) ?

2016-11-17 Thread Chitra R
> fields on the left and you don't lose the previous facet counts for > that field. > > Mike McCandless > > http://blog.mikemccandless.com > > > On Wed, Nov 16, 2016 at 8:51 AM, Chitra R wrote: > > Hi, > > > > Lucene-Drill sideways > > > &

Re: Faceting : what are the limitations of Taxonomy (Separate index and hierarchical facets) and SortedSetDocValuesFacetField ( flat facets and no sidecar index) ?

2016-11-16 Thread Chitra R
M, Michael McCandless < luc...@mikemccandless.com> wrote: > On Fri, Nov 11, 2016 at 5:21 AM, Chitra R wrote: > > > i)Hope, when opening SortedSetDocValuesReaderState , we are > > calculating ordinals( this will be used to calculate facet count ) for > doc > >

Re: Faceting : what are the limitations of Taxonomy (Separate index and hierarchical facets) and SortedSetDocValuesFacetField ( flat facets and no sidecar index) ?

2016-11-13 Thread Chitra R
store path and dimension in SSDVF field? Kindly post your suggestions. Regards, Chitra On Sat, Nov 12, 2016 at 4:03 AM, Michael McCandless < luc...@mikemccandless.com> wrote: > On Fri, Nov 11, 2016 at 5:21 AM, Chitra R wrote: > > > i)Hope, when opening SortedSetDocValu

Re: Faceting : what are the limitations of Taxonomy (Separate index and hierarchical facets) and SortedSetDocValuesFacetField ( flat facets and no sidecar index) ?

2016-11-11 Thread Chitra R
Hi Shai, i)Hope, when opening SortedSetDocValuesReaderState , we are calculating ordinals( this will be used to calculate facet count ) for doc values field and this only made the state instance somewhat costly. Am I right or any other reason behind that?

Re: Faceting: Taxonomy index Vs SortedSetDocValues

2016-09-26 Thread Chitra R
Hi, Kindly post your suggestions.. Chitra On Mon, Sep 26, 2016 at 3:48 PM, Chitra R wrote: > Hi, > > Issues(LUCENE-4795): Add FacetsCollector based on SortedSetDocValues > > https://issues.apache.org/jira/browse/LUCENE-4795 > > > i) In the above discussion,

Faceting: Taxonomy index Vs SortedSetDocValues

2016-09-26 Thread Chitra R
Hi, Issues(LUCENE-4795): Add FacetsCollector based on SortedSetDocValues https://issues.apache.org/jira/browse/LUCENE-4795 i) In the above discussion, mentioned that there is no need to maintain sidecar index to collect facets & its count (FacetsCollector) and even we can achieve it in flat in

Delete a specific term or facet mapping from lucene main index which refers to categories in taxonomy

2016-08-01 Thread Chitra R
Hi, I am using Lucene 4.10.4. Is there any way to delete a term or facetfield mapping from lucene main index which is used to refer the categories in taxonomy. And i know once a category is added to the taxonomy, it can never be deleted. So i am trying to remove that facet map from main index.

Re: Drawbacks of using Docvalues Fields

2016-06-03 Thread Chitra R
er _greatly_ as you get > more and more documents in your corpus if you use only > DocValues but don't have indexed="true" set. > > > Best, > Erick > > On Tue, May 31, 2016 at 10:51 PM, Chitra R wrote: > > Hi, > > I have one doubt. Actually I

Drawbacks of using Docvalues Fields

2016-05-31 Thread Chitra R
Hi, I have one doubt. Actually I have indexed 50 documents for both SortedNumericDocValuesField and IntField separately . Each document consists of 49 fields. After that, i performed indexing & searching ( with & without sorting) . It seems DocValuesField indexes and searches the docume

Re: SortedNumericDocValuesFIeld

2016-05-31 Thread Chitra R
Hi, Could you please explain how to store the SortedNumericDocValuesField to include in the code? Thanks, Chitra On Tue, May 31, 2016 at 3:02 PM, Chitra R wrote: > Thanks. > > On Fri, May 27, 2016 at 6:02 PM, Adrien Grand wrote: > >> DocValues.getSortedNumeric is

Re: SortedNumericDocValuesFIeld

2016-05-31 Thread Chitra R
building > a histogram of the prices of all matching documents, you would need to > build a custom collector and use these sorted numeric doc values to get the > prices. > > Le ven. 27 mai 2016 à 14:10, Chitra R a écrit : > > > Hi, > > > > i have achieved the

Re: SortedNumericDocValuesFIeld

2016-05-27 Thread Chitra R
ce"); Thanks, Chitra On Fri, May 27, 2016 at 3:18 PM, Chitra R wrote: > Hi, > Actually I like to print the sorted numeric list from the > sortedDocValues and I dont know which api have to use . Could you please > help me to achieve this? > > > Thanks, >

Re: SortedNumericDocValuesFIeld

2016-05-27 Thread Chitra R
out right ... did something go wrong? > > Mike McCandless > > http://blog.mikemccandless.com > > On Thu, May 26, 2016 at 9:29 AM, Chitra R wrote: > > > Hi, > > I am new to lucene. Anyone please explain how to sort the numeric > > values by SortedNumeri

SortedNumericDocValuesFIeld

2016-05-26 Thread Chitra R
Hi, I am new to lucene. Anyone please explain how to sort the numeric values by SortedNumericDocValuesField? I tried like this using Lucene 4.10.4: doc.add(new SortedNumericDocValuesField("Numericdoc_price", 1L)); doc.add(new SortedNumericDocValuesField("Numericdoc_price", 15L)); .. for (A