[
https://issues.apache.org/jira/browse/SOLR-2894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13991118#comment-13991118
]
Hoss Man commented on SOLR-2894:
--------------------------------
bq. He said it's important that we don't use the variable number of shards in
this particular because it exercises a number of specific sharding situations
to ensure that we get the correct answers.
that makes complete sense -- i just wanted to make sure it's a _test_
requirement and not a _feature_ requirement. We should definitely comment the
test to that effect, and add a more randomized cloud based test with some
dynamic shard assignment as well to try and help catch strange edge cases.
I'll try to work on that to help me better understand the feature (in general,
it's been a long time since i looved at pivot faceting)
bq. I will spend some time on this on Thursday to see if I can clean this area
up and make it a little more straight forward.
that would be great, thanks. The Map vs Set aspect would be a trivial
improvement, but in general i'm more concerned about the odd flow -- it seems
like something that could easily bite us in the ass later when people try to
maintain it. It seems like it would be a lot more straight forward to:
* have modifyRequest unconditionally remove all limit/offset/overrequest params
from the shard requests
* have a simple "getOverrequestLimitAmount(String fieldName)" method in the
FacetInfo class (that consults the _original_ request params)
* have each code path (facet.field & facet.pivot & whatever down the road...)
that sets params on the shard request and cares about over requesting call
{{sreq.params.set(pre + FACET_LIMIT, getOverrequestLimitAmount(fieldName))}}
bq. Having two different purposes allows us to call refineFacets and/or
refinePivotFacets only as needed to avoid looping through the shard responses
an extra time. If your comment is more to the effect that the loop in
refineFacets() and refinePivotFacets() could be merged into a single loop...
I don't have an opinion, i just wanted to understand the purpose of the new
"PURPOSE" (heh) since we don't have a special one for range facets or query
facets -- but in hindsight i realize that of course we don't: those don't need
refinement.
> Implement distributed pivot faceting
> ------------------------------------
>
> Key: SOLR-2894
> URL: https://issues.apache.org/jira/browse/SOLR-2894
> Project: Solr
> Issue Type: Improvement
> Reporter: Erik Hatcher
> Fix For: 4.9, 5.0
>
> Attachments: SOLR-2894-reworked.patch, SOLR-2894.patch,
> SOLR-2894.patch, SOLR-2894.patch, SOLR-2894.patch, SOLR-2894.patch,
> SOLR-2894.patch, SOLR-2894.patch, SOLR-2894.patch, SOLR-2894.patch,
> SOLR-2894.patch, SOLR-2894.patch, SOLR-2894.patch, SOLR-2894.patch,
> SOLR-2894.patch, SOLR-2894.patch, SOLR-2894.patch, SOLR-2894.patch,
> SOLR-2894.patch, SOLR-2894.patch, SOLR-2894.patch, SOLR-2894.patch,
> dateToObject.patch
>
>
> Following up on SOLR-792, pivot faceting currently only supports
> undistributed mode. Distributed pivot faceting needs to be implemented.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
