[
https://issues.apache.org/jira/browse/SOLR-2894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14046565#comment-14046565
]
Hoss Man commented on SOLR-2894:
--------------------------------
Ok, with the last patch, here are a couple of seeds that seem to reliably
reproduce some sort of infinite loop for me...
{noformat}
ant test -Dtestcase=TestCloudPivotFacet -Dtests.method=testDistribSearch
-Dtests.seed=BE59C186858EBC0E -Dtests.slow=true -Dtests.locale=es_US
-Dtests.timezone=Canada/Eastern -Dtests.file.encoding=UTF-8
...
[junit4] 2> 75419 T68 C104 P58648 oasc.SolrCore.execute [collection1]
webapp=/vv_ path=/select
params={NOW=1403913254268&version=2&facet.pivot.mincount=-1&facet=true&fpt14287=false,&distrib=false&facet.pivot={!fpt%3D14287}pivot_b,pivot_y_s&facet.limit=17&fq=id:[*+TO+232]&shard.url=https://127.0.0.1:58648/vv_/collection1/|https://127.0.0.1:58190/vv_/collection1/&rows=0&q=*:*&wt=javabin&isShard=true}
hits=112 status=0 QTime=2
[junit4] 2> 75425 T67 C104 P58648 oasc.SolrCore.execute [collection1]
webapp=/vv_ path=/select
params={NOW=1403913254268&version=2&facet.pivot.mincount=-1&facet=true&distrib=false&facet.pivot={!fpt%3D14289}pivot_b,pivot_y_s&fpt14289=false,&facet.limit=17&fq=id:[*+TO+232]&shard.url=https://127.0.0.1:58648/vv_/collection1/|https://127.0.0.1:58190/vv_/collection1/&rows=0&q=*:*&wt=javabin&isShard=true}
hits=112 status=0 QTime=1
[junit4] 2> 75430 T69 C104 P58648 oasc.SolrCore.execute [collection1]
webapp=/vv_ path=/select
params={NOW=1403913254268&version=2&facet.pivot.mincount=-1&facet=true&distrib=false&facet.pivot={!fpt%3D14291}pivot_b,pivot_y_s&facet.limit=17&fpt14291=false,&fq=id:[*+TO+232]&shard.url=https://127.0.0.1:58648/vv_/collection1/|https://127.0.0.1:58190/vv_/collection1/&rows=0&q=*:*&wt=javabin&isShard=true}
hits=112 status=0 QTime=2
[junit4] 2> 75435 T70 C104 P58648 oasc.SolrCore.execute [collection1]
webapp=/vv_ path=/select
params={NOW=1403913254268&version=2&facet.pivot.mincount=-1&facet=true&fpt14293=false,&distrib=false&facet.pivot={!fpt%3D14293}pivot_b,pivot_y_s&facet.limit=17&fq=id:[*+TO+232]&shard.url=https://127.0.0.1:58648/vv_/collection1/|https://127.0.0.1:58190/vv_/collection1/&rows=0&q=*:*&wt=javabin&isShard=true}
hits=112 status=0 QTime=2
[junit4] 2> 75440 T71 C104 P58648 oasc.SolrCore.execute [collection1]
webapp=/vv_ path=/select
params={NOW=1403913254268&version=2&facet.pivot.mincount=-1&facet=true&distrib=false&facet.pivot={!fpt%3D14295}pivot_b,pivot_y_s&facet.limit=17&fq=id:[*+TO+232]&shard.url=https://127.0.0.1:58648/vv_/collection1/|https://127.0.0.1:58190/vv_/collection1/&rows=0&q=*:*&wt=javabin&fpt14295=false,&isShard=true}
hits=112 status=0 QTime=1
[junit4] 2> 75446 T68 C104 P58648 oasc.SolrCore.execute [collection1]
webapp=/vv_ path=/select
params={NOW=1403913254268&version=2&facet.pivot.mincount=-1&facet=true&distrib=false&facet.pivot={!fpt%3D14297}pivot_b,pivot_y_s&fpt14297=false,&facet.limit=17&fq=id:[*+TO+232]&shard.url=https://127.0.0.1:58648/vv_/collection1/|https://127.0.0.1:58190/vv_/collection1/&rows=0&q=*:*&wt=javabin&isShard=true}
hits=112 status=0 QTime=1
{noformat}
{noformat}
ant test -Dtestcase=TestCloudPivotFacet -Dtests.method=testDistribSearch
-Dtests.seed=FFB687151132403E -Dtests.slow=true -Dtests.locale=es_US
-Dtests.timezone=Canada/Eastern -Dtests.file.encoding=UTF-8
...
[junit4] 2> 196659 T68 C356 P40661 oasc.SolrCore.execute [collection1]
webapp=/vtut path=/select
params={facet=true&fpt25929=-1.37306931E9&fpt25929=-1.1585728E9&fpt25929=-3.86510688E8&fpt25929=-3.42199296E8&fpt25929=-2.79124352E8&fpt25929=-2.6666448E8&fpt25929=-1.54946432E8&fpt25929=0.125&fpt25929=2956621.2&fpt25929=5.4770541E8&fpt25929=1.16071846E9&q=*:*&wt=javabin&rows=0&facet.limit=12&isShard=true&facet.pivot={!fpt%3D25929}pivot_x_s1,pivot_f&shard.url=http://127.0.0.1:40661/vtut/collection1/|http://127.0.0.1:35181/vtut/collection1/&facet.pivot.mincount=-1&version=2&distrib=false&NOW=1403914294688}
hits=269 status=0 QTime=5
[junit4] 2> 196668 T64 C356 P40661 oasc.SolrCore.execute [collection1]
webapp=/vtut path=/select
params={facet=true&q=*:*&wt=javabin&rows=0&facet.limit=12&isShard=true&fpt25931=-1.37306931E9&fpt25931=-1.1585728E9&fpt25931=-3.86510688E8&fpt25931=-3.42199296E8&fpt25931=-2.79124352E8&fpt25931=-2.6666448E8&fpt25931=-1.54946432E8&fpt25931=0.125&fpt25931=2956621.2&fpt25931=5.4770541E8&fpt25931=1.16071846E9&facet.pivot={!fpt%3D25931}pivot_x_s1,pivot_f&shard.url=http://127.0.0.1:40661/vtut/collection1/|http://127.0.0.1:35181/vtut/collection1/&facet.pivot.mincount=-1&version=2&distrib=false&NOW=1403914294688}
hits=269 status=0 QTime=5
[junit4] 2> 196678 T66 C356 P40661 oasc.SolrCore.execute [collection1]
webapp=/vtut path=/select
params={facet=true&q=*:*&wt=javabin&rows=0&facet.limit=12&isShard=true&facet.pivot={!fpt%3D25933}pivot_x_s1,pivot_f&shard.url=http://127.0.0.1:40661/vtut/collection1/|http://127.0.0.1:35181/vtut/collection1/&facet.pivot.mincount=-1&version=2&distrib=false&fpt25933=-1.37306931E9&fpt25933=-1.1585728E9&fpt25933=-3.86510688E8&fpt25933=-3.42199296E8&fpt25933=-2.79124352E8&fpt25933=-2.6666448E8&fpt25933=-1.54946432E8&fpt25933=0.125&fpt25933=2956621.2&fpt25933=5.4770541E8&fpt25933=1.16071846E9&NOW=1403914294688}
hits=269 status=0 QTime=5
[junit4] 2> 196687 T69 C356 P40661 oasc.SolrCore.execute [collection1]
webapp=/vtut path=/select
params={facet=true&fpt25935=-1.37306931E9&fpt25935=-1.1585728E9&fpt25935=-3.86510688E8&fpt25935=-3.42199296E8&fpt25935=-2.79124352E8&fpt25935=-2.6666448E8&fpt25935=-1.54946432E8&fpt25935=0.125&fpt25935=2956621.2&fpt25935=5.4770541E8&fpt25935=1.16071846E9&q=*:*&wt=javabin&rows=0&facet.limit=12&isShard=true&facet.pivot={!fpt%3D25935}pivot_x_s1,pivot_f&shard.url=http://127.0.0.1:40661/vtut/collection1/|http://127.0.0.1:35181/vtut/collection1/&facet.pivot.mincount=-1&version=2&distrib=false&NOW=1403914294688}
hits=269 status=0 QTime=5
{noformat}
(*NOTE:* Since the whole problem is that these seeds seem to go into infinite
loops, and i didn't feel like waiting for the test framework to time them out
after an hour, i pulled the seeds out of the junit "Master seed: XXXXX" log
output after killing the tests manually. The other tests.\* sys props are just
constants i picked at random when trying to reproduce to ensure that the "ant
test ..." lines i posted here would be fully reproducible)
By the looks of things, it looks the problem seems to be poping up when a
refinement constraint in a multi-level pivot involves the empty string (and/or
missing values?)
Looking back at the log snippet i posted in my previous comment
(facet.pivot=pivot_y_s,pivot_l1) and comparing that with the refinement
requests in test runs that pass, i realize how none of those refinements on the
pivot_l1 long values had a string prefix -- so perhaps the code was getting
confused about what it was supose to return, and that was then causing hte
coordinator to re-request?
just speculating here ... [~andrew.muldowney] & [~brett.lucey] -- does that
sound plausible to you?
> Implement distributed pivot faceting
> ------------------------------------
>
> Key: SOLR-2894
> URL: https://issues.apache.org/jira/browse/SOLR-2894
> Project: Solr
> Issue Type: Improvement
> Reporter: Erik Hatcher
> Assignee: Hoss Man
> Fix For: 4.9, 5.0
>
> Attachments: SOLR-2894-mincount-minification.patch,
> SOLR-2894-reworked.patch, SOLR-2894.patch, SOLR-2894.patch, SOLR-2894.patch,
> SOLR-2894.patch, SOLR-2894.patch, SOLR-2894.patch, SOLR-2894.patch,
> SOLR-2894.patch, SOLR-2894.patch, SOLR-2894.patch, SOLR-2894.patch,
> SOLR-2894.patch, SOLR-2894.patch, SOLR-2894.patch, SOLR-2894.patch,
> SOLR-2894.patch, SOLR-2894.patch, SOLR-2894.patch, SOLR-2894.patch,
> SOLR-2894.patch, SOLR-2894.patch, SOLR-2894.patch, SOLR-2894.patch,
> SOLR-2894.patch, SOLR-2894.patch, SOLR-2894.patch, SOLR-2894.patch,
> SOLR-2894.patch, SOLR-2894.patch, SOLR-2894_cloud_test.patch,
> dateToObject.patch, pivot_mincount_problem.sh
>
>
> Following up on SOLR-792, pivot faceting currently only supports
> undistributed mode. Distributed pivot faceting needs to be implemented.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]