Hi there,
If we are talking about SolrCloud. Up to 9.2 let to join "from" fully
replicated single shard collection "to" a many shards collection.
Starting from 9.3 Solr can join from many shards to many shards
collections, but route fields should be the fields, which are used in join
query.
AffinityFactoryPlugin.withCollectionShards may be used to collocate
corresponding collection shards.
On Wed, Jul 19, 2023 at 11:03 PM Ron Haines <mickr...@gmail.com> wrote:
> Well, that's interesting. I was under the impression that the 'join'
> required the 'joining' docs to be located on the same shard. I'd actually
> experienced fewer matches with the join, until I made sure the docs to
> 'join to' were located on the same shard as the docs that were doing the
> 'joining'. Maybe I'm confused...it would make my life a bit easier, if the
> 'same shard' requirement were not necessary.
>
> Ron Haines
>
> On Wed, Jul 19, 2023 at 3:11 PM Charles Sanders <csand...@redhat.com>
> wrote:
>
> > Thanks for the reply Ron. You bring up a good question and something I
> > need to consider. However in the solr 7 system the records are not on
> the
> > same shard. They are spread across 2 shards.
> >
> > Currently I'm working on a small test instance so I know exactly what
> data
> > I have. I will investigate the multiple shards question.
> >
> > Thanks
> >
> > On Wed, Jul 19, 2023 at 2:57 PM Ron Haines <mickr...@gmail.com> wrote:
> >
> > > After your migration, did your documents that should 'join' end up
> > located
> > > on the same shard? I believe that is a requirement.
> > >
> > > Ron Haines
> > >
> > > On Wed, Jul 19, 2023 at 1:04 PM Charles Sanders <csand...@redhat.com>
> > > wrote:
> > >
> > > > Thanks again Mikhail for your reply. Yes there are absolutely
> matches
> > > for
> > > > the subquery. This query should return 1 result. I'm working off a
> > > small
> > > > test collection.
> > > >
> > > > Here are the results of a debug.
> > > >
> > > > {
> > > > "responseHeader":{
> > > > "zkConnected":true,
> > > > "status":0,
> > > > "QTime":3,
> > > > "params":{
> > > > "q":"{!join from=image_id
> > > > to=image_record_id}(registry:\"registry.access.redhat.com\" AND
> > > > repository:\"rhel6/rhel\" AND published:true)&rows=100&start=0",
> > > > "indent":"true",
> > > > "q.op":"AND",
> > > > "debugQuery":"true",
> > > > "useParams":""}},
> > > >
> > > >
> > >
> >
> "response":{"numFound":0,"start":0,"maxScore":0.0,"numFoundExact":true,"docs":[]
> > > > },
> > > > "debug":{
> > > > "track":{
> > > > "rid":"localhost-96",
> > > > "EXECUTE_QUERY":{
> > > > "
> > > >
> > >
> >
> http://localhost:7574/solr/rhcc_shard2_replica_n6/|http://localhost:8983/solr/rhcc_shard2_replica_n2/
> > > > ":{
> > > > "QTime":"1",
> > > > "ElapsedTime":"2",
> > > > "RequestPurpose":"GET_TOP_IDS,SET_TERM_STATS",
> > > > "NumFound":"0",
> > > > "Response":"{responseHeader={zkConnected=true, status=0,
> > > > QTime=1, params={df=text, distrib=false, qt=select, debug=[false,
> > > > timing, track], fl=[id, score], shards.purpose=16388, start=0,
> > > > fsv=true, q.op=AND,
> > > > shard.url=
> > > >
> > >
> >
> http://localhost:7574/solr/rhcc_shard2_replica_n6/|http://localhost:8983/solr/rhcc_shard2_replica_n2/
> > > > ,
> > > > rows=10, rid=localhost-96, version=2, q={!join from=image_id
> > > > to=image_record_id}(registry:\"registry.access.redhat.com\" AND
> > > > repository:\"rhel6/rhel\" AND published:true)&rows=100&start=0,
> > > > omitHeader=false, requestPurpose=GET_TOP_IDS,SET_TERM_STATS,
> > > > NOW=1689786155982, isShard=true, wt=javabin, debugQuery=false,
> > > > useParams=}},
> > > >
> response={numFound=0,numFoundExact=true,start=0,maxScore=0.0,docs=[]},
> > > > sort_values={}, debug={join={{!join from=image_id
> > > > to=image_record_id}+(+registry:registry.access.redhat.com
> > > > +repository:rhel6/rhel +published:T) +text:&rows=100&start=0={time=0,
> > > > fromSetSize=0, toSetSize=0, fromTermCount=0, fromTermTotalDf=0,
> > > > fromTermDirectCount=0, fromTermHits=0, fromTermHitsTotalDf=0,
> > > > toTermHits=0, toTermHitsTotalDf=0, toTermDirectCount=0,
> > > > smallSetsDeferred=0, toSetDocsAdded=0}}, timing={time=1.0,
> > > > prepare={time=0.0, query={time=0.0}, facet={time=0.0},
> > > > facet_module={time=0.0}, mlt={time=0.0}, highlight={time=0.0},
> > > > stats={time=0.0}, expand={time=0.0}, terms={time=0.0},
> > > > debug={time=0.0}}, process={time=0.0, query={time=0.0},
> > > > facet={time=0.0}, facet_module={time=0.0}, mlt={time=0.0},
> > > > highlight={time=0.0}, stats={time=0.0}, expand={time=0.0},
> > > > terms={time=0.0}, debug={time=0.0}}}}}"},
> > > > "
> > > >
> > >
> >
> http://localhost:8983/solr/rhcc_shard1_replica_n1/|http://localhost:7574/solr/rhcc_shard1_replica_n4/
> > > > ":{
> > > > "QTime":"0",
> > > > "ElapsedTime":"2",
> > > > "RequestPurpose":"GET_TOP_IDS,SET_TERM_STATS",
> > > > "NumFound":"0",
> > > > "Response":"{responseHeader={zkConnected=true, status=0,
> > > > QTime=0, params={df=text, distrib=false, qt=select, debug=[false,
> > > > timing, track], fl=[id, score], shards.purpose=16388, start=0,
> > > > fsv=true, q.op=AND,
> > > > shard.url=
> > > >
> > >
> >
> http://localhost:8983/solr/rhcc_shard1_replica_n1/|http://localhost:7574/solr/rhcc_shard1_replica_n4/
> > > > ,
> > > > rows=10, rid=localhost-96, version=2, q={!join from=image_id
> > > > to=image_record_id}(registry:\"registry.access.redhat.com\" AND
> > > > repository:\"rhel6/rhel\" AND published:true)&rows=100&start=0,
> > > > omitHeader=false, requestPurpose=GET_TOP_IDS,SET_TERM_STATS,
> > > > NOW=1689786155982, isShard=true, wt=javabin, debugQuery=false,
> > > > useParams=}},
> > > >
> response={numFound=0,numFoundExact=true,start=0,maxScore=0.0,docs=[]},
> > > > sort_values={}, debug={join={{!join from=image_id
> > > > to=image_record_id}+(+registry:registry.access.redhat.com
> > > > +repository:rhel6/rhel +published:T) +text:&rows=100&start=0={time=0,
> > > > fromSetSize=0, toSetSize=0, fromTermCount=3, fromTermTotalDf=3,
> > > > fromTermDirectCount=3, fromTermHits=0, fromTermHitsTotalDf=0,
> > > > toTermHits=0, toTermHitsTotalDf=0, toTermDirectCount=0,
> > > > smallSetsDeferred=0, toSetDocsAdded=0}}, timing={time=0.0,
> > > > prepare={time=0.0, query={time=0.0}, facet={time=0.0},
> > > > facet_module={time=0.0}, mlt={time=0.0}, highlight={time=0.0},
> > > > stats={time=0.0}, expand={time=0.0}, terms={time=0.0},
> > > > debug={time=0.0}}, process={time=0.0, query={time=0.0},
> > > > facet={time=0.0}, facet_module={time=0.0}, mlt={time=0.0},
> > > > highlight={time=0.0}, stats={time=0.0}, expand={time=0.0},
> > > > terms={time=0.0}, debug={time=0.0}}}}}"}}},
> > > > "join":{
> > > > "{!join from=image_id
> > > > to=image_record_id}+(+registry:registry.access.redhat.com
> > > > +repository:rhel6/rhel +published:T) +text:&rows=100&start=0":{
> > > > "time":0,
> > > > "fromSetSize":0,
> > > > "toSetSize":0,
> > > > "fromTermCount":3,
> > > > "fromTermTotalDf":3,
> > > > "fromTermDirectCount":3,
> > > > "fromTermHits":0,
> > > > "fromTermHitsTotalDf":0,
> > > > "toTermHits":0,
> > > > "toTermHitsTotalDf":0,
> > > > "toTermDirectCount":0,
> > > > "smallSetsDeferred":0,
> > > > "toSetDocsAdded":0}},
> > > > "timing":{
> > > > "time":1.0,
> > > > "prepare":{
> > > > "time":0.0,
> > > > "query":{
> > > > "time":0.0},
> > > > "facet":{
> > > > "time":0.0},
> > > > "facet_module":{
> > > > "time":0.0},
> > > > "mlt":{
> > > > "time":0.0},
> > > > "highlight":{
> > > > "time":0.0},
> > > > "stats":{
> > > > "time":0.0},
> > > > "expand":{
> > > > "time":0.0},
> > > > "terms":{
> > > > "time":0.0},
> > > > "debug":{
> > > > "time":0.0}},
> > > > "process":{
> > > > "time":0.0,
> > > > "query":{
> > > > "time":0.0},
> > > > "facet":{
> > > > "time":0.0},
> > > > "facet_module":{
> > > > "time":0.0},
> > > > "mlt":{
> > > > "time":0.0},
> > > > "highlight":{
> > > > "time":0.0},
> > > > "stats":{
> > > > "time":0.0},
> > > > "expand":{
> > > > "time":0.0},
> > > > "terms":{
> > > > "time":0.0},
> > > > "debug":{
> > > > "time":0.0}}},
> > > > "rawquerystring":"{!join from=image_id
> > > > to=image_record_id}(registry:\"registry.access.redhat.com\" AND
> > > > repository:\"rhel6/rhel\" AND published:true)&rows=100&start=0",
> > > > "querystring":"{!join from=image_id
> > > > to=image_record_id}(registry:\"registry.access.redhat.com\" AND
> > > > repository:\"rhel6/rhel\" AND published:true)&rows=100&start=0",
> > > > "parsedquery":"JoinQuery({!join from=image_id
> > > > to=image_record_id}+(+registry:registry.access.redhat.com
> > > > +repository:rhel6/rhel +published:T) +text:&rows=100&start=0)",
> > > > "parsedquery_toString":"{!join from=image_id
> > > > to=image_record_id}+(+registry:registry.access.redhat.com
> > > > +repository:rhel6/rhel +published:T) +text:&rows=100&start=0",
> > > > "QParser":"",
> > > > "explain":{}}}
> > > >
> > > >
> > > > On Wed, Jul 19, 2023 at 12:50 PM Mikhail Khludnev <m...@apache.org>
> > > wrote:
> > > >
> > > > > ok. How is the query parsed (debugQuery=true)? Does the subquery
> have
> > > > > matches?
> > > > >
> > > > > On Wed, Jul 19, 2023 at 7:36 PM Charles Sanders <
> csand...@redhat.com
> > >
> > > > > wrote:
> > > > >
> > > > > > Thanks for the reply Mikhail. They are of type String. And
> yes, I
> > > > > > believe I saw that about integers as well.
> > > > > >
> > > > > > Thanks,
> > > > > > Charles
> > > > > >
> > > > > > On Wed, Jul 19, 2023 at 12:29 PM Mikhail Khludnev <
> m...@apache.org
> > >
> > > > > wrote:
> > > > > >
> > > > > > > Hello Charles
> > > > > > > What are image_id and image_record_id types? I roughly remember
> > > some
> > > > > > > mentions in the guide that integers might not be supported.
> > > > > > >
> > > > > > > On Wed, Jul 19, 2023 at 5:09 PM Charles Sanders <
> > > csand...@redhat.com
> > > > >
> > > > > > > wrote:
> > > > > > >
> > > > > > > > Hello,
> > > > > > > > I have an application using Solr 7.7.2. We are upgrading to
> > Solr
> > > > > > 9.2. I
> > > > > > > > have a join query that works fine in 7.7.2, but returns no
> > > results
> > > > in
> > > > > > > 9.2,
> > > > > > > > It does not return an error, just no results.
> > > > > > > >
> > > > > > > > Any idea as to what I should look at to resolve the issue? I
> > > don't
> > > > > > know
> > > > > > > if
> > > > > > > > anything changed regarding join queries in 7 to 9. I did not
> > see
> > > > > > > anything
> > > > > > > > in the documentation.
> > > > > > > >
> > > > > > > > My query is:
> > > > > > > > q={!join from=image_id to=image_record_id}(registry:"
> > > > > > > > registry.access.redhat.com" AND repository:"rhel6/rhel" AND
> > > > > > > > published:true)&rows=100&start=0
> > > > > > > >
> > > > > > > > Any help is greatly appreciated.
> > > > > > > > -Charles
> > > > > > > >
> > > > > > > > Wyrd bið ful aræd
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > Sincerely yours
> > > > > > > Mikhail Khludnev
> > > > > > >
> > > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Sincerely yours
> > > > > Mikhail Khludnev
> > > > >
> > > >
> > >
> >
>
--
Sincerely yours
Mikhail Khludnev
