Re: question on docker example from guide

[Thomas Corthals]

Hi Vince,

If you want to run the techproducts examples, these commands from
https://stackoverflow.com/a/55171062 do the trick:

   - docker run --name my_solr -d -p 8983:8983 -t solr
   - docker exec -it --user=solr my_solr bin/solr create_core -c
   techproducts
   - docker exec -it --user=solr my_solr bin/post -c techproducts
   example/exampledocs/

Thomas

Op do 26 okt 2023 om 04:42 schreef Vince McMahon <
sippingonesandze...@gmail.com>:

> ok, so those are commands.  I can't find them.
>
> I'm running into many problems to get any of the examples to start.
>
> Is there a clean version of the docker to learn solr?  Is there any YouTube
> videos can help me jump start?  My primary job is to dev an app and I'm in
> a tight deadline.  Running solr will not help me keeping my job.
>
> Please help.
>

Help Solr Newsletter October 2023 with links, blogs, articles

[Arrieta, Alejandro]

Hello Solr Community,

We are working on the October Newsletter, and Solr/Lucene/search-related
content is welcome.

Please check the draft here:
https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=272927879

If the content you want to suggest is not there, please add it to the wiki
or reply to this email thread with the following:

title
Two lines description
link

What we are looking for is:

-meetups or conferences that will take place in the following months,
starting in November 2023.
-blogs, photos, videos, and recordings of the Search/Solr/Lucene-related
meetups conference in October 2023 or before. If the talk is good, could
you send the link?
-any article, blog, post, or link you think is exciting and relevant to
Solr/Search/Lucene/community, even if it is older.

We plan to finish the Solr Newsletter October 2023 edition on the first
days of November. You still have five days.

Kind Regards,
Alejandro Arrieta

Re: Help Solr Newsletter October 2023 with links, blogs, articles

[Charlie Hull]

Hi Alejandro,

We've got a wealth of Solr related content to contribute, the question 
might be how much do you want? :-)


1. Talk videos about Solr
From our conferences and others, everything is categorised here 
https://opensourceconnections.com/about-us/videos-about-search/ with a 
Solr playlist at

https://www.youtube.com/playlist?list=PLCoJWKqBHERuLJgmR0PhiXmS3TUYjWatW

2. Tools compatible with Solr
We have Quepid for recording relevance judgements and adjusting Solr 
queries https://opensourceconnections.com/about-us/tools/#quepid

Splainer which decodes debug query information https://www.splainer.io
Querqy/SMUI for rules-based query rewriting 
https://opensourceconnections.com/about-us/tools/#querqy
Chorus which wraps some of the above into a e-commerce search reference 
implementation with a series of videos to introduce it 
https://opensourceconnections.com/blog/2020/07/07/meet-pete-the-e-commerce-search-product-manager/


3. Blogs on Solr https://opensourceconnections.com/?s=solr making a 
significant proportion of the 800+ blogs on OSC's site


4. Haystack, the search & AI event we run, has always featured talks on 
Solr https://www.haystackconf.com - the next events will be April (USA) 
and September/October (UK) plus we have a Haystack on Tour event in 
Austin, Texas on November 8th 
https://opensourceconnections.com/event/haystack-on-tour-austin-texas/


5. Search Solutions is one of my favourite search events and happens in 
London on November 21/22 
https://opensourceconnections.com/event/pragmatic-ai-powered-search-solutions-at-the-british-computer-society/


6. There's a #solr channel in Relevance Slack (over 4600 people in this 
Slack now!)


I'll stop now to let you catch your breath a bit :)

Cheers

Charlie

On 26/10/2023 14:11, Arrieta, Alejandro wrote:

Hello Solr Community,

We are working on the October Newsletter, and Solr/Lucene/search-related
content is welcome.

Please check the draft here:
https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=272927879

If the content you want to suggest is not there, please add it to the wiki
or reply to this email thread with the following:

title
Two lines description
link

What we are looking for is:

-meetups or conferences that will take place in the following months,
starting in November 2023.
-blogs, photos, videos, and recordings of the Search/Solr/Lucene-related
meetups conference in October 2023 or before. If the talk is good, could
you send the link?
-any article, blog, post, or link you think is exciting and relevant to
Solr/Search/Lucene/community, even if it is older.

We plan to finish the Solr Newsletter October 2023 edition on the first
days of November. You still have five days.

Kind Regards,
Alejandro Arrieta


--
Charlie Hull - Managing Consultant at OpenSource Connections Limited
Founding member of The Search Network and co-author of Searching the Enterprise
tel/fax: +44 (0)8700 118334
mobile: +44 (0)7767 825828

OpenSource Connections Europe GmbH | Pappelallee 78/79 | 10437 Berlin
Amtsgericht Charlottenburg | HRB 230712 B
Geschäftsführer: John M. Woodell | David E. Pugh
Finanzamt: Berlin Finanzamt für Körperschaften II

Re: question on docker example from guide

[Vince McMahon]

THank you,  Thomas.

It works.

ufuk yılmaz uyil...@vivaldi.net, I'm on a win 10 docker  20 and Thomas'
commands works.  Good luck.


On Thu, Oct 26, 2023 at 3:59 AM Thomas Corthals 
wrote:

> Hi Vince,
>
> If you want to run the techproducts examples, these commands from
> https://stackoverflow.com/a/55171062 do the trick:
>
>- docker run --name my_solr -d -p 8983:8983 -t solr
>- docker exec -it --user=solr my_solr bin/solr create_core -c
>techproducts
>- docker exec -it --user=solr my_solr bin/post -c techproducts
>example/exampledocs/
>
> Thomas
>
> Op do 26 okt 2023 om 04:42 schreef Vince McMahon <
> sippingonesandze...@gmail.com>:
>
> > ok, so those are commands.  I can't find them.
> >
> > I'm running into many problems to get any of the examples to start.
> >
> > Is there a clean version of the docker to learn solr?  Is there any
> YouTube
> > videos can help me jump start?  My primary job is to dev an app and I'm
> in
> > a tight deadline.  Running solr will not help me keeping my job.
> >
> > Please help.
> >
>

Re: Question on "useColdSearcher"

[Surya R]

Thanks Shawn, for the quick response.

That was my assumption that some queries were taking longer time during the
warmup. That is why I turned off the warmup count and made it to zero, but
still the slow behavior.

One thing I was curious about was, if the cache was being warmed up with
queries from the listener, why was I not seeing them in the solr.log, could
it be the verbosity level ?

Yes we do have few servers behind the load balancer, So i will go with
*useColdSearcher* to *True* and see how it goes. But atleast it will start
responding quickly.


thank you
Surya

On Wed, Oct 25, 2023 at 6:10 PM Shawn Heisey 
wrote:

> On 10/25/23 09:05, Surya R wrote:
> > I started playing with this setting "
> > *false* " in the solr config.xml,
> when
> > i made it "*true*", which implies to use the cold searcher, I get
> response
> > immediately after a core restart.
> >
> > But if i leave the default, which is "*false*" it takes a long time.
>
> It sounds like you probably have a bunch of slow queries in a
> firstSearcher listener config.  Maybe you did not have those slow
> queries in the 6.x config, so the searcher was available right away.  Or
> maybe the 6.x config was different in some other way that made those
> warming queries complete quickly.
>
> Generally, I would probably run with useColdSearcher set to true, even
> you have a number of Solr servers behind a load balancer.  That way the
> searcher will be usable immediately, even if it is not warmed yet by the
> queries in the firstSearcher listener.
>
> Thanks,
> Shawn
>
>

-- 
-- Surya

Re: Question on "useColdSearcher"

[Shawn Heisey]

On 10/26/23 08:36, Surya R wrote:

That was my assumption that some queries were taking longer time during the
warmup. That is why I turned off the warmup count and made it to zero, but
still the slow behavior.


Can you restart Solr and provide the entire solr.log file?  Maybe that 
will have some information about why the searcher takes so long to open. 
 You can't attach files to your message, you need to put it on a file 
sharing site and give us the URL.



One thing I was curious about was, if the cache was being warmed up with
queries from the listener, why was I not seeing them in the solr.log, could
it be the verbosity level ?


I defined a firstSearcher query of "body:misc" in my solrconfig.xml, and 
I see the query in solr.log after restarting Solr:


2023-10-26 14:50:59.067 INFO 
(searcherExecutor-20-thread-1-processing-solr.elyograg.org:443_solr 
dovecot_2023_03_shard1_replica_t1 dovecot_2023_03 shard1 core_node2) 
[dovecot_2023_03 shard1 core_node2 dovecot_2023_03_shard1_replica_t1] 
o.a.s.c.S.Request webapp=null path=null 
params={q=body:misc&distrib=false&event=firstSearcher} hits=1029 
status=0 QTime=185


If you turned down the logging level from the default of INFO, Solr's 
logfile will be almost completely silent.  When I was asking for the 
solr.log above, I am assuming that it is still at INFO.  If it's at WARN 
or ERROR it will not have any useful info.


Thanks,
Shawn

Solr Operator Tutorial

[Solr User]

I went through the tutorial documented at
https://apache.github.io/solr-operator/docs/local_tutorial and the solr
instances would not start.  I saw that there was an error parsing solr.xml
on the field "allowPaths" so decided to try version 8.7 since it looks like
this was introduced in 8.6:
https://solr.apache.org/guide/8_6/format-of-solr-xml.html.

When using 8.7 it worked!  The tutorial explains how to do an upgrade as
well, so perhaps it should start with 8.6 and then upgrade to 8.7?  I did
not try out 8.6, but perhaps someone could validate that if they agree with
my findings.

Anyway, just wanted to share this.  Thanks!

Re: Solr 9.2.1 custom plugin read values in solrconfig.xml

[elisabeth benoit]

Hello,

Thanks for answering.

The unit test does not bypass the newSearcher part when it works.

For the record (for others who may have the same problem), you have to
implement the same function as in AbstractSolrEventListener

protected NamedList addEventParms(
  SolrIndexSearcher currentSearcher, NamedList nlst) {
NamedList result = new NamedList<>();
result.addAll(nlst);
if (currentSearcher != null) {
  result.add(EventParams.EVENT, EventParams.NEW_SEARCHER);
} else {
  result.add(EventParams.EVENT, EventParams.FIRST_SEARCHER);
}
return result;
  }

Best regards



Le mar. 24 oct. 2023 à 17:06, Mikhail Khludnev  a écrit :

> I suppose a test may bypass some configs or stages.
> I think the default config shipped with distro has a listener configured
> and we can see that it works in bootstrap logs.
>
> On Tue, Oct 24, 2023 at 3:03 PM elisabeth benoit <
> elisaelisael...@gmail.com>
> wrote:
>
> > Hello,
> >
> > We have a solr custom plugin that we are actually migrating from solr
> 7.3.1
> > to solr 9.2.1.
> >
> > In our solrconfig.xml we have the following line:
> >
> >
> >  > class="com.cie.lbs.solr.search.function.StopWordSubtypeValueSourceParser"
> > stopwords="le;la;les;"
> > startswith="3"
> > />
> >
> > The values stopwords and startswith are defined in solrconfig and we read
> > those values in the newSearcher function of a class implementing
> > SolrEventListener.
> >
> > public void newSearcher(SolrIndexSearcher newSearcher,
> > SolrIndexSearcher currentSearcher) {
> > SolrConfig config = newSearcher.getCore().getSolrConfig();
> > String functionName = "//valueSourceParser[@name='" + this.name +
> > "']";
> > String[] stopWords = config.get(functionName +
> > "/@stopwords").txt().split(";") ;
> > StopWordSubtypeLoader.startsWithValue = Integer.parseInt(config.get(
> >   functionName + "/@startswith").txt());
> > StopWordSubtypeLoader.stopWords = new
> > HashSet(Arrays.asList(stopWords));
> > LOGGER.info("startsWithValue = " +
> > StopWordSubtypeLoader.startsWithValue);
> > LOGGER.info("stopwords = " + String.join(",",
> > StopWordSubtypeLoader.stopWords));
> > }
> >
> > This was working in solr 7.3.1 but is not working in solr 9.2.1. When I
> put
> > a break point in newSearcher function in a unit test, it never gets
> there,
> > as if newSearcher is not called.
> >
> > Did something change? I cant find an exemple of a similar case with solr
> 9.
> >
> > Best regards,
> > Elisabeth
> >
>
>
> --
> Sincerely yours
> Mikhail Khludnev
>

Re: Help Solr Newsletter October 2023 with links, blogs, articles

[Alessandro Benedetti]

Plenty of cool stuff!
I'll have our digital marketing manager @Lisa Biella  who
reads in copy to add our part as well!

Cheers
--
*Alessandro Benedetti*
Director @ Sease Ltd.
*Apache Lucene/Solr Committer*
*Apache Solr PMC Member*

e-mail: a.benede...@sease.io


*Sease* - Information Retrieval Applied
Consulting | Training | Open Source

Website: Sease.io 
LinkedIn  | Twitter
 | Youtube
 | Github



On Thu, 26 Oct 2023 at 15:37, Charlie Hull 
wrote:

> Hi Alejandro,
>
> We've got a wealth of Solr related content to contribute, the question
> might be how much do you want? :-)
>
> 1. Talk videos about Solr
>  From our conferences and others, everything is categorised here
> https://opensourceconnections.com/about-us/videos-about-search/ with a
> Solr playlist at
> https://www.youtube.com/playlist?list=PLCoJWKqBHERuLJgmR0PhiXmS3TUYjWatW
>
> 2. Tools compatible with Solr
> We have Quepid for recording relevance judgements and adjusting Solr
> queries https://opensourceconnections.com/about-us/tools/#quepid
> Splainer which decodes debug query information https://www.splainer.io
> Querqy/SMUI for rules-based query rewriting
> https://opensourceconnections.com/about-us/tools/#querqy
> Chorus which wraps some of the above into a e-commerce search reference
> implementation with a series of videos to introduce it
>
> https://opensourceconnections.com/blog/2020/07/07/meet-pete-the-e-commerce-search-product-manager/
>
> 3. Blogs on Solr https://opensourceconnections.com/?s=solr making a
> significant proportion of the 800+ blogs on OSC's site
>
> 4. Haystack, the search & AI event we run, has always featured talks on
> Solr https://www.haystackconf.com - the next events will be April (USA)
> and September/October (UK) plus we have a Haystack on Tour event in
> Austin, Texas on November 8th
> https://opensourceconnections.com/event/haystack-on-tour-austin-texas/
>
> 5. Search Solutions is one of my favourite search events and happens in
> London on November 21/22
>
> https://opensourceconnections.com/event/pragmatic-ai-powered-search-solutions-at-the-british-computer-society/
>
> 6. There's a #solr channel in Relevance Slack (over 4600 people in this
> Slack now!)
>
> I'll stop now to let you catch your breath a bit :)
>
> Cheers
>
> Charlie
>
> On 26/10/2023 14:11, Arrieta, Alejandro wrote:
> > Hello Solr Community,
> >
> > We are working on the October Newsletter, and Solr/Lucene/search-related
> > content is welcome.
> >
> > Please check the draft here:
> >
> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=272927879
> >
> > If the content you want to suggest is not there, please add it to the
> wiki
> > or reply to this email thread with the following:
> >
> > title
> > Two lines description
> > link
> >
> > What we are looking for is:
> >
> > -meetups or conferences that will take place in the following months,
> > starting in November 2023.
> > -blogs, photos, videos, and recordings of the Search/Solr/Lucene-related
> > meetups conference in October 2023 or before. If the talk is good, could
> > you send the link?
> > -any article, blog, post, or link you think is exciting and relevant to
> > Solr/Search/Lucene/community, even if it is older.
> >
> > We plan to finish the Solr Newsletter October 2023 edition on the first
> > days of November. You still have five days.
> >
> > Kind Regards,
> > Alejandro Arrieta
> >
> --
> Charlie Hull - Managing Consultant at OpenSource Connections Limited
> Founding member of The Search Network and co-author of Searching the
> Enterprise
> tel/fax: +44 (0)8700 118334
> mobile: +44 (0)7767 825828
>
> OpenSource Connections Europe GmbH | Pappelallee 78/79 | 10437 Berlin
> Amtsgericht Charlottenburg | HRB 230712 B
> Geschäftsführer: John M. Woodell | David E. Pugh
> Finanzamt: Berlin Finanzamt für Körperschaften II
>
>

where is the

[Vince McMahon]

I needed to be able to add the following lines to the managed-schema file.

  

  

  





  

  

  

  

  

  

  


can those lines be added using Solr UI?