ls ./server/solr-webapp/webapp/WEB-INF/lib/*lucene*common*
./server/solr-webapp/webapp/WEB-INF/lib/lucene-analysis-common-9.5.0.jar
and if I pass this jar to jar -tf , I've
got org/tartarus/snowball/ext/HungarianStemmer.class which is needed for
this analysis chain.
Can you confirm that this stemmer works before modifying default configs?
On Mon, Jul 3, 2023 at 12:00 PM Szűcs Roland <szucs.rol...@bookandwalk.hu>
wrote:
> Hi Mikhail,
>
> I used Solr 9.2.1. on Ubuntu 22. I used the included install script (
> bin/install_solr_service.sh). I did not change anything. It is not a cloud
> setup, I have a standalone solr version and one empty core in it. I work
> with python not java so I could not touch jar files. The only modification
> I did is that I deleted the text_hu field type definition of the default
> schema.xml (first I just renamed managed-schema.xml, then modified it since
> I want to manipulate schema only through xml, I do not use api for that)
> and replaced with mine to have asciifolding filter in the process since
> Hungarians are lazy on mobile to type in accents. Also, I eliminated stop
> word removal. But that's all.
>
> During the installation process I left everything on default.
>
> Where should be the lucene-analysis-common.jar located in the default
> directory layout? I found for example several lucene prefix jar files in :
> /opt/solr/modules/analysis-extras/lib but all of them are located in
> analysis-extra. Your referred file relates to the core usage of Solr and
> Lucene so I would expect it not to be located in analysis-extra. Maybe I
> have missing modules?
> The content of my /opt/solr/modules/:
> analysis-extras, gcs-repository, jwt-auth, s3-repository, analytics,
> hadoop-auth, langid, scripting, clustering, hdfs, ltr, sql, extraction,
> jaegertracer-configurator, opentelemetry.
>
> None of them has lucene-analysis-common.jar in it.
>
> Roland
>
>
>
>
>
>
> Mikhail Khludnev <m...@apache.org> ezt írta (időpont: 2023. júl. 1., Szo,
> 18:38):
>
> > Hello Roland.
> >
> > I took techproducts example
> > It has text_hu in schema which has the following filter
> > org.apache.lucene.analysis.snowball.SnowballPorterFilterFactory
> > luceneMatchVersion: 9.5.0language: Hungarianname: snowballPorter
> > I invoked this field type in Analysis screen. It seems working.
> > SF
> > átszűrődtek
> > SF
> > átszűrődt
> > Haven't you modified lucene-analysis-common.jar? Haven't you put any
> > snowball jar into Solr folders?
> > The exception means that SnowballPorterFilterFactory.inform() hasn't been
> > invoked. I don't know how it may happened.
> > Which version you are running? Is it cloud or standalone?
> >
> > On Sat, Jul 1, 2023 at 1:39 PM Szűcs Roland <szucs.rol...@bookandwalk.hu
> >
> > wrote:
> >
> > > Hi All,
> > >
> > > I use the following field type definition of a Hungarian text field:
> > > <fieldType name="text_hu" class="solr.TextField"
> > positionIncrementGap="100"
> > > uninvertible="false" omitTermFreqAndPositions="false">
> > >
> > > <analyzer type="index">
> > > <tokenizer name="standard"/>
> > > <filter name="lowercase"/>
> > > <filter name="snowballPorter" language="Hungarian"/>
> > > <filter name="asciiFolding" preserveOriginal="true"/>
> > > </analyzer>
> > >
> > > <analyzer type="query">
> > > <tokenizer name="standard"/>
> > > <filter name="lowercase"/>
> > > <filter name="snowballPorter" language="Hungarian"/>
> > > </analyzer>
> > > </fieldType>
> > >
> > > Currently the core is empty. Solr is running as a service and I can
> > access
> > > the UI admin. As soon as I try to analyze how my title field works
> (which
> > > has text_hu field type) I get the following error: *Error instantiating
> > > stemmer for language Hungarianfrom class null.*
> > >
> > > I have checked the documentation and it is stated that Hungarian is
> among
> > > the supported language. I checked the details in the solr.log but I did
> > not
> > > get smarter:
> > >
> > > 2023-07-01 10:22:05.028 INFO (qtp873827336-19) [ x:books]
> > > o.a.s.c.S.Request webapp=/solr path=/analysis/field
> > >
> > >
> >
> params={analysis.fieldvalue=Menj\FCnk+haza+hozz\E1tok&analysis.fieldname=title&analysis.showmatch=true&verbose_output=1&wt=json&_=1688206899397}
> > > status=500 QTime=22
> > > 2023-07-01 10:22:05.029 ERROR (qtp873827336-19) [ x:books]
> > > o.a.s.s.HttpSolrCall java.lang.RuntimeException: Error instantiating
> > > stemmer for language Hungarianfrom class null =>
> > > java.lang.RuntimeException: Error instantiating stemmer for language
> > > Hungarianfrom class null
> > > at
> > >
> > >
> >
> org.apache.lucene.analysis.snowball.SnowballPorterFilterFactory.create(SnowballPorterFilterFactory.java:90)
> > > java.lang.RuntimeException: Error instantiating stemmer for language
> > > Hungarianfrom class null
> > > at
> > >
> > >
> >
> org.apache.lucene.analysis.snowball.SnowballPorterFilterFactory.create(SnowballPorterFilterFactory.java:90)
> > > ~[?:?]
> > > at
> > >
> > >
> >
> org.apache.lucene.analysis.snowball.SnowballPorterFilterFactory.create(SnowballPorterFilterFactory.java:47)
> > > ~[?:?]
> > > at
> > >
> > >
> >
> org.apache.solr.handler.AnalysisRequestHandlerBase.analyzeValue(AnalysisRequestHandlerBase.java:141)
> > > ~[?:?]
> > > at
> > >
> > >
> >
> org.apache.solr.handler.FieldAnalysisRequestHandler.analyzeValues(FieldAnalysisRequestHandler.java:234)
> > > ~[?:?]
> > > at
> > >
> > >
> >
> org.apache.solr.handler.FieldAnalysisRequestHandler.handleAnalysisRequest(FieldAnalysisRequestHandler.java:199)
> > > ~[?:?]
> > > at
> > >
> > >
> >
> org.apache.solr.handler.FieldAnalysisRequestHandler.doAnalysis(FieldAnalysisRequestHandler.java:104)
> > > ~[?:?]
> > > at
> > >
> > >
> >
> org.apache.solr.handler.AnalysisRequestHandlerBase.handleRequestBody(AnalysisRequestHandlerBase.java:70)
> > > ~[?:?]
> > > at
> > >
> > >
> >
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:224)
> > > ~[?:?]
> > > at org.apache.solr.core.SolrCore.execute(SolrCore.java:2890) ~[?:?]
> > > at
> > >
> > >
> >
> org.apache.solr.servlet.HttpSolrCall.executeCoreRequest(HttpSolrCall.java:872)
> > > ~[?:?]
> > > at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:568)
> > ~[?:?]
> > > at
> > >
> > >
> >
> org.apache.solr.servlet.SolrDispatchFilter.dispatch(SolrDispatchFilter.java:252)
> > > ~[?:?]
> > > at
> > >
> > >
> >
> org.apache.solr.servlet.SolrDispatchFilter.lambda$doFilter$0(SolrDispatchFilter.java:220)
> > > ~[?:?]
> > > at
> > >
> > >
> >
> org.apache.solr.servlet.ServletUtils.traceHttpRequestExecution2(ServletUtils.java:257)
> > > ~[?:?]
> > > at
> > >
> > >
> >
> org.apache.solr.servlet.ServletUtils.rateLimitRequest(ServletUtils.java:227)
> > > ~[?:?]
> > > at
> > >
> > >
> >
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:215)
> > > ~[?:?]
> > > at
> > >
> > >
> >
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:197)
> > > ~[?:?]
> > > at
> org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:210)
> > > ~[jetty-servlet-10.0.13.jar:10.0.13]
> > > at
> > >
> > >
> >
> org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1635)
> > > ~[jetty-servlet-10.0.13.jar:10.0.13]
> > > at
> > >
> >
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:527)
> > > ~[jetty-servlet-10.0.13.jar:10.0.13]
> > > at
> > >
> > >
> >
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:131)
> > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > at
> > >
> >
> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:578)
> > > ~[jetty-security-10.0.13.jar:10.0.13]
> > > at
> > >
> > >
> >
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:122)
> > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > at
> > >
> > >
> >
> org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:223)
> > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > at
> > >
> > >
> >
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1570)
> > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > at
> > >
> > >
> >
> org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:221)
> > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > at
> > >
> > >
> >
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1383)
> > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > at
> > >
> > >
> >
> org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:176)
> > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > at
> > >
> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:484)
> > > ~[jetty-servlet-10.0.13.jar:10.0.13]
> > > at
> > >
> > >
> >
> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1543)
> > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > at
> > >
> > >
> >
> org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:174)
> > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > at
> > >
> > >
> >
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1305)
> > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > at
> > >
> > >
> >
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:129)
> > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > at
> > >
> > >
> >
> org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:149)
> > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > at
> > >
> > >
> >
> org.eclipse.jetty.server.handler.InetAccessHandler.handle(InetAccessHandler.java:228)
> > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > at
> > >
> > >
> >
> org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:141)
> > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > at
> > >
> > >
> >
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:122)
> > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > at
> > >
> > >
> >
> org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:301)
> > > ~[jetty-rewrite-10.0.13.jar:10.0.13]
> > > at
> > >
> > >
> >
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:122)
> > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > at
> > >
> > >
> >
> org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:822)
> > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > at
> > >
> > >
> >
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:122)
> > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > at org.eclipse.jetty.server.Server.handle(Server.java:563)
> > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > at
> > >
> >
> org.eclipse.jetty.server.HttpChannel.lambda$handle$0(HttpChannel.java:505)
> > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:762)
> > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:497)
> > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > at
> > >
> >
> org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:282)
> > > ~[jetty-server-10.0.13.jar:10.0.13]
> > > at
> > > org.eclipse.jetty.io
> > > .AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:314)
> > > ~[jetty-io-10.0.13.jar:10.0.13]
> > > at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:100)
> > > ~[jetty-io-10.0.13.jar:10.0.13]
> > > at
> > > org.eclipse.jetty.io
> > > .SelectableChannelEndPoint$1.run(SelectableChannelEndPoint.java:53)
> > > ~[jetty-io-10.0.13.jar:10.0.13]
> > > at
> > >
> > >
> >
> org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.runTask(AdaptiveExecutionStrategy.java:416)
> > > ~[jetty-util-10.0.13.jar:10.0.13]
> > > at
> > >
> > >
> >
> org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.consumeTask(AdaptiveExecutionStrategy.java:385)
> > > ~[jetty-util-10.0.13.jar:10.0.13]
> > > at
> > >
> > >
> >
> org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.tryProduce(AdaptiveExecutionStrategy.java:272)
> > > ~[jetty-util-10.0.13.jar:10.0.13]
> > > at
> > >
> > >
> >
> org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.lambda$new$0(AdaptiveExecutionStrategy.java:140)
> > > ~[jetty-util-10.0.13.jar:10.0.13]
> > > at
> > >
> > >
> >
> org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:411)
> > > ~[jetty-util-10.0.13.jar:10.0.13]
> > > at
> > >
> > >
> >
> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:934)
> > > ~[jetty-util-10.0.13.jar:10.0.13]
> > > at
> > >
> > >
> >
> org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1078)
> > > ~[jetty-util-10.0.13.jar:10.0.13]
> > > at java.lang.Thread.run(Thread.java:829) [?:?]
> > > Caused by: java.lang.NullPointerException
> > > at
> > >
> > >
> >
> org.apache.lucene.analysis.snowball.SnowballPorterFilterFactory.create(SnowballPorterFilterFactory.java:88)
> > > ~[?:?]
> > > ... 56 more
> > >
> > > Any idea, what is wrong here?
> > >
> > > Roland
> > >
> >
> >
> > --
> > Sincerely yours
> > Mikhail Khludnev
> >
>
--
Sincerely yours
Mikhail Khludnev
