Understanding why query does not work when enclosed with parenthesis

[Arun Kumar]

Hi,

I am using solr(v8.10.1) in one of my project and have recently noticed
that when executing a query with negative term query enclosed in
parentheses as shown below with q.op as AND it returns 0 results.

*(-title:legend AND -title:Urban) OR releaseYear:[1900 TO 2022]*

When enabling debugQuery I could see that it is running following parsed
query string

*+(-title:legend -title:urban) +releaseYear:[1900 TO 2022]*

However the same query return results if I do not enclose first two terms
in parentheses as shown below

*-title:legend AND -title:Urban AND releaseYear:[1900 TO 2022]*

It's parsed query string is

*-title:legend -title:urban +releaseYear:[1900 TO 2022]*

Could you please explain as to why the second query returns results while
the first does not as I could not find anything in the documentation to
explain this behavior?

Thanks,
Arun

Re: Understanding why query does not work when enclosed with parenthesis

[Mikhail Khludnev]

Hello, Arun.
Please check the great explanation generously provided by Shawn.
https://cwiki.apache.org/confluence/display/solr/NegativeQueryProblems

Enjoy.

On Mon, Jan 31, 2022 at 11:54 AM Arun Kumar  wrote:

> Hi,
>
> I am using solr(v8.10.1) in one of my project and have recently noticed
> that when executing a query with negative term query enclosed in
> parentheses as shown below with q.op as AND it returns 0 results.
>
> *(-title:legend AND -title:Urban) OR releaseYear:[1900 TO 2022]*
>
> When enabling debugQuery I could see that it is running following parsed
> query string
>
> *+(-title:legend -title:urban) +releaseYear:[1900 TO 2022]*
>
> However the same query return results if I do not enclose first two terms
> in parentheses as shown below
>
> *-title:legend AND -title:Urban AND releaseYear:[1900 TO 2022]*
>
> It's parsed query string is
>
> *-title:legend -title:urban +releaseYear:[1900 TO 2022]*
>
> Could you please explain as to why the second query returns results while
> the first does not as I could not find anything in the documentation to
> explain this behavior?
>
> Thanks,
> Arun
>


-- 
Sincerely yours
Mikhail Khludnev

Apache SOLR issue

[Bindal, Gauri]

Hello,

We use Apache SOLR version 4.10.3 which is the middleware between database 
(Teradata) and a web application (frontend). Below is a diagram for better 
understanding.
[cid:image003.png@01D813D3.D1CED550]

There is a daily job scheduled on our Solr server which is used for extracting 
data from Teradata and for creating indexes to push into Solr which is further 
consumed by a Web application. This indexing job is failing continuously.

Below are the errors we are seeing in Solr Admin UI-
[cid:image001.png@01D813D1.5D0C9D30]
[cid:image002.png@01D813D2.22593080]


Errors in Job logs-
[cid:image004.png@01D813D4.BC086190]
[cid:image005.png@01D81452.ADAEAF90]


Any help regarding the above errors and the reason for continuous job failure 
would be highly appreciated.
Please let me know if any further information is needed. Thanks in advance!

Thanks,
Gauri Bindal





This message is for the designated recipient only and may contain privileged, 
proprietary, or otherwise confidential information. If you have received it in 
error, please notify the sender immediately and delete the original. Any other 
use of the e-mail by you is prohibited. Where allowed by local law, electronic 
communications with Accenture and its affiliates, including e-mail and instant 
messaging (including content), may be scanned by our systems for the purposes 
of information security and assessment of internal compliance with Accenture 
policy. Your privacy is important to us. Accenture uses your personal data only 
in compliance with data protection laws. For further information on how 
Accenture processes your personal data, please see our privacy statement at 
https://www.accenture.com/us-en/privacy-policy.
__

www.accenture.com

v0.6.0-prerelease crds were missing

[vishal parekh]

Below crd file doesn't exist.

https://solr.apache.org/operator/downloads/crds/v0.6.0-prerelease/all-with-dependencies.yaml

Re: Apache SOLR issue

[matthew sporleder]

The mailing list strips all of your images so we can't see anything :)

You can make a gist on github or not use screenshots.

solr 4 is quite old so prepare to be told that a few times.

On Mon, Jan 31, 2022 at 7:47 AM Bindal, Gauri
 wrote:

> Hello,
>
>
>
> We use Apache SOLR *version 4.10.3* which is the middleware between
> database (Teradata) and a web application (frontend). Below is a diagram
> for better understanding.
>
>
>
> There is a daily job scheduled on our Solr server which is used for
> extracting data from Teradata and for creating indexes to push into Solr
> which is further consumed by a Web application. This indexing job is
> failing continuously.
>
>
>
> Below are the errors we are seeing in *Solr Admin UI*-
>
>
>
>
>
> Errors in *Job logs*-
>
>
>
>
>
> Any help regarding the above errors and the reason for continuous job
> failure would be highly appreciated.
>
> Please let me know if any further information is needed. Thanks in advance!
>
>
>
> Thanks,
>
> Gauri Bindal
>
>
>
>
>
> --
>
> This message is for the designated recipient only and may contain
> privileged, proprietary, or otherwise confidential information. If you have
> received it in error, please notify the sender immediately and delete the
> original. Any other use of the e-mail by you is prohibited. Where allowed
> by local law, electronic communications with Accenture and its affiliates,
> including e-mail and instant messaging (including content), may be scanned
> by our systems for the purposes of information security and assessment of
> internal compliance with Accenture policy. Your privacy is important to us.
> Accenture uses your personal data only in compliance with data protection
> laws. For further information on how Accenture processes your personal
> data, please see our privacy statement at
> https://www.accenture.com/us-en/privacy-policy.
>
> __
>
> www.accenture.com
>

SSLConfigurationsFactory - ClassNotFoundException

[Pnina Bashkanski]

Hello!
I am currently moving from solr version 6.3.0 to solr version 8.11.1. I am
using java 8(jdk1.8.0_272).
When using the following command:

java  -Xms4196m -Xmx7168m -verbose:gc -XX:NewRatio=3 -XX:SurvivorRatio=4
-XX:TargetSurvivorRatio=90 -XX:MaxTenuringThreshold=8 -XX:ConcGCThreads=4
-XX:ParallelGCThreads=4 -XX:+CMSScavengeBeforeRemark
-XX:PretenureSizeThreshold=64m -XX:+UseCMSInitiatingOccupancyOnly
-XX:CMSInitiatingOccupancyFraction=50 -XX:CMSMaxAbortablePrecleanTime=6000
-XX:+CMSParallelRemarkEnabled -XX:+ParallelRefProcEnabled
-XX:-OmitStackTraceInFastThrow -DSTOP.PORT=7983 -DSTOP.KEY=mysecret
-Dsolr.solr.home=C:\ "-Dsolr.install.dir=C:\Program Files\Morphisec
Server\solr-8.11.1\server\.." -Djetty.host=0.0.0.0 -Djetty.port=8983
-Dsolr.jetty.https.port=8983 "-Djetty.home=C:\Program Files\Morphisec
Server\solr-8.11.1\server\solr" -Dsolr.autoSoftCommit.maxTime=1000
"-Dsolr.log.dir=C:\Program Files\Morphisec Server\solr-8.11.1\server\logs"
-Dsolr.autoCommit.maxTime=6 -Dsolr.ssl.checkPeerName=false
"-Djavax.net.ssl.trustStore=C:\Program Files\Morphisec
Server\solr-8.11.1\server\etc\keystore.solr.jks"
-Djavax.net.ssl.trustStorePassword=DEA7B39145F6478C -DzkClientTimeout=15000
-DzkRun -jar start.jar --module=https -DurlScheme=https

I am receiving the following exception:
ClassNotFoundException:
org.apache.solr.util.configuration.SSLConfigurationsFactory
at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
at org.eclipse.jetty.util.Loader.loadClass(Loader.java:64)
at
org.eclipse.jetty.xml.XmlConfiguration$JettyXmlConfiguration.call(XmlConfiguration.java:927)
at
org.eclipse.jetty.xml.XmlConfiguration$JettyXmlConfiguration.configure(XmlConfiguration.java:515)
at
org.eclipse.jetty.xml.XmlConfiguration$JettyXmlConfiguration.configure(XmlConfiguration.java:468)
at
org.eclipse.jetty.xml.XmlConfiguration.configure(XmlConfiguration.java:380)
at
org.eclipse.jetty.xml.XmlConfiguration.lambda$main$3(XmlConfiguration.java:1893)
... 9 more


I found out that the issue was with the jetty-ssl.xml file which was
changed from version 6.3.0.

When replacing the file to the previous version and trying to execute the
command, I am receiving a different error:

Caused by: java.lang.IllegalStateException: No Server ALPNProcessors!
at
org.eclipse.jetty.alpn.server.ALPNServerConnectionFactory.(ALPNServerConnectionFactory.java:52)
... 35 more
Suppressed: java.lang.UnsupportedClassVersionError:
org/eclipse/jetty/alpn/java/server/JDK9ServerALPNProcessor has been
compiled by a more recent version of the Java Runtime (class file version
53.0), this version of the Java Runtime only recognizes class file versions
up to 52.0

After google search I found that the file that is being used doesn't fit to
java 8, when downloading the jar
"jetty-alpn-openjdk8-server-9.4.44.v20210927.jar" and adding it to
"server/lib", it works.

thank you

-- 
CONFIDENTIALITY NOTICE: The contents of this email message and any 
attachments are intended solely for the addressee(s) and may contain 
confidential and/or privileged information and their further disclosure may 
be contractually or legally restricted. If you are not the intended 
recipient, please do not use or disclose the contents of this email or its 
attachments to anyone and please delete it immediately and notify the 
sender.

Solr Queries Investigation

[Hadeer Samir]

Hello all,

I want to get your support regarding this question please.

I want to get the WKT field based on defined condition on a query and in the 
same process I want to use this returned field as an argument to the Intersects 
method
I want to do something like that : {!field f=shape}Intersects(Select shape 
WHERE field_1:"value_1" AND field_2:"value_2")

The main issue is : selecting the shape from another query and pass it to the 
Intersects method as upon searching I always find that the Intersects method 
takes a constant shape object which can be WKT or coordinates and not a 
returned field.

I will be grateful to you if you reply on me ASAP.

Thanks in advance.
Hadeer Samir,

Re: Apache SOLR issue

[Charlie Hull]

This list strips attachments, so none of the images you attached are 
visible I'm afraid.


Charlie

On 28/01/2022 08:55, Bindal, Gauri wrote:


Hello,

We use Apache SOLR *version 4.10.3* which is the middleware between 
database (Teradata) and a web application (frontend). Below is a 
diagram for better understanding.


There is a daily job scheduled on our Solr server which is used for 
extracting data from Teradata and for creating indexes to push into 
Solr which is further consumed by a Web application. This indexing job 
is failing continuously.


Below are the errors we are seeing in *Solr Admin UI*-

Errors in *Job logs*-

Any help regarding the above errors and the reason for continuous job 
failure would be highly appreciated.


Please let me know if any further information is needed. Thanks in 
advance!


Thanks,

Gauri Bindal




This message is for the designated recipient only and may contain 
privileged, proprietary, or otherwise confidential information. If you 
have received it in error, please notify the sender immediately and 
delete the original. Any other use of the e-mail by you is prohibited. 
Where allowed by local law, electronic communications with Accenture 
and its affiliates, including e-mail and instant messaging (including 
content), may be scanned by our systems for the purposes of 
information security and assessment of internal compliance with 
Accenture policy. Your privacy is important to us. Accenture uses your 
personal data only in compliance with data protection laws. For 
further information on how Accenture processes your personal data, 
please see our privacy statement at 
https://www.accenture.com/us-en/privacy-policy.

__

www.accenture.com

--
Charlie Hull - Managing Consultant at OpenSource Connections Limited
Founding member of The Search Network  
and co-author of Searching the Enterprise 


tel/fax: +44 (0)8700 118334
mobile: +44 (0)7767 825828

OpenSource Connections Europe GmbH | Pappelallee 78/79 | 10437 Berlin
Amtsgericht Charlottenburg | HRB 230712 B
Geschäftsführer: John M. Woodell | David E. Pugh
Finanzamt: Berlin Finanzamt für Körperschaften II

--
This email has been checked for viruses by AVG.
https://www.avg.com

Solr upgrade(6.6 ->. 8.8.2)|| High Heap usage

[sachin gk]

Hi All,

We upgraded solr(cloud) from 6.6 version to 8.8.2.

Below are job details:
1. Indexing every 24 hour
2. There are two in place update runs 15 min apart each running every 30
minutes.

In-place update details:
updatechain: inplace-update-chain
number of segment forced to 1

Index
1.  Total documents 983768 occupying 1.87 GB of data

Implementation Details:
1. Customized plugin code with block join implementation.

Memory:
30 GB of Physical Memory
12 GB of Heap
16 core cpu

Cache usage:
Changed the cache for queryResultCache, documentCache from LRUcache
to CaffeineCache , due to performance issue.

GC Parameters:
-XX:+AggressiveOpts
-XX:+HeapDumpOnOutOfMemoryError
-XX:+ParallelRefProcEnabled
-XX:+PerfDisableSharedMem
-XX:+PrintGC
-XX:+PrintGCApplicationStoppedTime
-XX:+PrintGCDateStamps
-XX:+PrintGCDetails
-XX:+PrintGCTimeStamps
-XX:+PrintHeapAtGC
-XX:+PrintTenuringDistribution
-XX:+UnlockExperimentalVMOptions
-XX:+UseG1GC
-XX:+UseGCLogFileRotation
-XX:+UseLargePages
-XX:-OmitStackTraceInFastThrow
-XX:ConcGCThreads=8
-XX:G1HeapWastePercent=2
-XX:G1MaxNewSizePercent=75
-XX:G1MixedGCLiveThresholdPercent=90
-XX:G1OldCSetRegionThresholdPercent=15
-XX:G1ReservePercent=5
-XX:GCLogFileSize=20M
-XX:HeapDumpPath=/data/java_69904(date).hprof
-XX:InitiatingHeapOccupancyPercent=80
-XX:MaxGCPauseMillis=1000
-XX:MaxPermSize=250M
-XX:NumberOfGCLogFiles=9
-XX:OnOutOfMemoryError=/opt/solr/bin/oom_solr.sh 8983 /var/log/DP/solr
-XX:ParallelGCThreads=13
-Xloggc:/var/log/DP/solr/solr_gc.log
-Xms12g
-Xmx12g
-Xss256k
-Xss256k
-verbose:gc





It was observed after deploying the migrated code base during negligible
traffic and in-place update in the span of 2 hours that complete 12 GB of
heap usage resulted in dead nodes. Attached the GC snapshot where deep GC
is observed.

Please suggest how to avoid the high heap usage ?
is there any specific aspects to handle the inplacee updates while solr
upgrade ?

Any pointers to resolve this issue is highly appreciated

-- 
Regards,
Sachin

backup and restore, standalone instance, windows paths

[SIMM Stephen (Acoss)]

Hello,

The backup works with this URL
http://localhost:8983/solr/documents/replication?command=backup&name=1629&location=c:/temp/solr-backups

But the restore command does not :
http://localhost:8983/solr/documents/replication?command=restore&name=1629&location=c:/temp/solr-backups

The error is :
"responseHeader": {
"status": 500,
"QTime": 1
},
"error": {
"msg": "Provider \"c\" not installed",
"trace": "java.nio.file.FileSystemNotFoundException: Provider \"c\" not 
installed\r\n\tat java.base/java.nio.file.Path.of(Path.java:212)\r\n\tat 
java.base/java.nio.file.Paths.get(Paths.java:97)\r\n\tat 
org.apache.solr.core.backup.repository.LocalFileSystemRepository.resolve(LocalFileSystemRepository.java:88)\r\n\tat
 
org.apache.solr.core.backup.repository.BackupRepository.resolveDirectory(BackupRepository.java:106)\r\n\tat
 org.apache.solr.handler.RestoreCore.create(RestoreCore.java:60)\r\n\tat 
org.apache.solr.handler.ReplicationHandler.restore(ReplicationHandler.java:530)\r\n\tat
 
org.apache.solr.handler.ReplicationHandler.handleRequestBody(ReplicationHandler.java:282)\r\n\tat
 
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:216)\r\n\tat
 org.apache.solr.core.SolrCore.execute(SolrCore.java:2637)\r\n\tat 
org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:794)\r\n\tat 
org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:567)\r\n\tat 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:427)\r\n\tat
 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:357)\r\n\tat
 org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:201)\r\n\tat 
org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)\r\n\tat
 
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:548)\r\n\tat
 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)\r\n\tat
 
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:600)\r\n\tat
 
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\r\n\tat
 
org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235)\r\n\tat
 
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1624)\r\n\tat
 
org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)\r\n\tat
 
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1434)\r\n\tat
 
org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)\r\n\tat
 
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501)\r\n\tat
 
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1594)\r\n\tat
 
org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)\r\n\tat
 
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1349)\r\n\tat
 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)\r\n\tat
 
org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:191)\r\n\tat
 
org.eclipse.jetty.server.handler.InetAccessHandler.handle(InetAccessHandler.java:177)\r\n\tat
 
org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146)\r\n\tat
 
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\r\n\tat
 
org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)\r\n\tat
 
org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:763)\r\n\tat
 
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\r\n\tat
 org.eclipse.jetty.server.Server.handle(Server.java:516)\r\n\tat 
org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:400)\r\n\tat
 org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:645)\r\n\tat 
org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:392)\r\n\tat 
org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)\r\n\tat
 
org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\r\n\tat
 org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)\r\n\tat 
org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\r\n\tat 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)\r\n\tat
 
org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)\r\n\tat
 java.base/java.lang.Thread.run(Thread.java:834)\r\n",
"code": 500
}
}

In solr.xml I change the allowPaths property to this :
  *

Why is there a difference between backup and restore ?

Is there a way around this problem ?

Thanks !