date:20231012

CPU spikes when sharding

2023-10-12 Thread Sergio García Maroto

Hi everyone,

I have at the moment a SolrCloud cluster with 3 servers and few different
collections with all of them replicated to the 3 servers without sharding.
I am using streaming expressions retrieving and joining data from these
collections so everyhting happens on indivial servers as all data are
sitting together in the same server.
This expressions are getting pretty complex and we had to scale vertically
the instance types on AWS a few times.

I am now trying to split the cluster using sharding and having more servers
with smaller instance types to try to see wher we are able to scale
horizzontally.
First thing I noticed is there is a huge CPU spike when sharing from 1
shard to 8 shards.

Is this something which makes sense? I know now we have to move data across
servers when on 1 shard everyhitng happened on same server.
Why when shardin we have such a big CPU usage increase?

Thanks a lot.
Sergio Maroto

Re: CPU spikes when sharding

2023-10-12 Thread Deepak Goel

How long are the cpu spikes?

On Thu, 12 Oct 2023, 16:47 Sergio García Maroto,  wrote:

> Hi everyone,
>
> I have at the moment a SolrCloud cluster with 3 servers and few different
> collections with all of them replicated to the 3 servers without sharding.
> I am using streaming expressions retrieving and joining data from these
> collections so everyhting happens on indivial servers as all data are
> sitting together in the same server.
> This expressions are getting pretty complex and we had to scale vertically
> the instance types on AWS a few times.
>
> I am now trying to split the cluster using sharding and having more servers
> with smaller instance types to try to see wher we are able to scale
> horizzontally.
> First thing I noticed is there is a huge CPU spike when sharing from 1
> shard to 8 shards.
>
> Is this something which makes sense? I know now we have to move data across
> servers when on 1 shard everyhitng happened on same server.
> Why when shardin we have such a big CPU usage increase?
>
> Thanks a lot.
> Sergio Maroto
>

Re: quoting/escaping of literal values in SOLR_OPTS ?

2023-10-12 Thread Chris Hostetter





: SOLR_OPTS='-XX:-UseLargePages -Dfoo=bar -Dyak="white space"'
: ./solr/packaging/build/dev/bin/solr start -V -f
: 
: Does this work?

No.  Sorry, i thought i included that in my list of examples...

$ SOLR_OPTS='-XX:-UseLargePages -Dfoo=bar -Dyak="white space"'  
./solr/packaging/build/dev/bin/solr start -f
Error: Could not find or load main class space"
Caused by: java.lang.ClassNotFoundException: space"


: 
: On Thu, 12 Oct, 2023, 6:08 am Chris Hostetter, 
: wrote:
: 
: >
: > my bash-fu isn't that great, but AFAICT the way SOLR_OPTS is used in
: > bin/solr breaks on any attempt i can think of to quote/escape any jvm
: > args included in the SOLR_OPTS env variable.
: >
: > Am i missing something, or is this a bug?
: >
: > (see examples below)
: >
: > -Hoss
: > http://www.lucidworks.com/
: >
: >
: > hossman@slate:~/lucene/solr [j11] [tags/releases/solr/9.3.0] $
: > SOLR_OPTS='-XX:-UseLargePages -Dfoo=bar "-Dyak=white space"'
: > ./solr/packaging/build/dev/bin/solr start -V -f
: > Using Solr root directory:
: > /home/hossman/lucene/solr/solr/packaging/build/dev
: > Using Java: /opt/jdk/11/latest//bin/java
: > openjdk version "11.0.15" 2022-04-19
: > OpenJDK Runtime Environment Temurin-11.0.15+10 (build 11.0.15+10)
: > OpenJDK 64-Bit Server VM Temurin-11.0.15+10 (build 11.0.15+10, mixed mode)
: >
: > Starting Solr using the following settings:
: >  JAVA= /opt/jdk/11/latest//bin/java
: >  SOLR_SERVER_DIR =
: > /home/hossman/lucene/solr/solr/packaging/build/dev/server
: >  SOLR_HOME   =
: > /home/hossman/lucene/solr/solr/packaging/build/dev/server/solr
: >  SOLR_HOST   =
: >  SOLR_PORT   = 8983
: >  STOP_PORT   = 7983
: >  JAVA_MEM_OPTS   = -Xms512m -Xmx512m
: >  GC_TUNE = -XX:+UseG1GC -XX:+PerfDisableSharedMem
: > -XX:+ParallelRefProcEnabled -XX:MaxGCPauseMillis=250 -XX:+UseLargePages
: > -XX:+AlwaysPreTouch -XX:+ExplicitGCInvokesConcurrent
: >  GC_LOG_OPTS =
: > 
-Xlog:gc*:file=/home/hossman/lucene/solr/solr/packaging/build/dev/server/logs/solr_gc.log:time,uptime:filecount=9,filesize=20M
: >  SOLR_TIMEZONE   = UTC
: >  SOLR_OPTS   = -XX:-UseLargePages -Dfoo=bar "-Dyak=white space"
: > -Xss256k
: >
: > Error: Could not find or load main class "-Dyak=white
: > Caused by: java.lang.ClassNotFoundException: "-Dyak=white
: > hossman@slate:~/lucene/solr [j11] [tags/releases/solr/9.3.0] $
: > SOLR_OPTS='-XX:-UseLargePages -Dfoo=bar -Dyak=white\ space'
: > ./solr/packaging/build/dev/bin/solr start -f
: > Error: Could not find or load main class space
: > Caused by: java.lang.ClassNotFoundException: space
: > hossman@slate:~/lucene/solr [j11] [tags/releases/solr/9.3.0] $
: > SOLR_OPTS="-XX:-UseLargePages -Dfoo=bar '-Dyak=white space'"
: > ./solr/packaging/build/dev/bin/solr start -f
: > Error: Could not find or load main class '-Dyak=white
: > Caused by: java.lang.ClassNotFoundException: '-Dyak=white
: > hossman@slate:~/lucene/solr [j11] [tags/releases/solr/9.3.0] $
: > SOLR_OPTS="-XX:-UseLargePages -Dfoo=bar -Dyak='white space'"
: > ./solr/packaging/build/dev/bin/solr start -f
: > Error: Could not find or load main class space'
: > Caused by: java.lang.ClassNotFoundException: space'
: >
: >
: >
: >
: 

-Hoss
http://www.lucidworks.com/

Re: quoting/escaping of literal values in SOLR_OPTS ?

2023-10-12 Thread Eric Pugh

We need more BATS tests around all these non common approaches for dealing with 
parameters.  Or, figure out how to do less work in our bash scripts ;-)

> On Oct 12, 2023, at 1:22 PM, Chris Hostetter  wrote:
> 
> 
> 
> 
> : SOLR_OPTS='-XX:-UseLargePages -Dfoo=bar -Dyak="white space"'
> : ./solr/packaging/build/dev/bin/solr start -V -f
> : 
> : Does this work?
> 
> No.  Sorry, i thought i included that in my list of examples...
> 
> $ SOLR_OPTS='-XX:-UseLargePages -Dfoo=bar -Dyak="white space"'  
> ./solr/packaging/build/dev/bin/solr start -f
> Error: Could not find or load main class space"
> Caused by: java.lang.ClassNotFoundException: space"
> 
> 
> : 
> : On Thu, 12 Oct, 2023, 6:08 am Chris Hostetter, 
> : wrote:
> : 
> : >
> : > my bash-fu isn't that great, but AFAICT the way SOLR_OPTS is used in
> : > bin/solr breaks on any attempt i can think of to quote/escape any jvm
> : > args included in the SOLR_OPTS env variable.
> : >
> : > Am i missing something, or is this a bug?
> : >
> : > (see examples below)
> : >
> : > -Hoss
> : > http://www.lucidworks.com/
> : >
> : >
> : > hossman@slate:~/lucene/solr [j11] [tags/releases/solr/9.3.0] $
> : > SOLR_OPTS='-XX:-UseLargePages -Dfoo=bar "-Dyak=white space"'
> : > ./solr/packaging/build/dev/bin/solr start -V -f
> : > Using Solr root directory:
> : > /home/hossman/lucene/solr/solr/packaging/build/dev
> : > Using Java: /opt/jdk/11/latest//bin/java
> : > openjdk version "11.0.15" 2022-04-19
> : > OpenJDK Runtime Environment Temurin-11.0.15+10 (build 11.0.15+10)
> : > OpenJDK 64-Bit Server VM Temurin-11.0.15+10 (build 11.0.15+10, mixed mode)
> : >
> : > Starting Solr using the following settings:
> : >  JAVA= /opt/jdk/11/latest//bin/java
> : >  SOLR_SERVER_DIR =
> : > /home/hossman/lucene/solr/solr/packaging/build/dev/server
> : >  SOLR_HOME   =
> : > /home/hossman/lucene/solr/solr/packaging/build/dev/server/solr
> : >  SOLR_HOST   =
> : >  SOLR_PORT   = 8983
> : >  STOP_PORT   = 7983
> : >  JAVA_MEM_OPTS   = -Xms512m -Xmx512m
> : >  GC_TUNE = -XX:+UseG1GC -XX:+PerfDisableSharedMem
> : > -XX:+ParallelRefProcEnabled -XX:MaxGCPauseMillis=250 -XX:+UseLargePages
> : > -XX:+AlwaysPreTouch -XX:+ExplicitGCInvokesConcurrent
> : >  GC_LOG_OPTS =
> : > 
> -Xlog:gc*:file=/home/hossman/lucene/solr/solr/packaging/build/dev/server/logs/solr_gc.log:time,uptime:filecount=9,filesize=20M
> : >  SOLR_TIMEZONE   = UTC
> : >  SOLR_OPTS   = -XX:-UseLargePages -Dfoo=bar "-Dyak=white space"
> : > -Xss256k
> : >
> : > Error: Could not find or load main class "-Dyak=white
> : > Caused by: java.lang.ClassNotFoundException: "-Dyak=white
> : > hossman@slate:~/lucene/solr [j11] [tags/releases/solr/9.3.0] $
> : > SOLR_OPTS='-XX:-UseLargePages -Dfoo=bar -Dyak=white\ space'
> : > ./solr/packaging/build/dev/bin/solr start -f
> : > Error: Could not find or load main class space
> : > Caused by: java.lang.ClassNotFoundException: space
> : > hossman@slate:~/lucene/solr [j11] [tags/releases/solr/9.3.0] $
> : > SOLR_OPTS="-XX:-UseLargePages -Dfoo=bar '-Dyak=white space'"
> : > ./solr/packaging/build/dev/bin/solr start -f
> : > Error: Could not find or load main class '-Dyak=white
> : > Caused by: java.lang.ClassNotFoundException: '-Dyak=white
> : > hossman@slate:~/lucene/solr [j11] [tags/releases/solr/9.3.0] $
> : > SOLR_OPTS="-XX:-UseLargePages -Dfoo=bar -Dyak='white space'"
> : > ./solr/packaging/build/dev/bin/solr start -f
> : > Error: Could not find or load main class space'
> : > Caused by: java.lang.ClassNotFoundException: space'
> : >
> : >
> : >
> : >
> : 
> 
> -Hoss
> http://www.lucidworks.com/

___
Eric Pugh | Founder & CEO | OpenSource Connections, LLC | 434.466.1467 | 
http://www.opensourceconnections.com  | 
My Free/Busy   
Co-Author: Apache Solr Enterprise Search Server, 3rd Ed 


This e-mail and all contents, including attachments, is considered to be 
Company Confidential unless explicitly stated otherwise, regardless of whether 
attachments are marked as such.

Re: quoting/escaping of literal values in SOLR_OPTS ?

2023-10-12 Thread Ishan Chattopadhyaya

SOLR_OPTS='-XX:-UseLargePages -Dfoo=bar' ./solr/packaging/build/dev/bin/solr
start -f -a '-Dyak="white space"'

Would this work?

I remember that I did something like this for passing that remote debug
parameters using -a, but can't remember if they had spaces or not.


n Thu, 12 Oct, 2023, 11:06 pm Eric Pugh, 
wrote:

> We need more BATS tests around all these non common approaches for dealing
> with parameters.  Or, figure out how to do less work in our bash scripts ;-)
>
> > On Oct 12, 2023, at 1:22 PM, Chris Hostetter 
> wrote:
> >
> >
> >
> >
> > : SOLR_OPTS='-XX:-UseLargePages -Dfoo=bar -Dyak="white space"'
> > : ./solr/packaging/build/dev/bin/solr start -V -f
> > :
> > : Does this work?
> >
> > No.  Sorry, i thought i included that in my list of examples...
> >
> > $ SOLR_OPTS='-XX:-UseLargePages -Dfoo=bar -Dyak="white space"'
> ./solr/packaging/build/dev/bin/solr start -f
> > Error: Could not find or load main class space"
> > Caused by: java.lang.ClassNotFoundException: space"
> >
> >
> > :
> > : On Thu, 12 Oct, 2023, 6:08 am Chris Hostetter, <
> hossman_luc...@fucit.org>
> > : wrote:
> > :
> > : >
> > : > my bash-fu isn't that great, but AFAICT the way SOLR_OPTS is used in
> > : > bin/solr breaks on any attempt i can think of to quote/escape any jvm
> > : > args included in the SOLR_OPTS env variable.
> > : >
> > : > Am i missing something, or is this a bug?
> > : >
> > : > (see examples below)
> > : >
> > : > -Hoss
> > : > http://www.lucidworks.com/
> > : >
> > : >
> > : > hossman@slate:~/lucene/solr [j11] [tags/releases/solr/9.3.0] $
> > : > SOLR_OPTS='-XX:-UseLargePages -Dfoo=bar "-Dyak=white space"'
> > : > ./solr/packaging/build/dev/bin/solr start -V -f
> > : > Using Solr root directory:
> > : > /home/hossman/lucene/solr/solr/packaging/build/dev
> > : > Using Java: /opt/jdk/11/latest//bin/java
> > : > openjdk version "11.0.15" 2022-04-19
> > : > OpenJDK Runtime Environment Temurin-11.0.15+10 (build 11.0.15+10)
> > : > OpenJDK 64-Bit Server VM Temurin-11.0.15+10 (build 11.0.15+10, mixed
> mode)
> > : >
> > : > Starting Solr using the following settings:
> > : >  JAVA= /opt/jdk/11/latest//bin/java
> > : >  SOLR_SERVER_DIR =
> > : > /home/hossman/lucene/solr/solr/packaging/build/dev/server
> > : >  SOLR_HOME   =
> > : > /home/hossman/lucene/solr/solr/packaging/build/dev/server/solr
> > : >  SOLR_HOST   =
> > : >  SOLR_PORT   = 8983
> > : >  STOP_PORT   = 7983
> > : >  JAVA_MEM_OPTS   = -Xms512m -Xmx512m
> > : >  GC_TUNE = -XX:+UseG1GC -XX:+PerfDisableSharedMem
> > : > -XX:+ParallelRefProcEnabled -XX:MaxGCPauseMillis=250
> -XX:+UseLargePages
> > : > -XX:+AlwaysPreTouch -XX:+ExplicitGCInvokesConcurrent
> > : >  GC_LOG_OPTS =
> > : >
> -Xlog:gc*:file=/home/hossman/lucene/solr/solr/packaging/build/dev/server/logs/solr_gc.log:time,uptime:filecount=9,filesize=20M
> > : >  SOLR_TIMEZONE   = UTC
> > : >  SOLR_OPTS   = -XX:-UseLargePages -Dfoo=bar "-Dyak=white
> space"
> > : > -Xss256k
> > : >
> > : > Error: Could not find or load main class "-Dyak=white
> > : > Caused by: java.lang.ClassNotFoundException: "-Dyak=white
> > : > hossman@slate:~/lucene/solr [j11] [tags/releases/solr/9.3.0] $
> > : > SOLR_OPTS='-XX:-UseLargePages -Dfoo=bar -Dyak=white\ space'
> > : > ./solr/packaging/build/dev/bin/solr start -f
> > : > Error: Could not find or load main class space
> > : > Caused by: java.lang.ClassNotFoundException: space
> > : > hossman@slate:~/lucene/solr [j11] [tags/releases/solr/9.3.0] $
> > : > SOLR_OPTS="-XX:-UseLargePages -Dfoo=bar '-Dyak=white space'"
> > : > ./solr/packaging/build/dev/bin/solr start -f
> > : > Error: Could not find or load main class '-Dyak=white
> > : > Caused by: java.lang.ClassNotFoundException: '-Dyak=white
> > : > hossman@slate:~/lucene/solr [j11] [tags/releases/solr/9.3.0] $
> > : > SOLR_OPTS="-XX:-UseLargePages -Dfoo=bar -Dyak='white space'"
> > : > ./solr/packaging/build/dev/bin/solr start -f
> > : > Error: Could not find or load main class space'
> > : > Caused by: java.lang.ClassNotFoundException: space'
> > : >
> > : >
> > : >
> > : >
> > :
> >
> > -Hoss
> > http://www.lucidworks.com/
>
> ___
> Eric Pugh | Founder & CEO | OpenSource Connections, LLC | 434.466.1467 |
> http://www.opensourceconnections.com <
> http://www.opensourceconnections.com/> | My Free/Busy <
> http://tinyurl.com/eric-cal>
> Co-Author: Apache Solr Enterprise Search Server, 3rd Ed <
> https://www.packtpub.com/big-data-and-business-intelligence/apache-solr-enterprise-search-server-third-edition-raw>
>
> This e-mail and all contents, including attachments, is considered to be
> Company Confidential unless explicitly stated otherwise, regardless of
> whether attachments are marked as such.
>
>

Performance of solr 9.3 vs 8.11

2023-10-12 Thread Natarajan, Rajeswari

Hi,

Does anyone see any query performance degradation from 8.11 to 9.3. Please let 
me know


Thanks,
Rajeswari

Re: Performance of solr 9.3 vs 8.11

2023-10-12 Thread Andy Lester

> On Oct 12, 2023, at 12:54 PM, Natarajan, Rajeswari 
>  wrote:
> 
> Does anyone see any query performance degradation from 8.11 to 9.3. Please 
> let me know

What is it that you are really asking?

Are you wondering if there will be a slowdown if you upgrade from 8.11 to 9.3? 
If so, we need to know more details..

Are you observing what seems to be a query performance degradation after 
upgrading from 8.11 to 9.3, and you're trying to figure out why?  If so, we 
need to know more details.

Andy

Re: Performance of solr 9.3 vs 8.11

2023-10-12 Thread Tomás Fernández Löbbe

Are you asking a general question or did you see degradation and you are
trying to dig into it? Some more details can help people understand the
problem.

There is this Jira[1] I filed about a specific type of degradation with
highly distributed indices when using PKIAuthenticationPlugin

[1] https://issues.apache.org/jira/browse/SOLR-16951

On Thu, Oct 12, 2023 at 10:54 AM Natarajan, Rajeswari
 wrote:

> Hi,
>
> Does anyone see any query performance degradation from 8.11 to 9.3. Please
> let me know
>
>
> Thanks,
> Rajeswari
>

Re: Performance of solr 9.3 vs 8.11

2023-10-12 Thread Tim Funk

In 9 - The JVM security manager is enabled by default. That might be your
issue.

Disable via  adding SOLR_SECURITY_MANAGER_ENABLED=false to your startup

-Tim

On Thu, Oct 12, 2023 at 1:54 PM Natarajan, Rajeswari
 wrote:

> Hi,
>
> Does anyone see any query performance degradation from 8.11 to 9.3. Please
> let me know
>
>
> Thanks,
> Rajeswari
>

Re: Performance of solr 9.3 vs 8.11

2023-10-12 Thread Natarajan, Rajeswari

We saw query response degradation with solr9 , that is why checking , we are 
not using PKIAuthenticationPlugin.

Thanks

On 10/12/23, 11:34 AM, "Tomás Fernández Löbbe" mailto:tomasflo...@gmail.com>> wrote:

Are you asking a general question or did you see degradation and you are
trying to dig into it? Some more details can help people understand the
problem.

There is this Jira[1] I filed about a specific type of degradation with
highly distributed indices when using PKIAuthenticationPlugin

[1] https://issues.apache.org/jira/browse/SOLR-16951 

On Thu, Oct 12, 2023 at 10:54 AM Natarajan, Rajeswari
mailto:rajeswari.natara...@sap.com.inva>lid> 
wrote:

> Hi,
>
> Does anyone see any query performance degradation from 8.11 to 9.3. Please
> let me know
>
>
> Thanks,
> Rajeswari
>

Re: Performance of solr 9.3 vs 8.11

2023-10-12 Thread Natarajan, Rajeswari

Thanks , will try it out.

On 10/12/23, 12:15 PM, "Tim Funk" mailto:funk...@apache.org>> wrote:

[You don't often get email from funk...@apache.org . 
Learn why this is important at https://aka.ms/LearnAboutSenderIdentification 
 ]

In 9 - The JVM security manager is enabled by default. That might be your
issue.

Disable via adding SOLR_SECURITY_MANAGER_ENABLED=false to your startup

-Tim

On Thu, Oct 12, 2023 at 1:54 PM Natarajan, Rajeswari
mailto:rajeswari.natara...@sap.com.inva>lid> 
wrote:

> Hi,
>
> Does anyone see any query performance degradation from 8.11 to 9.3. Please
> let me know
>
>
> Thanks,
> Rajeswari
>

Re: Performance of solr 9.3 vs 8.11

2023-10-12 Thread Natarajan, Rajeswari

We did see query response time increase about 50 ms with the same set up and 
queries , that is why wanted to check.

Thanks

On 10/12/23, 11:11 AM, "Andy Lester" mailto:a...@petdance.com>> wrote:

> On Oct 12, 2023, at 12:54 PM, Natarajan, Rajeswari 
>  LID> wrote:
> 
> Does anyone see any query performance degradation from 8.11 to 9.3. Please 
> let me know

What is it that you are really asking?

Are you wondering if there will be a slowdown if you upgrade from 8.11 to 9.3? 
If so, we need to know more details..

Are you observing what seems to be a query performance degradation after 
upgrading from 8.11 to 9.3, and you're trying to figure out why? If so, we need 
to know more details.

Andy

Re: A general question about update ordering

2023-10-12 Thread Chris Hostetter



: Because the two requests are sent by different services and coordinating those
: requests woud likely be difficult, I think the simplest change that would fix
: the problem is to use optimistic concurrency, setting the field to 0 on the
: "create" request so the request fails if the document already exists.  And of

i think you're missunderstanding rules of _version_ and how '0' is 
handled.

_version_=0 just means "ignore any verion rules, add/overwrite this doc no 
matter what"

what you probably want it...

* requests that expect to be creating a brand new doc: _version_=-1
  "this doc must not already exist"

* requests that expect to be updating an existing doc: _version_=1
  "this doc must exist with any version"


-Hoss
http://www.lucidworks.com/

Re: quoting/escaping of literal values in SOLR_OPTS ?

2023-10-12 Thread Kevin Risden

I ran `shellcheck solr/bin/solr` and one of the warnings jumped out as
potentially relevant. I haven't had a chance to check it further yet.

In solr/bin/solr line 1224:
SOLR_OPTS=(${SOLR_OPTS:-})
   ^^ SC2206 (warning): Quote to prevent word
splitting/globbing, or split robustly with mapfile or read -a.

My guess is its being split into an array based on spaces -
https://www.shellcheck.net/wiki/SC2206 has more details about options.

Kevin Risden


On Thu, Oct 12, 2023 at 1:41 PM Ishan Chattopadhyaya <
ichattopadhy...@gmail.com> wrote:

> SOLR_OPTS='-XX:-UseLargePages -Dfoo=bar'
> ./solr/packaging/build/dev/bin/solr
> start -f -a '-Dyak="white space"'
>
> Would this work?
>
> I remember that I did something like this for passing that remote debug
> parameters using -a, but can't remember if they had spaces or not.
>
>
> n Thu, 12 Oct, 2023, 11:06 pm Eric Pugh, 
> wrote:
>
> > We need more BATS tests around all these non common approaches for
> dealing
> > with parameters.  Or, figure out how to do less work in our bash scripts
> ;-)
> >
> > > On Oct 12, 2023, at 1:22 PM, Chris Hostetter  >
> > wrote:
> > >
> > >
> > >
> > >
> > > : SOLR_OPTS='-XX:-UseLargePages -Dfoo=bar -Dyak="white space"'
> > > : ./solr/packaging/build/dev/bin/solr start -V -f
> > > :
> > > : Does this work?
> > >
> > > No.  Sorry, i thought i included that in my list of examples...
> > >
> > > $ SOLR_OPTS='-XX:-UseLargePages -Dfoo=bar -Dyak="white space"'
> > ./solr/packaging/build/dev/bin/solr start -f
> > > Error: Could not find or load main class space"
> > > Caused by: java.lang.ClassNotFoundException: space"
> > >
> > >
> > > :
> > > : On Thu, 12 Oct, 2023, 6:08 am Chris Hostetter, <
> > hossman_luc...@fucit.org>
> > > : wrote:
> > > :
> > > : >
> > > : > my bash-fu isn't that great, but AFAICT the way SOLR_OPTS is used
> in
> > > : > bin/solr breaks on any attempt i can think of to quote/escape any
> jvm
> > > : > args included in the SOLR_OPTS env variable.
> > > : >
> > > : > Am i missing something, or is this a bug?
> > > : >
> > > : > (see examples below)
> > > : >
> > > : > -Hoss
> > > : > http://www.lucidworks.com/
> > > : >
> > > : >
> > > : > hossman@slate:~/lucene/solr [j11] [tags/releases/solr/9.3.0] $
> > > : > SOLR_OPTS='-XX:-UseLargePages -Dfoo=bar "-Dyak=white space"'
> > > : > ./solr/packaging/build/dev/bin/solr start -V -f
> > > : > Using Solr root directory:
> > > : > /home/hossman/lucene/solr/solr/packaging/build/dev
> > > : > Using Java: /opt/jdk/11/latest//bin/java
> > > : > openjdk version "11.0.15" 2022-04-19
> > > : > OpenJDK Runtime Environment Temurin-11.0.15+10 (build 11.0.15+10)
> > > : > OpenJDK 64-Bit Server VM Temurin-11.0.15+10 (build 11.0.15+10,
> mixed
> > mode)
> > > : >
> > > : > Starting Solr using the following settings:
> > > : >  JAVA= /opt/jdk/11/latest//bin/java
> > > : >  SOLR_SERVER_DIR =
> > > : > /home/hossman/lucene/solr/solr/packaging/build/dev/server
> > > : >  SOLR_HOME   =
> > > : > /home/hossman/lucene/solr/solr/packaging/build/dev/server/solr
> > > : >  SOLR_HOST   =
> > > : >  SOLR_PORT   = 8983
> > > : >  STOP_PORT   = 7983
> > > : >  JAVA_MEM_OPTS   = -Xms512m -Xmx512m
> > > : >  GC_TUNE = -XX:+UseG1GC -XX:+PerfDisableSharedMem
> > > : > -XX:+ParallelRefProcEnabled -XX:MaxGCPauseMillis=250
> > -XX:+UseLargePages
> > > : > -XX:+AlwaysPreTouch -XX:+ExplicitGCInvokesConcurrent
> > > : >  GC_LOG_OPTS =
> > > : >
> >
> -Xlog:gc*:file=/home/hossman/lucene/solr/solr/packaging/build/dev/server/logs/solr_gc.log:time,uptime:filecount=9,filesize=20M
> > > : >  SOLR_TIMEZONE   = UTC
> > > : >  SOLR_OPTS   = -XX:-UseLargePages -Dfoo=bar "-Dyak=white
> > space"
> > > : > -Xss256k
> > > : >
> > > : > Error: Could not find or load main class "-Dyak=white
> > > : > Caused by: java.lang.ClassNotFoundException: "-Dyak=white
> > > : > hossman@slate:~/lucene/solr [j11] [tags/releases/solr/9.3.0] $
> > > : > SOLR_OPTS='-XX:-UseLargePages -Dfoo=bar -Dyak=white\ space'
> > > : > ./solr/packaging/build/dev/bin/solr start -f
> > > : > Error: Could not find or load main class space
> > > : > Caused by: java.lang.ClassNotFoundException: space
> > > : > hossman@slate:~/lucene/solr [j11] [tags/releases/solr/9.3.0] $
> > > : > SOLR_OPTS="-XX:-UseLargePages -Dfoo=bar '-Dyak=white space'"
> > > : > ./solr/packaging/build/dev/bin/solr start -f
> > > : > Error: Could not find or load main class '-Dyak=white
> > > : > Caused by: java.lang.ClassNotFoundException: '-Dyak=white
> > > : > hossman@slate:~/lucene/solr [j11] [tags/releases/solr/9.3.0] $
> > > : > SOLR_OPTS="-XX:-UseLargePages -Dfoo=bar -Dyak='white space'"
> > > : > ./solr/packaging/build/dev/bin/solr start -f
> > > : > Error: Could not find or load main class space'
> > > : > Caused by: java.lang.ClassNotFoundException: space'
> > > : >
> > > : >
> > > : >
> > > : >
> > > :
> > >
> > > -Hoss
> > > http://www.lucidworks.com/
> >
> > ___

Re: A general question about update ordering

2023-10-12 Thread Shawn Heisey


On 10/12/23 13:26, Chris Hostetter wrote:

i think you're missunderstanding rules of _version_ and how '0' is
handled.


I'm about 90 percent sure the update requests are not being sent with 
the _version_ field populated.  I am verifying this right as quickly as 
I can.


Thanks,
Shawn

CPU spikes when sharding

Re: CPU spikes when sharding

Re: quoting/escaping of literal values in SOLR_OPTS ?

Re: quoting/escaping of literal values in SOLR_OPTS ?

Re: quoting/escaping of literal values in SOLR_OPTS ?

Performance of solr 9.3 vs 8.11

Re: Performance of solr 9.3 vs 8.11

Re: Performance of solr 9.3 vs 8.11

Re: Performance of solr 9.3 vs 8.11

Re: Performance of solr 9.3 vs 8.11

Re: Performance of solr 9.3 vs 8.11

Re: Performance of solr 9.3 vs 8.11

Re: A general question about update ordering

Re: quoting/escaping of literal values in SOLR_OPTS ?

Re: A general question about update ordering

15 matches

Site Navigation

Mail list logo

Footer information