[
https://issues.apache.org/jira/browse/SOLR-16799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17728068#comment-17728068
]
Alex Deparvu edited comment on SOLR-16799 at 6/8/23 4:37 PM:
-------------------------------------------------------------
I did some minor manual testing on this upgrade.I even ran it on jdk20 with the
new lucene jdk memory segment api! I did not see any obvious errors so far. my
goal was to run the exiting `CloudIndexing` benchmark but gradle will not run
on jdk20 yet, so this is not possible yet.
[edit] I was able to run benchmarks on jdk19
Params common across both runs:
{noformat}
running JMH with args: CloudIndexing
# VM version: JDK 19.0.2, OpenJDK 64-Bit Server VM, 19.0.2+7-44
# Warmup: 3 iterations, 10 s each
# Measurement: 4 iterations, 20 s each
# Timeout: 300 s per iteration
# Threads: 4 threads, will synchronize iterations
# Benchmark mode: Throughput, ops/time
# Benchmark: org.apache.solr.bench.index.CloudIndexing.indexLargeDoc
# Parameters: (directBuffer = true, nodeCount = 4, numReplicas = 1, numShards =
5, scale = 1, useStringUtf8Over = 0)
{noformat}
* results with MemorySegmentIndexInput enabled
{noformat}
org.apache.lucene.store.MemorySegmentIndexInputProvider <init>
INFO: Using MemorySegmentIndexInput with Java 19; to disable start with
-Dorg.apache.lucene.store.MMapDirectory.enableMemorySegments=false
Result "org.apache.solr.bench.index.CloudIndexing.indexLargeDoc":
930.101 ±(99.9%) 156.023 ops/s [Average]
(min, avg, max) = (898.710, 930.101, 956.251), stdev = 24.145
CI (99.9%): [774.078, 1086.124] (assumes normal distribution)
{noformat}
* results with MemorySegmentIndexInput disabled
I did have to manually remove `-XX:-UseBiasedLocking` as jdk19 will not accept
it anymore
{noformat}
./jmh.sh CloudIndexing -jvmArgsAppend
-Dorg.apache.lucene.store.MMapDirectory.enableMemorySegments=false
{noformat}
{noformat}
Result "org.apache.solr.bench.index.CloudIndexing.indexLargeDoc":
910.928 ±(99.9%) 58.121 ops/s [Average]
(min, avg, max) = (899.527, 910.928, 921.492), stdev = 8.994
CI (99.9%): [852.806, 969.049] (assumes normal distribution)
{noformat}
was (Author: alex.parvulescu):
I did some minor manual testing on this upgrade.I even ran it on jdk20 with the
new lucene jdk memory segment api! I did not see any obvious errors so far. my
goal was to run the exiting `CloudIndexing` benchmark but gradle will not run
on jdk20 yet, so this is not possible yet.
[edit] I was able to run benchmarks on jdk19
Params common across both runs:
{noformat}
running JMH with args: CloudIndexing
# VM version: JDK 19.0.2, OpenJDK 64-Bit Server VM, 19.0.2+7-44
# Warmup: 3 iterations, 10 s each
# Measurement: 4 iterations, 20 s each
# Timeout: 300 s per iteration
# Threads: 4 threads, will synchronize iterations
# Benchmark mode: Throughput, ops/time
# Benchmark: org.apache.solr.bench.index.CloudIndexing.indexLargeDoc
# Parameters: (directBuffer = true, nodeCount = 4, numReplicas = 1, numShards =
5, scale = 1, useStringUtf8Over = 0)
{noformat}
* results with MemorySegmentIndexInput enabled
{noformat}
org.apache.lucene.store.MemorySegmentIndexInputProvider <init>
INFO: Using MemorySegmentIndexInput with Java 19; to disable start with
-Dorg.apache.lucene.store.MMapDirectory.enableMemorySegments=false
Result "org.apache.solr.bench.index.CloudIndexing.indexLargeDoc":
930.101 ±(99.9%) 156.023 ops/s [Average]
(min, avg, max) = (898.710, 930.101, 956.251), stdev = 24.145
CI (99.9%): [774.078, 1086.124] (assumes normal distribution)
{noformat}
* results with MemorySegmentIndexInput disabled
I did have to manually remove `-XX:-UseBiasedLocking` as jdk19 will not accept
it anymore
{noformat}
./jmh.sh CloudIndexing -jvmArgsAppend
-Dorg.apache.lucene.store.MMapDirectory.enableMemorySegments=false
{noformat}
{noformat}
Result "org.apache.solr.bench.index.CloudIndexing.indexLargeDoc":
910.928 ±(99.9%) 58.121 ops/s [Average]
(min, avg, max) = (899.527, 910.928, 921.492), stdev = 8.994
CI (99.9%): [852.806, 969.049] (assumes normal distribution)
{noformat}
> upgrade Solr to use Lucene 9.6.0
> --------------------------------
>
> Key: SOLR-16799
> URL: https://issues.apache.org/jira/browse/SOLR-16799
> Project: Solr
> Issue Type: Task
> Reporter: Christine Poerschke
> Priority: Major
> Labels: newdev
> Time Spent: 40m
> Remaining Estimate: 0h
>
> Apache Lucene 9.6.0 was recently released:
> [https://lists.apache.org/thread/d4zw7o3t0g4h329wk7vc7s5730bsyk5t]
> This ticket is to upgrade Solr's Lucene dependency from 9.5.0 to the latest
> 9.6.0 version.
> new or existing contributors interested in this ticket:
> * please take a look at the documentation to see what's involved:
> [https://github.com/apache/solr/blob/main/dev-docs/lucene-upgrade.md]
> * optional: add a short note on this ticket to share your intention to work
> on this
> * make the upgrade changes (and of course do feel free to ask any questions
> that may arise)
> * open a pull request
> Solr committers, please could you:
> * help review/merge/backport etc. the pull request for this ticket
> * try and leave the upgrade itself as an opportunity for someone else to
> also contribute to the project
> Thanks everyone!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@solr.apache.org
For additional commands, e-mail: issues-h...@solr.apache.org
