[
https://issues.apache.org/jira/browse/LUCENE-8598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16716643#comment-16716643
]
ASF subversion and git services commented on LUCENE-8598:
---------------------------------------------------------
Commit ef61b547b175f9fbb63dd9fca78f7984f4f72be2 in lucene-solr's branch
refs/heads/jira/http2 from [~simonw]
[ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=ef61b54 ]
LUCENE-8599: Use sparse bitset to store docs in SingleValueDocValuesFieldUpdates
Using a sparse bitset in SingleValueDocValuesFieldUdpates allows storing
which documents have an update much more efficient and prevents the need
to sort the docs array altogether that showed to be a significant bottleneck
in LUCENE-8598. Using the spares bitset yields another 10x performance
improvement
in applying updates versus the changes proposed in LUCENE-8598.
> Improve field updates packed values
> -----------------------------------
>
> Key: LUCENE-8598
> URL: https://issues.apache.org/jira/browse/LUCENE-8598
> Project: Lucene - Core
> Issue Type: Improvement
> Reporter: Simon Willnauer
> Priority: Major
> Fix For: master (8.0), 7.7
>
> Time Spent: 1h 20m
> Remaining Estimate: 0h
>
> DocValuesFieldUpdats are using compact settings for packet ints that causes
> dramatic slowdowns when the updates are finished and sorted. Moving to
> the default
> accepted overhead ratio yields up to 4x improvements in applying updates.
> This change
> also improves the packing of numeric values since we know the value range
> in advance and
> can choose a different packing scheme in such a case.
> Overall this change yields a good performance improvement since 99% of
> the times of applying
> DV field updates are spend in the sort method which essentially makes
> applying the updates
> 4x faster.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
