[
https://issues.apache.org/jira/browse/LUCENE-8590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710318#comment-16710318
]
ASF subversion and git services commented on LUCENE-8590:
---------------------------------------------------------
Commit eaf840867fade1dfdd1adb9bf510ec181aa4e3f8 in lucene-solr's branch
refs/heads/branch_7x from [~simonw]
[ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=eaf8408 ]
LUCENE-8590: Optimize DocValues update datastructures
Today we are using a LinkedHashMap to buffer doc-values updates in
BufferedUpdates. This on the one hand uses an Object based datastructure
and on the other requires re-encoding the data into a more compact
representation
once the BufferedUpdates are frozen. This change uses a more compact
represenation
for the updates already in the BufferedUpdates in a parallel-array like
datastructure
that can be reused in FrozenBufferedDeletes. It also adds an much simpler to use
API to consume the updates and allows for internal memory optimization for
common
case updates.
> Optimize DocValues update datastructures
> ----------------------------------------
>
> Key: LUCENE-8590
> URL: https://issues.apache.org/jira/browse/LUCENE-8590
> Project: Lucene - Core
> Issue Type: Improvement
> Reporter: Simon Willnauer
> Priority: Major
> Fix For: 7.6, master (8.0)
>
> Time Spent: 3h 50m
> Remaining Estimate: 0h
>
> Today we are using a LinkedHashMap to buffer doc-values updates in
> BufferedUpdates. This on the one hand uses an Object based datastructure
> and on the other requires re-encoding the data into a more compact
> representation
> once the BufferedUpdates are frozen. This change uses a more compact
> represenation
> for the updates already in the BufferedUpdates in a parallel-array like
> datastructure
> that can be reused in FrozenBufferedDeletes. It also adds an much simpler
> to use
> API to consume the updates and allows for internal memory optimization
> for common
> case updates.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
