This is an automated email from the ASF dual-hosted git repository.
xiangfu0 pushed a change to branch xiangfu0/data-3221-9-column-arrays
in repository https://gitbox.apache.org/repos/asf/pinot.git
omit f23d03c0ac4 Adapt lazy loader and config test to column views
omit 6393783dfe9 Use existing column views instead of extra metadata APIs
omit 3a39001a192 DATA-3221 (10): publish the segment column arrays as one
immutable pair
omit 7f2f9a6fb55 DATA-3221 (10): hold segment column metadata in sorted
arrays, derive the map on demand
omit 702a6348a98 Keep focused packed metadata coverage
omit 4d394f464f4 DATA-3221 (8+9 follow-up): drop the shared shape, pack
bitsPerElement instead
omit 0073673fd99 DATA-3221 (8+9): shared column shape and primitive min/max
in ColumnMetadataImpl
omit e76a4f259a9 Use per-segment schema state in lazy metadata tests
omit 3754ce93f55 Slim ColumnMetadataImpl to 72 bytes and derive the
per-segment Schema lazily
add 4ed98b81c17 Serialize v1/v2 index buffer access for lazy
materialization and cover destroy vs in-flight
add 3c0bd9b5b00 Slim ColumnMetadataImpl to 72 bytes and derive the
per-segment Schema lazily
add ed2bf68149e Use per-segment schema state in lazy metadata tests
add 49a54b2cbc2 Invalidate the derived schema when the loader registers
virtual columns
add 86abbf58b6a DATA-3221 (8+9): shared column shape and primitive min/max
in ColumnMetadataImpl
add a34f0e59419 DATA-3221 (8+9 follow-up): drop the shared shape, pack
bitsPerElement instead
add 6bf534c62e2 Keep focused packed metadata coverage
add 02deb743ed0 Pack min/max words without boxing and tighten the layout
Javadoc
add 1c4ae614375 DATA-3221 (10): hold segment column metadata in sorted
arrays, derive the map on demand
add 018cd5813d9 DATA-3221 (10): publish the segment column arrays as one
immutable pair
add 7f41710c9ec Use existing column views instead of extra metadata APIs
add 04fa40717c9 Adapt lazy loader and config test to column views
add 15f6c8a955e Make the derived column metadata map read-only and the SPI
defaults null-tolerant
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (f23d03c0ac4)
\
N -- N -- N refs/heads/xiangfu0/data-3221-9-column-arrays
(15f6c8a955e)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.../indexsegment/immutable/ColumnMaterializer.java | 6 +-
.../immutable/ImmutableSegmentLoader.java | 26 ++-
.../immutable/PhysicalColumnNames.java | 5 +-
.../segment/readers/PinotSegmentRecordReader.java | 10 +-
.../local/segment/store/FilePerIndexDirectory.java | 13 +-
.../immutable/ColumnMaterializerTest.java | 19 +++
.../immutable/ImmutableSegmentImplTest.java | 46 ++++++
.../segment/index/SegmentMetadataImplTest.java | 64 ++++++++
.../segment/store/FilePerIndexDirectoryTest.java | 47 ++++++
.../apache/pinot/segment/spi/SegmentMetadata.java | 14 +-
.../spi/index/metadata/ColumnMetadataImpl.java | 52 +++---
.../spi/index/metadata/SegmentMetadataImpl.java | 177 +++++++++++++++++++--
.../spi/index/metadata/SortedStringArraySet.java | 2 +
.../pinot/segment/spi/store/SegmentDirectory.java | 5 +
.../pinot/server/api/resources/TablesResource.java | 4 +-
.../spi/config/table/OpenStructIndexConfig.java | 26 +++
.../config/table/OpenStructIndexConfigTest.java | 17 ++
17 files changed, 480 insertions(+), 53 deletions(-)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
