dependabot[bot] opened a new pull request, #5692: URL: https://github.com/apache/ignite-3/pull/5692
Bumps [org.rocksdb:rocksdbjni](https://github.com/facebook/rocksdb) from 9.10.0 to 10.0.1. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/facebook/rocksdb/releases";>org.rocksdb:rocksdbjni's releases</a>.</em></p> <blockquote> <h2>RocksDB 10.0.1 Release</h2> <h2>10.0.1 (2025-03-05)</h2> <h3>Public API Changes</h3> <ul> <li>Add an unordered map of name/value pairs, ReadOptions::property_bag, to pass opaque options through to an external table when creating an Iterator.</li> <li>Introduced CompactionServiceJobStatus::kAborted to allow handling aborted scenario in Schedule(), Wait() or OnInstallation() APIs in Remote Compactions.</li> <li>Added a column family option disallow_memtable_writes to safely fail any attempts to write to a non-default column family. This can be used for column families that are ingest only.</li> </ul> <h2>10.0.0 (2025-02-21)</h2> <h3>New Features</h3> <ul> <li>Introduced new <code>auto_refresh_iterator_with_snapshot</code> opt-in knob that (when enabled) will periodically release obsolete memory and storage resources for as long as the iterator is making progress and its supplied <code>read_options.snapshot</code> was initialized with non-nullptr value.</li> <li>Added the ability to plug-in a custom table reader implementation. See include/rocksdb/external_table_reader.h for more details.</li> <li>Experimental feature: RocksDB now supports FAISS inverted file based indices via the secondary indexing framework. Applications can use FAISS secondary indices to automatically quantize embeddings and perform K-nearest-neighbors similarity searches. See <code>FaissIVFIndex</code> and <code>SecondaryIndex</code> for more details. Note: the FAISS integration currently requires using the BUCK build.</li> <li>Add new DB property <code>num_running_compaction_sorted_runs</code> that tracks the number of sorted runs being processed by currently running compactions</li> <li>Experimental feature: added support for simple secondary indices that index the specified column as-is. See <code>SimpleSecondaryIndex</code> and <code>SecondaryIndex</code> for more details.</li> <li>Added new <code>TransactionDBOptions::txn_commit_bypass_memtable_threshold</code>, which enables optimized transaction commit (see <code>TransactionOptions::commit_bypass_memtable</code>) when the transaction size exceeds a configured threshold.</li> </ul> <h3>Public API Changes</h3> <ul> <li>Updated the query API of the experimental secondary indexing feature by removing the earlier <code>SecondaryIndex::NewIterator</code> virtual and adding a <code>SecondaryIndexIterator</code> class that can be utilized by applications to find the primary keys for a given search target.</li> <li>Added back the ability to leverage the primary key when building secondary index entries. This involved changes to the signatures of <code>SecondaryIndex::GetSecondary{KeyPrefix,Value}</code> as well as the addition of a new method <code>SecondaryIndex::FinalizeSecondaryKeyPrefix</code>. See the API comments for more details.</li> <li>Minimum supported version of ZSTD is now 1.4.0, for code simplification. Obsolete <code>CompressionType</code> <code>kZSTDNotFinalCompression</code> is also removed.</li> </ul> <h3>Behavior Changes</h3> <ul> <li><code>VerifyBackup</code> in <code>verify_with_checksum</code>=<code>true</code> mode will now evaluate checksums in parallel. As a result, unlike in case of original implementation, the API won't bail out on a very first corruption / mismatch and instead will iterate over all the backup files logging success / <em>degree_of_failure</em> for each.</li> <li>Reversed the order of updates to the same key in WriteBatchWithIndex. This means if there are multiple updates to the same key, the most recent update is ordered first. This affects the output of WBWIIterator. When WriteBatchWithIndex is created with <code>overwrite_key=true</code>, this affects the output only if Merge is used (<a href="https://redirect.github.com/facebook/rocksdb/issues/13387";>#13387</a>).</li> <li>Added support for Merge operations in transactions using option <code>TransactionOptions::commit_bypass_memtable</code>.</li> </ul> <h3>Bug Fixes</h3> <ul> <li>Fixed GetMergeOperands() API in ReadOnlyDB and SecondaryDB</li> <li>Fix a bug in <code>GetMergeOperands()</code> that can return incorrect status (MergeInProgress) and incorrect number of merge operands. This can happen when <code>GetMergeOperandsOptions::continue_cb</code> is set, both active and immutable memtables have merge operands and the callback stops the look up at the immutable memtable.</li> </ul> <h2>RocksDB 9.11.2 Release</h2> <h1>Rocksdb Change Log</h1> <blockquote> <p>NOTE: Entries for next release do not go here. Follow instructions in <code>unreleased_history/README.txt</code></p> </blockquote> <h2>9.11.2 (03/29/2025)</h2> <p>Bump patch version to fix a mistake in the previous 9.11 release tag</p> <h2>9.11.1 (02/19/2025)</h2> <h3>New Features</h3> <ul> <li>Added the ability to plug-in a custom table reader implementation. See include/rocksdb/external_table_reader.h for more details.</li> </ul> <h2>9.11.0 (01/17/2025)</h2> <h3>New Features</h3> <ul> <li>Introduce CancelAwaitingJobs() in CompactionService interface which will allow users to implement cancellation of running remote compactions from the primary instance</li> <li>Experimental feature: RocksDB now supports defining secondary indices, which are automatically maintained by the storage engine. Secondary indices provide a new customization point: applications can provide their own by implementing the new <code>SecondaryIndex</code> interface. See the <code>SecondaryIndex</code> API comments for more details. Note: this feature is currently only available in conjunction with write-committed pessimistic transactions, and <code>Merge</code> is not yet supported.</li> <li>Provide a new option <code>track_and_verify_wals</code> to track and verify various information about WAL during WAL recovery. This is intended to be a better replacement to <code>track_and_verify_wals_in_manifest</code>.</li> </ul> <h3>Public API Changes</h3> <ul> <li>Add <code>io_buffer_size</code> to BackupEngineOptions to enable optimal configuration of IO size</li> <li>Clean up all the references to <code>random_access_max_buffer_size</code>, related rules and all the clients wrappers. This option has been officially deprecated in 5.4.0.</li> </ul> <!-- raw HTML omitted --> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Changelog</summary> <p><em>Sourced from <a href="https://github.com/facebook/rocksdb/blob/v10.0.1/HISTORY.md";>org.rocksdb:rocksdbjni's changelog</a>.</em></p> <blockquote> <h2>10.0.1 (03/05/2025)</h2> <h3>Public API Changes</h3> <ul> <li>Add an unordered map of name/value pairs, ReadOptions::property_bag, to pass opaque options through to an external table when creating an Iterator.</li> <li>Introduced CompactionServiceJobStatus::kAborted to allow handling aborted scenario in Schedule(), Wait() or OnInstallation() APIs in Remote Compactions.</li> <li>Added a column family option disallow_memtable_writes to safely fail any attempts to write to a non-default column family. This can be used for column families that are ingest only.</li> </ul> <h2>10.0.0 (02/21/2025)</h2> <h3>New Features</h3> <ul> <li>Introduced new <code>auto_refresh_iterator_with_snapshot</code> opt-in knob that (when enabled) will periodically release obsolete memory and storage resources for as long as the iterator is making progress and its supplied <code>read_options.snapshot</code> was initialized with non-nullptr value.</li> <li>Added the ability to plug-in a custom table reader implementation. See include/rocksdb/external_table_reader.h for more details.</li> <li>Experimental feature: RocksDB now supports FAISS inverted file based indices via the secondary indexing framework. Applications can use FAISS secondary indices to automatically quantize embeddings and perform K-nearest-neighbors similarity searches. See <code>FaissIVFIndex</code> and <code>SecondaryIndex</code> for more details. Note: the FAISS integration currently requires using the BUCK build.</li> <li>Add new DB property <code>num_running_compaction_sorted_runs</code> that tracks the number of sorted runs being processed by currently running compactions</li> <li>Experimental feature: added support for simple secondary indices that index the specified column as-is. See <code>SimpleSecondaryIndex</code> and <code>SecondaryIndex</code> for more details.</li> <li>Added new <code>TransactionDBOptions::txn_commit_bypass_memtable_threshold</code>, which enables optimized transaction commit (see <code>TransactionOptions::commit_bypass_memtable</code>) when the transaction size exceeds a configured threshold.</li> </ul> <h3>Public API Changes</h3> <ul> <li>Updated the query API of the experimental secondary indexing feature by removing the earlier <code>SecondaryIndex::NewIterator</code> virtual and adding a <code>SecondaryIndexIterator</code> class that can be utilized by applications to find the primary keys for a given search target.</li> <li>Added back the ability to leverage the primary key when building secondary index entries. This involved changes to the signatures of <code>SecondaryIndex::GetSecondary{KeyPrefix,Value}</code> as well as the addition of a new method <code>SecondaryIndex::FinalizeSecondaryKeyPrefix</code>. See the API comments for more details.</li> <li>Minimum supported version of ZSTD is now 1.4.0, for code simplification. Obsolete <code>CompressionType</code> <code>kZSTDNotFinalCompression</code> is also removed.</li> </ul> <h3>Behavior Changes</h3> <ul> <li><code>VerifyBackup</code> in <code>verify_with_checksum</code>=<code>true</code> mode will now evaluate checksums in parallel. As a result, unlike in case of original implementation, the API won't bail out on a very first corruption / mismatch and instead will iterate over all the backup files logging success / <em>degree_of_failure</em> for each.</li> <li>Reversed the order of updates to the same key in WriteBatchWithIndex. This means if there are multiple updates to the same key, the most recent update is ordered first. This affects the output of WBWIIterator. When WriteBatchWithIndex is created with <code>overwrite_key=true</code>, this affects the output only if Merge is used (<a href="https://redirect.github.com/facebook/rocksdb/issues/13387";>#13387</a>).</li> <li>Added support for Merge operations in transactions using option <code>TransactionOptions::commit_bypass_memtable</code>.</li> </ul> <h3>Bug Fixes</h3> <ul> <li>Fixed GetMergeOperands() API in ReadOnlyDB and SecondaryDB</li> <li>Fix a bug in <code>GetMergeOperands()</code> that can return incorrect status (MergeInProgress) and incorrect number of merge operands. This can happen when <code>GetMergeOperandsOptions::continue_cb</code> is set, both active and immutable memtables have merge operands and the callback stops the look up at the immutable memtable.</li> </ul> <h2>9.11.0 (01/17/2025)</h2> <h3>New Features</h3> <ul> <li>Introduce CancelAwaitingJobs() in CompactionService interface which will allow users to implement cancellation of running remote compactions from the primary instance</li> <li>Experimental feature: RocksDB now supports defining secondary indices, which are automatically maintained by the storage engine. Secondary indices provide a new customization point: applications can provide their own by implementing the new <code>SecondaryIndex</code> interface. See the <code>SecondaryIndex</code> API comments for more details. Note: this feature is currently only available in conjunction with write-committed pessimistic transactions, and <code>Merge</code> is not yet supported.</li> <li>Provide a new option <code>track_and_verify_wals</code> to track and verify various information about WAL during WAL recovery. This is intended to be a better replacement to <code>track_and_verify_wals_in_manifest</code>.</li> </ul> <h3>Public API Changes</h3> <ul> <li>Add <code>io_buffer_size</code> to BackupEngineOptions to enable optimal configuration of IO size</li> <li>Clean up all the references to <code>random_access_max_buffer_size</code>, related rules and all the clients wrappers. This option has been officially deprecated in 5.4.0.</li> <li>Add <code>file_ingestion_nanos</code> and <code>file_ingestion_blocking_live_writes_nanos</code> in PerfContext to observe file ingestions</li> <li>Offer new DB::Open and variants that use <code>std::unique_ptr<DB>*</code> output parameters and deprecate the old versions that use <code>DB**</code> output parameters.</li> <li>The DB::DeleteFile API is officially deprecated.</li> </ul> <h3>Behavior Changes</h3> <ul> <li>For leveled compaction, manual compaction (CompactRange()) will be more strict about keeping compaction size under <code>max_compaction_bytes</code>. This prevents overly large compactions in some cases (<a href="https://redirect.github.com/facebook/rocksdb/issues/13306";>#13306</a>).</li> <li>Experimental tiering options <code>preclude_last_level_data_seconds</code> and <code>preserve_internal_time_seconds</code> are now mutable with <code>SetOptions()</code>. Some changes to handling of these features along with long-lived snapshots and range deletes made this possible.</li> </ul> <h3>Bug Fixes</h3> <ul> <li>Fix a longstanding major bug with SetOptions() in which setting changes can be quietly reverted.</li> </ul> </blockquote> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/facebook/rocksdb/commit/45f74739090be67d7d6a437cbe7e7c62a98d1f80";><code>45f7473</code></a> set ignore_unknown_options when parsing options (<a href="https://redirect.github.com/facebook/rocksdb/issues/13443";>#13443</a>)</li> <li><a href="https://github.com/facebook/rocksdb/commit/884f57ccc10feead88411f898632c267ae803b81";><code>884f57c</code></a> Fix version numbering from 10.1.0 to 10.0.1</li> <li><a href="https://github.com/facebook/rocksdb/commit/6fff8f68491ef3e0e214b08bb988ddc59643de5f";><code>6fff8f6</code></a> Update HISTORY and version to 10.1.0</li> <li><a href="https://github.com/facebook/rocksdb/commit/28788c63377950e323012f85655a2960638a025c";><code>28788c6</code></a> Introduce kAborted Status (<a href="https://redirect.github.com/facebook/rocksdb/issues/13438";>#13438</a>)</li> <li><a href="https://github.com/facebook/rocksdb/commit/b09612881c5b9de75c5297232604c6e97eb23f6c";><code>b096128</code></a> Add Logging for debugging InputFileCheck Failure (<a href="https://redirect.github.com/facebook/rocksdb/issues/13427";>#13427</a>)</li> <li><a href="https://github.com/facebook/rocksdb/commit/513c8d2f1648fd2f6e323adfc2d0d43a28ea2d64";><code>513c8d2</code></a> Initial implementation of ExternalTableBuilder (<a href="https://redirect.github.com/facebook/rocksdb/issues/13434";>#13434</a>)</li> <li><a href="https://github.com/facebook/rocksdb/commit/82ada7502d39b5e1aefe51cc1a37ef3c5a042a25";><code>82ada75</code></a> Add opaque options in ReadOptions for external tables (<a href="https://redirect.github.com/facebook/rocksdb/issues/13436";>#13436</a>)</li> <li><a href="https://github.com/facebook/rocksdb/commit/20b93e3bf7f101da29bf9b2257adc197151f70b2";><code>20b93e3</code></a> New CF option disallow_memtable_writes (<a href="https://redirect.github.com/facebook/rocksdb/issues/13431";>#13431</a>)</li> <li><a href="https://github.com/facebook/rocksdb/commit/c1f63e16f0def68ad83209700d486889ae86d8ce";><code>c1f63e1</code></a> Add missing txn updates to HISTORY.md</li> <li><a href="https://github.com/facebook/rocksdb/commit/ba27c3a0f9e5ce4a6dfb798568daee0ab858e4b6";><code>ba27c3a</code></a> Update HISTORY.md for 10.0 release</li> <li>Additional commits viewable in <a href="https://github.com/facebook/rocksdb/compare/v9.10.0...v10.0.1";>compare view</a></li> </ul> </details> <br /> [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@ignite.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
