kenssa4eedfd opened a new pull request, #3134: URL: https://github.com/apache/hugegraph/pull/3134
## Purpose of the PR
This PR introduces ToplingDB as an optional RocksDB-compatible storage
engine
for HugeGraph.
ToplingDB is explicitly enabled through configuration. Standard RocksDB
remains
the default, so existing deployments and data paths are unaffected unless
`rocksdb.provider=topling` is configured.
## Main Changes
- Add explicit storage engine selection through `rocksdb.provider`.
- Integrate ToplingDB with HugeGraph Server, PD, and Store.
- Use ToplingDB Easy Migrate YAML configuration while continuing to use
the
standard RocksDB Java API.
- Add component-specific configurations for Server, PD, and Store,
including
separate HTTP ports and JRaft column-family settings.
- Add startup scripts that:
- Select and preload the ToplingDB JNI library.
- Extract required native libraries and Web UI resources.
- Configure `LD_PRELOAD`, `LD_LIBRARY_PATH`, and
`TOPLINGDB_EASY_MIGRATE_CONF`.
- Validate the operating system and architecture.
- Verify downloaded dependencies using SHA-256.
- Handle jemalloc and Ubuntu 24.04 `libaio` compatibility.
- Align the RocksDB JNI version across Server, PD, and Store.
- Update CI workflows to install and test the ToplingDB runtime
dependencies.
- Update third-party dependency metadata, LICENSE information, operational
documentation, troubleshooting guides, and security notes.
## Compatibility
- Standard RocksDB remains the default provider.
- Existing RocksDB data and APIs remain compatible.
- ToplingDB is enabled only when `rocksdb.provider=topling` is configured.
- No public HugeGraph API changes are introduced.
- The bundled ToplingDB runtime currently targets Linux x86_64.
## Verifying these changes
- [ ] Trivial rework / code cleanup without any test coverage. (No Need)
- [ ] Already covered by existing tests, such as *(please modify tests
here)*.
- [x] Need tests and can be verified as follows:
- Build all modules:
```bash
mvn clean compile -Dmaven.javadoc.skip=true
```
- Run HugeGraph Server tests with the RocksDB backend:
```bash
mvn test -pl hugegraph-server/hugegraph-test -am \
-P core-test,rocksdb
```
- Run PD tests:
```bash
mvn install -pl hugegraph-struct -am -DskipTests
mvn test -pl hugegraph-pd/hg-pd-test -am
```
- Run Store tests:
```bash
mvn test -pl hugegraph-store/hg-store-test -am
```
- Verify Server, PD, and Store startup in both standard RocksDB mode and
ToplingDB mode.
## Does this PR potentially affect the following parts?
- [x] Dependencies
- [x] Modify configurations
- [ ] The public API
- [x] Other affects: startup scripts, native library loading, and CI
workflows
- [ ] Nope
## Documentation Status
- [ ] `Doc - TODO`
- [x] `Doc - Done`
- [ ] `Doc - No Need`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
