LuciferYang commented on PR #13528: URL: https://github.com/apache/gravitino/pull/13528#issuecomment-5867323597
Good idea, I reworked it this way. The storage now opens and closes a `Dataset` per operation and keeps a single storage-scoped `Session` that shares the index and metadata caches across those opens. That removes the dataset cache and its refcounting entirely, so there is no cached handle an eviction can close under an in-flight scan. The `Session` is closed in `close()` before the allocator. I also dropped the now-unused `datasetCacheSize` option and its docs row. cc @roryqi @yuqi1129 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
