xy720 opened a new issue #3944: URL: https://github.com/apache/incubator-doris/issues/3944
**Describe the bug** In doris, the descriptor of every file opened by BE is stored in cache. For both segment V1 and V2, the file descriptor will be released after its file handler's close() is called. The storage engine will periodically clean up the released descriptors stored in the cache. However, segment V1 and V2 don't share on same cache. And storage engine only detach a clean thread for segment V1. As a result, segment V2's cache will never gets cleaned up and the unreleased descriptors in cache make the files unable to be deleted, which will eventually exhausts the space of disk. **To Reproduce** Steps to reproduce the behavior: 1. Create a table with "storage_format" = "V2". 2. Load data into the table every short period of time. 3. List all open files in disk(lsof), check if there are lots of "deleted" files. **Expected behavior** Make segment V1 and segment V2 share on same cache, so that storage engine can clean up cache of both at a same time. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
