deepakpanda93 commented on issue #15544: URL: https://github.com/apache/hudi/issues/15544#issuecomment-4892115406
This issue was reviewed as part of the JIRA-migrated backlog triage. The improvement here - faster file deletion for DROP TABLE / TRUNCATE TABLE - is already in place on current Hudi (all 1.x). Both commands delete via the distributed, parallelized FSUtils.deleteDir(HoodieEngineContext, storage, path, parallelism), which fans sub-path deletion out across the engine (Spark) using parallelizeSubPathProcess(...) rather than a serial recursive filesystem delete: - DropHoodieTableCommand -> FSUtils.deleteDir(engineContext, storage, targetPath, defaultParallelism) - TruncateHoodieTableCommand -> same The linked PR #7144 has been open and un-merged since 2022 and is effectively superseded by the current implementation (the status:pr-available label points at that stale PR). Closing as already-addressed. If the intended improvement was something more specific than parallel deletion (the original PR/JIRA didn't include a description), please add detail and reopen. Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
