yihua commented on issue #7541: URL: https://github.com/apache/hudi/issues/7541#issuecomment-1403080868
Hi @haoxie-aws the fix to this issue (#7690) is ready to land. I benchmarked the savepoint performance on a Hudi table with 20k partitions on a small EMR cluster and got the following improvement. Now the savepoint action should be fast with metadata table enabled and the performance should not depend on the number of partitions. Could you also test the fix on your end to see how much improvement you get? | Hudi version | Savepoint time (s) | | ------------ | ------------ | | 0.12.1 | 118.6 | | Latest master | 31.5 | | This PR | 10.9 | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
