siying opened a new pull request, #50520: URL: https://github.com/apache/spark/pull/50520
### Why are the changes needed? RocksDB State Store's Lineage Manager currently isn't synchronized, but it can be accessed by both DB loading and maintenance thread. In theory, it can cause wrong lineage: 1. maintenance thread get current lineage 2. task commit() adds a lineage from the lienage 3. maintenance thread does the truncation and store it back In this case, the new lineage added by 2. is lost. It should be fixed by simply synchronizing those operations. ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Run existing unit tests ### Was this patch authored or co-authored using generative AI tooling? No. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
