yaooqinn opened a new pull request, #54619: URL: https://github.com/apache/spark/pull/54619
### What changes were proposed in this pull request? Reduces `spark.cleaner.periodicGC.interval` from the default 30 minutes to 60 seconds for `ThriftServerQueryTestSuite`. ### Why are the changes needed? `ThriftServerQueryTestSuite` runs 800+ SQL golden file tests sequentially in a single SparkSession over ~50 minutes. The default 30-minute periodic GC interval means only one GC fires during the entire run, allowing memory to accumulate. This causes intermittent OOM (`java.lang.OutOfMemoryError: Java heap space`) during memory-intensive tests like scalar subquery evaluation, with 100+ failed 64MB page allocations. For example: https://github.com/apache/spark/actions/runs/22659394682/job/65676090341 With 60-second intervals, GC runs ~50 times during the suite, preventing the memory buildup. ### Does this PR introduce _any_ user-facing change? No. Test-only change. ### How was this patch tested? Compilation verified. The change only affects test configuration. ### Was this patch authored or co-authored using generative AI tooling? Yes, co-authored with GitHub Copilot. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
