https://databricks.com/blog/2015/05/28/tuning-java-garbage-collection-for-spark-applications.html
Regards, Vaquar khan On Wed, Jun 20, 2018, 1:18 AM Aakash Basu <aakash.spark....@gmail.com> wrote: > Hi guys, > > I just wanted to know, why my ParallelGC (*--conf > "spark.executor.extraJavaOptions=-XX:+UseParallelGC"*) in a very long > Spark ML Pipeline works faster than when I set G1GC (*--conf > "spark.executor.extraJavaOptions=-XX:+UseG1GC"*), even though the Spark > community suggests G1GC to be much better than the ParallelGC. > > Any pointers? > > Thanks, > Aakash. >
