ahshahid commented on code in PR #50033:
URL: https://github.com/apache/spark/pull/50033#discussion_r1982447026
##########
core/src/test/scala/org/apache/spark/scheduler/DAGSchedulerSuite.scala:
##########
@@ -3185,16 +3197,101 @@ class DAGSchedulerSuite extends SparkFunSuite with
TempLocalSparkContext with Ti
"Spark can only do this while using the new shuffle block fetching
protocol"))
}
+ test("SPARK-51272: retry all the succeeding stages when the map stage is
indeterminate with" +
+ " concurrent tasks completion") {
+ if (scheduler != null) {
+ this.afterEach()
+ }
+ val resubmitFailedStageTriggered = Array.fill[Boolean](1)(false)
Review Comment:
Let me see if I can remove it.. It is old habit from Java, where anonymous
inner class can access only final fields of outer class.
I am not sure if it holds true for scala.. I mean if the anonymous inner
class in scala can access mutable fields of outer class and mutate them, then
array can be replaced by a single var boolean
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
