Although like you said, spark support for scala 2.12 is beta anyway then shouldn’t we get it to a working state by basing on 2.12.7? There shouldn’t be a stability issue since it is not officially “supported”
________________________________ From: Wenchen Fan <cloud0...@gmail.com> Sent: Monday, October 1, 2018 7:43 PM To: Sean Owen Cc: sad...@zoho.com; Spark dev list Subject: Re: On Scala 2.12.7 My major concern is how it will affect end-users if Spark 2.4 is built with Scala versions prior to 2.12.7. Generally I'm hesitating to upgrade Scala version when we are very close to a release, and Scala 2.12 build of Spark 2.4 is beta anyway. On Sat, Sep 29, 2018 at 6:46 AM Sean Owen <sro...@apache.org<mailto:sro...@apache.org>> wrote: I'm forking the discussion about Scala 2.12.7 from the 2.4.0 RC vote thread. 2.12.7 was released yesterday, and, is even labeled as fixing Spark 2.4 compatibility! https://www.scala-lang.org/news/2.12.7 We should look into it, yes. Darcy identified, and they fixed, this issue: https://github.com/scala/scala/pull/7156 while finishing the work for Scala 2.12. However we already worked around this in Spark, no? at https://github.com/apache/spark/commit/f29c2b5287563c0d6f55f936bd5a75707d7b2b1f So we should go ahead and update to use 2.12.7, yes, and undo this workaround? But this doesn't necessarily block a 2.4.0 release, if it's already worked around. --------------------------------------------------------------------- To unsubscribe e-mail: dev-unsubscr...@spark.apache.org<mailto:dev-unsubscr...@spark.apache.org>
