Re: Scala 3 support approach

2021-12-03 Thread Sean Owen
I don't think anyone's tested it or tried it, but if it's pretty compatible with 2.13, it may already work, or mostly. See my answer below, which still stands: if it's not pretty compatible with 2.13 and needs a new build, this effectively means dropping 2.12 support, as supporting 3 Scala version

Re: Scala 3 support approach

2020-10-18 Thread Dongjoon Hyun
Hi, Koert. We know, welcome, and believe it. However, it's only Scala community's roadmap so far. It doesn't mean Apache Spark supports Scala 3 officially. For example, Apache Spark 3.0.1 supports Scala 2.12.10 but not 2.12.12 due to Scala issue. In Apache Spark community, we had better focus on

Re: Scala 3 support approach

2020-10-18 Thread Koert Kuipers
i think scala 3.0 will be able to use libraries built with Scala 2.13 (as long as they dont use macros) see: https://www.scala-lang.org/2019/12/18/road-to-scala-3.html On Sun, Oct 18, 2020 at 9:54 AM Sean Owen wrote: > Spark depends on a number of Scala libraries, so needs them all to support >

Re: Scala 3 support approach

2020-10-18 Thread Dongjoon Hyun
Hi, Denis We are currently moving toward Scala 3 together by focusing on completion SPARK-25075 first as a stepping stone. https://issues.apache.org/jira/browse/SPARK-25075 Build and test Spark against Scala 2.13 We didn't finish it yet. We need to have Jenkins jobs with Scala 2.13. Also

Re: Scala 3 support approach

2020-10-18 Thread gemelen
Thanks for the input, Sean. > Spark depends on a number of Scala libraries, so needs them all to support > version X before Spark can. This only happened for 2.13 about 4-5 months > ago. I wonder if even a fraction of the necessary libraries have 3.0 > support yet? As far as I understand, here sh

Re: Scala 3 support approach

2020-10-18 Thread Sean Owen
Spark depends on a number of Scala libraries, so needs them all to support version X before Spark can. This only happened for 2.13 about 4-5 months ago. I wonder if even a fraction of the necessary libraries have 3.0 support yet? It can be difficult to test and support multiple Scala versions simu

Re: Scala 3 support approach

2020-10-18 Thread gemelen
Sorry for the noise. Please reply to this one. -- Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/ - To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Scala 3 support approach

2020-10-17 Thread Denis Pyshev
Hi all! I'd like to ask for an opinion and discuss the next thing: at this moment in general Spark could be built with Scala 2.11 and 2.12 (mostly), and close to the point to have support for Scala 2.13. On the other hand, Scala 3 is going into pre-release phase (with 3.0.0-M1 released at the begi

Scala 3 support approach

2020-10-17 Thread Denis Pyshev
Hi all! I'd like to ask for an opinion and discuss the next thing: at this moment in general Spark could be built with Scala 2.11 and 2.12 (mostly), and close to the point to have support for Scala 2.13. On the other hand, Scala 3 is going into the pre-release phase (with 3.0.0-M1 released at the

Scala 3 support approach

2020-10-17 Thread gemelen
Hi all! I'd like to ask for an opinion and discuss the next thing: at this moment in general Spark could be built with Scala 2.11 and 2.12 (mostly), and close to the point to have support for Scala 2.13. On the other hand, Scala 3 is going into the pre-release phase (with 3.0.0-M1 released at the