Any thoughts.. Please
On Fri, May 10, 2019 at 2:22 AM Chetan Khatri
wrote:
> Hello All,
>
> I need your help / suggestions,
>
> I am using Spark 2.3.1 with HDP 2.6.1 Distribution, I will tell my use
> case so you get it where people are trying to use Delta.
> My use case is I have source as a MS
Yea my main point is when we do support 2.13, it'd be great if we don't have to
break APIs. That's why doing the prep work in 3.0 would be great.
On Fri, May 10, 2019 at 1:30 PM, Imran Rashid < iras...@cloudera.com > wrote:
>
> +1 on making whatever api changes we can now for 3.0.
>
>
> I don
+1 on making whatever api changes we can now for 3.0.
I don't think that is making any commitments to supporting scala 2.13 in
any specific version. We'll have to deal with all the other points you
raised when we do cross that bridge, but hopefully those are things we can
cover in a minor release
I really hope we don't have to have separate source trees for some files,
but yeah it's an option too. OK, will start looking into changes we can
make now that don't break things now, and deprecations we need to make now
proactively.
I should also say that supporting Scala 2.13 will mean dependenc
Looks like a great idea to make changes in Spark 3.0 to prepare for Scala 2.13
upgrade.
Are there breaking changes that would require us to have two different source
code for 2.12 vs 2.13?
On Fri, May 10, 2019 at 11:41 AM, Sean Owen < sro...@gmail.com > wrote:
>
>
>
> While that's not happe
While that's not happening soon (2.13 isn't out), note that some of
the changes to collections will be fairly breaking changes.
https://issues.apache.org/jira/browse/SPARK-25075
https://docs.scala-lang.org/overviews/core/collections-migration-213.html
Some of this may impact a public API, so may
Any idea on when Spark 3.0.0 is to come, and its roadmap?
I am particularly awaiting this feature:
https://issues.apache.org/jira/browse/SPARK-25994
thanks,
-soma
On Thu, May 9, 2019 at 12:27 PM Xiao Li wrote:
> We are happy to announce the availability of Spark 2.4.3!
>
> Spark 2.4.3 is a main
