Re: My I report a special comparaison of executions leading on issues on Spark JIRA ?

2020-10-02 Thread Marc Le Bihan
Yes. As I explained at the beginning of the message. For com/fasterxml/jackson/module/scala/ScalaObjectMapper missing I will check myself with spark-core and spark-sql become unable to load this dependency But I see nothing in Spark Migration Guide 2.4.6 to 3.0 explaining the apparition of this m

Re: My I report a special comparaison of executions leading on issues on Spark JIRA ?

2020-10-02 Thread Sean Owen
I am not sure what tests you are referring to. Your own? They may indeed have to be changed to work with Spark 3. All Spark tests pass in Spark 3 though. No, until you can clarify I do not see something to report in JIRA. On Fri, Oct 2, 2020, 3:07 PM Marc Le Bihan wrote: > Few tests (that are w

Re: My I report a special comparaison of executions leading on issues on Spark JIRA ?

2020-10-02 Thread Marc Le Bihan
Few tests (that are working on 2.4.6 and 2.4.7) are failling in 3.0.1 Some with this message : *java.lang.ClassNotFoundException: com/fasterxml/jackson/module/scala/ScalaObjectMapper* Coming from : at org.apache.spark.sql.catalyst.util.RebaseDateTime.lastSwitchJulianDay(RebaseDateTime.sc

Re: Spark 3.1 first RC date

2020-10-02 Thread Dongjoon Hyun
Hi, Igor. The first RC is scheduled for early December . Please see the website for Apache Spark release cadence. - https://spark.apache.org/versioning-policy.html Date Event Early Nov 2020 Code freeze. Release branch cut. Mid Nov 2020QA period. Focus on bug fixes, tests, stability and doc