I can't imagine any Spark data source using Spark internals compiled on
Spark 2.4 working on 3.0 out of the box. There are many braking changes.
I'll try to get a *dev* branch for 3.0 soon (mid Jan).
Best,
Burak
On Mon, Dec 30, 2019, 8:53 AM Jean-Georges Perrin wrote:
> Hi there,
>
> Trying to
It looks like delta calls org.apache.spark.Utils, which is technically
a private class in Spark. The signature of Utils.classForName changed
(in the bytecode) to take two more params. Either delta would have to
cross-compile for Spark 2 vs 3, or, needs to avoid calling Utils, or
we can add a small