Re: Issues with Delta Lake on 3.0.0 preview + preview 2

2019-12-30 Thread Burak Yavuz
I can't imagine any Spark data source using Spark internals compiled on Spark 2.4 working on 3.0 out of the box. There are many braking changes. I'll try to get a *dev* branch for 3.0 soon (mid Jan). Best, Burak On Mon, Dec 30, 2019, 8:53 AM Jean-Georges Perrin wrote: > Hi there, > > Trying to

Re: Issues with Delta Lake on 3.0.0 preview + preview 2

2019-12-30 Thread Sean Owen
It looks like delta calls org.apache.spark.Utils, which is technically a private class in Spark. The signature of Utils.classForName changed (in the bytecode) to take two more params. Either delta would have to cross-compile for Spark 2 vs 3, or, needs to avoid calling Utils, or we can add a small