Re: Schema evolution in tables

2017-01-13 Thread sim
There is not automated solution right now. You have to issue manual ALTER TABLE commands, which works for adding top-level columns but gets tricky if you are adding a field in a deeply nested struct. Hopefully, the issue will be fixed in 2.2 because work has started on https://issues.apache.org/ji

Re: Schema evolution in tables

2015-08-03 Thread Brandon White
Sim did you find anything? :) On Sun, Jul 26, 2015 at 9:31 AM, sim wrote: > The schema merging > > section of the Spark SQL documentation shows an example of schema evolution > in a partitioned table. > > Is this fun