Why separate SessionStateBuilder? (it's BaseSessionStateBuilder)

2017-04-23 Thread Jacek Laskowski
Hi, While reviewing SessionStateBuilder [1] I came to conclusion that it's a kind of a leftover and should really be removed since it's BaseSessionStateBuilder [2]. What I'm proposing is to remove SessionStateBuilder followed by renaming BaseSessionStateBuilder to SessionStateBuilder. That will

Re: [VOTE] Apache Spark 2.1.1 (RC3)

2017-04-23 Thread Holden Karau
Whats the regression this fixed in 2.1 from 2.0? On Fri, Apr 21, 2017 at 7:45 PM, Wenchen Fan wrote: > IIRC, the new "spark.sql.hive.caseSensitiveInferenceMode" stuff will only > scan all table files only once, and write back the inferred schema to > metastore so that we don't need to do the sch