I opened https://github.com/apache/spark/pull/31461 to track the discussion
further. It narrowly proposes making a few types public.
On Mon, Feb 1, 2021 at 8:52 AM Fitch, Simeon wrote:
> š
>
> On Mon, Feb 1, 2021 at 9:38 AM Sean Owen wrote:
>
>> I'm not hearing any objection to making it public
SendingĀ https://github.com/apache/spark/pull/31460Based my research so far, when there isĀ there is an existingio.file.buffer.sizeĀ in hive-site.xml, the hadoopConf finallly get reset by that.Ā In many real-world cases, when interacting with hive catalog through Spark SQL,
Hi,
FYI, I have been using the project at
https://github.com/chermenin/spark-states
for a few months and it has been working well for me.
-Nico
--
Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/
-
To un
+1 for this work!
I agree with some clarifications below:
SQL is a somewhat different case. There are functions that aren't _that_ useful
in general, kind of niche, but nevertheless exist in other SQL systems, most
notably Hive. It's useful to try to expand SQL support to cover those to ease
mig
