Hi Doug,
Spark-5111 is to make spark work with security hadoop cluster in 2.6. There is
some compatibility issue which need the fix Spark-5111 patch.
In insecure cluster, current spark can connect to hive-0.14 without problems.
By the way, I am really glad to hear that "an adaption layer in Spar
Is there a JIRA for this adaption layer ? It sounds like a better long term
solution.
If anybody knows what is require to get the current Shim layer working with
Hive 0.14, please post what you know.
I’m willing to spend some time on it, but I’m still learning how things fit
together and it mig
We're planning to replace the current Hive version profiles and shim
layer with an adaption layer in Spark SQL in 1.4. This adaption layer
allows Spark SQL to connect to arbitrary Hive version greater than or
equal to 0.12.0 (or maybe 0.13.1, not decided yet).
However, it's not a promise yet,
Hi,
I'm just wondering if anybody is working on supporting Hive 0.14 in secure
mode on hadoop 2.6.0 ?
I see once Jira referring to it
https://issues.apache.org/jira/browse/SPARK-5111
but it mentions no effort to move to 0.14.
Thanks,
Doug
-
