Hi All, I want to start a discussion thread on the SPIP titled "Upgrade Apache Hive to 4.x” [JIRA<https://issues.apache.org/jira/browse/SPARK-52408>][Doc<https://docs.google.com/document/d/1ejaGpuBvwBz2cD3Xj-QysShauBrdgYSh5yTxfAGvS1c/edit?usp=sharing>] that I was researching for some time now.
The SPIP proposes upgrading the Apache Hive version used in Apache Spark builds from 2.3.10 to version 4.x. It also proposes discontinuing support for Apache Hive 2.x and 3.x, as these versions are no longer maintained by the Apache Hive community and have reached end-of-life (EOL). The key objectives of this proposal are to: * Maintain all existing functionality currently supported in Apache Hive 2.x that is compatible with Apache Hive 4.x * Ensure no functional or performance regressions occur * Provide the best upgrade path for current Apache Spark users, minimizing prerequisites and manual steps for those using Hive 2.x or 3.x I'd greatly appreciate your feedback, thoughts, and suggestions on this proposal! Thank you, Vlad
