Re: Spark with Hive (Standalone) Metastore

2022-07-04 Thread Qian SUN
Hi, Setting the hive configuration to *spark.hive.xxx* should take effect. Could you share your configuration? https://github.com/apache/spark/blob/648457905c4ea7d00e3d88048c63f360045f0714/core/src/main/scala/org/apache/spark/deploy/SparkHadoopUtil.scala#L108-L115 And metastore client initializati

Spark with Hive (Standalone) Metastore

2022-07-04 Thread Ankur Khanna
Hi, I am using spark-shell/spark-sql with Hive Metastore (running as a standalone process). I am facing a problem where the custom conf I pass while starting spark-shell (using –conf) is not being passed-on to the metastore with the session. I’ll appreciate help on how to get the properties pa