Thanks Akhil.
So the worker spark node doesn't need access to metastore to run Hive
queries? If yes, which component accesses the metastore?
For Hive, the Hive-cli accesses the metastore before submitting M/R jobs.
Thanks,
Ken
--
View this message in context:
http://apache-spark-user-list.1
Hi Ken,
AFAIK, you can specify the following in the spark-env.sh file across the
cluster
export HIVE_HOME=/path/to/hive/
export HIVE_CONF_DIR=/path/to/hive/conf/
And it is not necessary for the worker node to have access to the hive's
metastore dir.
--
View this message in co
