Hi. I’m trying to use Hive warehouse connector with Livy Interpreter. To do that, I must set the spark.sql.extention property before the spark context creation. How to do that using Livy Interpreter ?
My 1st paragraph is : %livy.conf livy.spark.jars file:///opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hive_warehouse_connector/hive-warehouse-connector-assembly-1.0.0.7.1.3.0-100.jar <file:///opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hive_warehouse_connector/hive-warehouse-connector-assembly-1.0.0.7.1.3.0-100.jar> I’e tried : 1) livy.spark.conf spark.sql.extention com.qubole.spark.hiveacid.HiveAcidAutoConvertExtension 2) spark.conf spark.sql.extention com.qubole.spark.hiveacid.HiveAcidAutoConvertExtension But they didn’t work. Set this property on the spark-default affects all other applications and notebook that does not use Hive warehouse connector.
