I am trying to integrate spark with hive on HDInsight spark cluster .
I copied hive-site.xml in spark/conf directory. In addition I added hive
metastore properties like jdbc connection info on Ambari as well. But still the
database and tables created using spark-sql are not visible in hive. Cha
Hello,
For one of our legacy workloads we use spark thriftserver to retrieve data
from Kafka. The pipeline is:
Oracle -- odbc --> Spark Thrift --> Kafka
Spark is doing some transformation like: avro deserialize, array explode,
etc, but no aggregation.
The main issue we face is that thrift sends d
