Re: Custom Data Source for getting data from Rest based services

@sathich Here are my thoughts on your points - 1. Yes this should be able to handle any complex json structure returned by the target rest API. Essentially what it would be returning is Rows of that complex structure. Then one can use Spark SQL to further flatten it using the functions like inlin

Spark SQL is not able to connect to hive metastore

HI, I'm trying to execute simple sql statement from spark-shell val sqlContext = new org.apache.spark.sql.hive.HiveContext(sc) - This one executes properly. Next I'm trying - sqlContext.sql("CREATE TABLE IF NOT EXISTS src (key INT, value STRING)") This keeps on trying to connect Metastore but c

Using Spark SQL in Spark1.2.1 with Hive 0.14

Hi, I'm trying to execute queries from beeline to Hive 0.14 from Spark SQL (1.2.1). A simple query like 'show tables' or 'create schema ' doe not return back at all. Do I need to update to Spark 1.3 for this to work with 0.14 ? Is there any other alternatives ? Regards, Sourav -- View this m