Re: DataFrame cannot find temporary table

2016-05-09 Thread Takeshi Yamamuro
Hi, What's `convertRDDToDF`? Seems you use different `SQLContext` between table registration and querying. //maropu On Tue, May 10, 2016 at 2:46 AM, Mich Talebzadeh wrote: > Have you created sqlContext based on HiveContext? > > > val sc = new SparkContext(conf) > // Create sqlContext base

Re: DataFrame cannot find temporary table

2016-05-09 Thread Mich Talebzadeh
Have you created sqlContext based on HiveContext? val sc = new SparkContext(conf) // Create sqlContext based on HiveContext val sqlContext = new HiveContext(sc) import sqlContext.implicits._ df.registerTempTable("person") ... Dr Mich Talebzadeh LinkedIn * https://ww

DataFrame cannot find temporary table

2016-05-09 Thread KhajaAsmath Mohammed
Hi, I have created dataframe with below code and I was able to print the schema but unfortuntely cannot pull the data from the temporary table. It always says that table is not found val df=convertRDDToDF(records, mapper, errorRecords, sparkContext); import sqlContext._ df.printSchema