Re: Error: at sqlContext.createDataFrame with RDD and Schema

2016-12-28 Thread Liang-Chi Hsieh
Your schema is all fields are string: > val stdSchema= StructType(stdSchemaString.split(",").map(fieldName => > StructField(fieldName, StringType, true))) But looks like you have integer columns in the RDD? Chetan Khatri wrote > Resolved above error by creating SparkSession > > val spark = Sp

Re: Error: at sqlContext.createDataFrame with RDD and Schema

2016-12-28 Thread Chetan Khatri
Resolved above error by creating SparkSession val spark = SparkSession.builder().appName("Hbase - Spark POC").getOrCreate() Error after: spark.sql("SELECT * FROM student").show() But while doing show() action on Dataframe throws below error: scala> sqlContext.sql("select * from student").show(