Re: jsonRdd and MapType

2014-11-07 Thread Yin Huai
ing > ||-- value: string (valueContainsNull = false) > > schemaRddSt.collect > *** Failure *** > scala.MatchError: MapType(StringType,StringType,false) (of class > org.apache.spark.sql.catalyst.types.MapType) > at > org.apache.spark.sql.json.JsonRDD$.enforceCorre

jsonRdd and MapType

2014-11-07 Thread boclair
park.sql.catalyst.types.MapType) at org.apache.spark.sql.json.JsonRDD$.enforceCorrectType(JsonRDD.scala:397) ... The schema of the schemaRDD is correct. But it seems that the json cannot be coerced to a MapType. I can see at the line in the stack trace that there is no case stat