Re: scala.MatchError on SparkSQL when creating ArrayType of StructType

2014-12-08 Thread Yin Huai
Seems you hit https://issues.apache.org/jira/browse/SPARK-4245. It was fixed in 1.2. Thanks, Yin On Wed, Dec 3, 2014 at 11:50 AM, invkrh wrote: > Hi, > > I am using SparkSQL on 1.1.0 branch. > > The following code leads to a scala.MatchError > at > > org.apache.spark.sql.catalyst.expressions.C

scala.MatchError on SparkSQL when creating ArrayType of StructType

2014-12-04 Thread invkrh
Hi, I am using SparkSQL on 1.1.0 branch. The following code leads to a scala.MatchError at org.apache.spark.sql.catalyst.expressions.Cast.cast$lzycompute(Cast.scala:247) val scm = StructType(*inputRDD*.schema.fields.init :+ StructField("list", ArrayType( StructType(