Re: Spark SQL parser bug?

[Cheng Lian]

Hmm, there is a “T” in the timestamp string, which makes the string not 
a valid timestamp string representation. Internally Spark SQL uses 
|java.sql.Timestamp.valueOf| to cast a string to a timestamp.

On 10/11/14 2:08 AM, Mohammed Guller wrote:
scala> rdd.registerTempTable("x")

scala> val sRdd = sqlContext.sql("select a from x where ts >= 
'2012-01-01*T*00:00:00';")

sRdd: org.apache.spark.sql.SchemaRDD =

SchemaRDD[4] at RDD at SchemaRDD.scala:103

== Query Plan ==

== Physical Plan ==

Project [a#0]

ExistingRdd [a#0,ts#1], MapPartitionsRDD[6] at mapPartitions at 
basicOperators.scala:208

scala> sRdd.collect

res2: Array[org.apache.spark.sql.Row] = Array()

​