There are 2 SQL dialects, one is a very basic SQL support and another is Hive QL. In most of cases I think people prefer using the HQL, which also means you have to use HiveContext instead of the SQLContext.
In this particular query you showed, seems datatime is the type Date, unfortunately, neither of those SQL dialect supports Date, but Timestamp. Cheng Hao From: Benjamin Zaitlen [mailto:quasi...@gmail.com] Sent: Friday, September 05, 2014 5:37 AM To: user@spark.apache.org Subject: TimeStamp selection with SparkSQL I may have missed this but is it possible to select on datetime in a SparkSQL query jan1 = sqlContext.sql("SELECT * FROM Stocks WHERE datetime = '2014-01-01'") Additionally, is there a guide as to what SQL is valid? The guide says, "Note that Spark SQL currently uses a very basic SQL parser" It would be great to post what is currently supported. --Ben
