RE: spark sql: timestamp in json - fails

2014-10-20 Thread Wang, Daoyuan
Subject: RE: spark sql: timestamp in json - fails Spark 1.1.0 -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/spark-sql-timestamp-in-json-fails-tp16864p16888.html Sent from the Apache Spark User List mailing list archive at Nabble.com

RE: spark sql: timestamp in json - fails

2014-10-20 Thread Wang, Daoyuan
ge in context: http://apache-spark-user-list.1001560.n3.nabble.com/spark-sql-timestamp-in-json-fails-tp16864p16884.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-uns

RE: spark sql: timestamp in json - fails

2014-10-20 Thread tridib
Spark 1.1.0 -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/spark-sql-timestamp-in-json-fails-tp16864p16888.html Sent from the Apache Spark User List mailing list archive at Nabble.com

RE: spark sql: timestamp in json - fails

2014-10-20 Thread Wang, Daoyuan
ge in context: http://apache-spark-user-list.1001560.n3.nabble.com/spark-sql-timestamp-in-json-fails-tp16864p16884.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-uns

Re: spark sql: timestamp in json - fails

2014-10-20 Thread tridib
.1001560.n3.nabble.com/spark-sql-timestamp-in-json-fails-tp16864p16884.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands

RE: spark sql: timestamp in json - fails

2014-10-20 Thread Wang, Daoyuan
Seems I made a mistake… From: Wang, Daoyuan Sent: Tuesday, October 21, 2014 10:35 AM To: 'Yin Huai' Cc: Michael Armbrust; tridib; u...@spark.incubator.apache.org Subject: RE: spark sql: timestamp in json - fails I got that, it is in JsonRDD.java of `typeOfPrimitiveValues`. I’l

RE: spark sql: timestamp in json - fails

2014-10-20 Thread Wang, Daoyuan
: tridib; u...@spark.incubator.apache.org<mailto:u...@spark.incubator.apache.org> Subject: Re: spark sql: timestamp in json - fails Hi Tridib, For the second approach, can you attach the complete stack trace? Thanks, Yin On Mon, Oct 20, 2014 at 8:24 PM, Michael Armbrust mailto:mich...@databricks.co

Re: spark sql: timestamp in json - fails

2014-10-20 Thread Yin Huai
id testJsonStruct(SparkContext sc) { > JavaSQLContext sqlCtx = getSqlCtx(getCtx(sc)); > String path = "/hdd/spark/test.json"; > JavaSchemaRDD test = sqlCtx.jsonFile(path, createStructType()); > sqlCtx.registerRDDAsTable(test, "test"); >

RE: spark sql: timestamp in json - fails

2014-10-20 Thread Wang, Daoyuan
: tridib; u...@spark.incubator.apache.org Subject: Re: spark sql: timestamp in json - fails Hi Tridib, For the second approach, can you attach the complete stack trace? Thanks, Yin On Mon, Oct 20, 2014 at 8:24 PM, Michael Armbrust mailto:mich...@databricks.com>> wrote: I think you are r

Re: spark sql: timestamp in json - fails

2014-10-20 Thread Yin Huai
public void testJsonStruct(SparkContext sc) { >> JavaSQLContext sqlCtx = getSqlCtx(getCtx(sc)); >> String path = "/hdd/spark/test.json"; >> JavaSchemaRDD test = sqlCtx.jsonFile(path, createStructType()); >> sqlCtx.registerRDDAsTable(test, "test&q

Re: spark sql: timestamp in json - fails

2014-10-20 Thread Michael Armbrust
> JavaSQLContext sqlCtx = getSqlCtx(getCtx(sc)); > String path = "/hdd/spark/test.json"; > JavaSchemaRDD test = sqlCtx.jsonFile(path, createStructType()); > sqlCtx.registerRDDAsTable(test, "test"); > execSql(sqlCtx, "select * from test", 1); >

spark sql: timestamp in json - fails

2014-10-20 Thread tridib
nks Tridib -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/spark-sql-timestamp-in-json-fails-tp16864.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsu