RE: spark sql: timestamp in json - fails

2014-10-20 Thread Wang, Daoyuan
Subject: RE: spark sql: timestamp in json - fails Spark 1.1.0 -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/spark-sql-timestamp-in-json-fails-tp16864p16888.html Sent from the Apache Spark User List mailing list archive at Nabble.com

RE: spark sql: timestamp in json - fails

2014-10-20 Thread Wang, Daoyuan
The exception of second approach, has been resolved by SPARK-3853. Thanks, Daoyuan -Original Message- From: Wang, Daoyuan [mailto:daoyuan.w...@intel.com] Sent: Tuesday, October 21, 2014 11:06 AM To: tridib; u...@spark.incubator.apache.org Subject: RE: spark sql: timestamp in json

RE: spark sql: timestamp in json - fails

2014-10-20 Thread tridib
Spark 1.1.0 -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/spark-sql-timestamp-in-json-fails-tp16864p16888.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - T

RE: spark sql: timestamp in json - fails

2014-10-20 Thread Wang, Daoyuan
spark sql: timestamp in json - fails Stack trace for my second case: 2014-10-20 23:00:36,903 ERROR [Executor task launch worker-0] executor.Executor (Logging.scala:logError(96)) - Exception in task 0.0 in stage 0.0 (TID 0) scala.MatchError: TimestampType (of

Re: spark sql: timestamp in json - fails

2014-10-20 Thread tridib
Stack trace for my second case: 2014-10-20 23:00:36,903 ERROR [Executor task launch worker-0] executor.Executor (Logging.scala:logError(96)) - Exception in task 0.0 in stage 0.0 (TID 0) scala.MatchError: TimestampType (of class org.apache.spark.sql.catalyst.types.TimestampType$) at org.ap

RE: spark sql: timestamp in json - fails

2014-10-20 Thread Wang, Daoyuan
Seems I made a mistake… From: Wang, Daoyuan Sent: Tuesday, October 21, 2014 10:35 AM To: 'Yin Huai' Cc: Michael Armbrust; tridib; u...@spark.incubator.apache.org Subject: RE: spark sql: timestamp in json - fails I got that, it is in JsonRDD.java of `typeOfPrimitiveValues`. I’l

RE: spark sql: timestamp in json - fails

2014-10-20 Thread Wang, Daoyuan
: tridib; u...@spark.incubator.apache.org<mailto:u...@spark.incubator.apache.org> Subject: Re: spark sql: timestamp in json - fails Hi Tridib, For the second approach, can you attach the complete stack trace? Thanks, Yin On Mon, Oct 20, 2014 at 8:24 PM, Michael Armbrust mailto:mich...@databricks.co

Re: spark sql: timestamp in json - fails

2014-10-20 Thread Yin Huai
ark.incubator.apache.org > *Subject:* Re: spark sql: timestamp in json - fails > > > > Hi Tridib, > > > > For the second approach, can you attach the complete stack trace? > > > > Thanks, > > > > Yin > > > > On Mon, Oct 20, 2014 at

RE: spark sql: timestamp in json - fails

2014-10-20 Thread Wang, Daoyuan
: tridib; u...@spark.incubator.apache.org Subject: Re: spark sql: timestamp in json - fails Hi Tridib, For the second approach, can you attach the complete stack trace? Thanks, Yin On Mon, Oct 20, 2014 at 8:24 PM, Michael Armbrust mailto:mich...@databricks.com>> wrote: I think you are r

Re: spark sql: timestamp in json - fails

2014-10-20 Thread Yin Huai
Hi Tridib, For the second approach, can you attach the complete stack trace? Thanks, Yin On Mon, Oct 20, 2014 at 8:24 PM, Michael Armbrust wrote: > I think you are running into a bug that will be fixed by this PR: > https://github.com/apache/spark/pull/2850 > > On Mon, Oct 20, 2014 at 4:34 PM

Re: spark sql: timestamp in json - fails

2014-10-20 Thread Michael Armbrust
I think you are running into a bug that will be fixed by this PR: https://github.com/apache/spark/pull/2850 On Mon, Oct 20, 2014 at 4:34 PM, tridib wrote: > Hello Experts, > After repeated attempt I am unable to run query on map json date string. I > tried two approaches: > > *** Approach 1 ***