This was not intentional, here is a JIRA
https://issues.apache.org/jira/browse/SPARK-1364
Note that you can create big decimals by using the Decimal type in a
HiveContext.
Date is not yet a supported data type.
On Sun, Mar 30, 2014 at 5:35 PM, Manoj Samel wrote:
> Hi,
>
> Would the same issue
Hi,
Would the same issue be present for other Java type like Date ?
Converting the person/teenager example on Patricks page reproduces the
problem ...
Thanks,
scala> import scala.math
import scala.math
scala> case class Person(name: String, age: BigDecimal)
defined class Person
scala> val pe
Well, the error is coming from this case statement not matching on the
BigDecimal type:
https://github.com/apache/spark/blob/master/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/ScalaReflection.scala#L41
This seems to be a bug because there is a corresponding Catalyst DataType
for BigD
can I get the whole operation? then i can try to locate the error
smallmonkey...@hotmail.com
From: Manoj Samel
Date: 2014-03-31 01:16
To: user
Subject: SparkSQL "where" with BigDecimal type gives stacktrace
Hi,
If I do a where on BigDecimal, I get a stack trace. Changing BigDecimal to
Doub
