Re: Spark SQL cannot tolerate regexp with BIGINT

Actually I'm doing some cleanups related to type coercion, and I will take care of this. On Wed, Apr 29, 2015 at 5:10 PM, lonely Feb wrote: > OK, I'll try. > On Apr 30, 2015 06:54, "Reynold Xin" wrote: > >> We added ExpectedInputConversion rule recently in analysis: >> https://github.com/apach

Re: Spark SQL cannot tolerate regexp with BIGINT

OK, I'll try. On Apr 30, 2015 06:54, "Reynold Xin" wrote: > We added ExpectedInputConversion rule recently in analysis: > https://github.com/apache/spark/blob/master/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/HiveTypeCoercion.scala#L647 > > With this rule, the analyzer aut

Re: Spark SQL cannot tolerate regexp with BIGINT

We added ExpectedInputConversion rule recently in analysis: https://github.com/apache/spark/blob/master/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/HiveTypeCoercion.scala#L647 With this rule, the analyzer automatically adds cast for expressions that inherit ExpectsInputTypes

Re: Spark SQL cannot tolerate regexp with BIGINT

I guess you can use cast(id as String) instead of just id in your where clause ? Le mer. 29 avr. 2015 à 12:13, lonely Feb a écrit : > Hi all, we are transfer our HIVE job into SparkSQL, but we found a litter > difference between HIVE and Spark SQL that our sql has a statement like: > > select A