[
https://issues.apache.org/jira/browse/SPARK-19072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yin Huai resolved SPARK-19072.
------------------------------
Resolution: Fixed
Fix Version/s: 2.2.0
Issue resolved by pull request 16469
[https://github.com/apache/spark/pull/16469]
> Catalyst's IN always returns false for infinity
> -----------------------------------------------
>
> Key: SPARK-19072
> URL: https://issues.apache.org/jira/browse/SPARK-19072
> Project: Spark
> Issue Type: Bug
> Components: SQL, Tests
> Reporter: Kay Ousterhout
> Assignee: Wenchen Fan
> Fix For: 2.2.0
>
>
> This bug was caused by the fix for SPARK-18999
> (https://github.com/apache/spark/pull/16402)
> This can be reproduced by adding the following test to PredicateSuite.scala
> (which will consistently fail):
> val value = NonFoldableLiteral(Double.PositiveInfinity, DoubleType)
> checkEvaluation(In(value, List(value)), true)
> This bug is causing
> org.apache.spark.sql.catalyst.expressions.PredicateSuite.IN to fail
> approximately 10% of the time (it fails anytime the value is Infinity or
> -Infinity and the correct answer is True -- e.g.,
> https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70826/testReport/org.apache.spark.sql.catalyst.expressions/PredicateSuite/IN/,
>
> https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70830/console).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
