andygrove commented on issue #1127: URL: https://github.com/apache/datafusion-comet/issues/1127#issuecomment-2578652346
Here is my repro. ## Comet 0.3.0 ``` scala> spark.read.parquet("/mnt/bigdata/tpch/sf100/lineitem.parquet").createTempView("lineitem") 25/01/08 13:56:35 INFO core/src/lib.rs: Comet native library version 0.3.0 initialized 25/01/08 13:56:35 WARN CometSparkSessionExtensions$CometExecRule: Comet cannot execute some parts of this plan natively (set spark.comet.explainFallback.enabled=false to disable this logging): Execute CreateViewCommand [COMET: Execute CreateViewCommand is not supported] +- CreateViewCommand +- LogicalRelation scala> spark.sql("select cast(l_shipmode as decimal(12,2)) from lineitem").show 25/01/08 13:56:40 WARN CometSparkSessionExtensions$CometExecRule: Comet cannot execute some parts of this plan natively (set spark.comet.explainFallback.enabled=false to disable this logging): CollectLimit [COMET: CollectLimit is not supported] +- Project [COMET: Comet does not guarantee correct results for cast from StringType to DecimalType(12,2) with timezone Some(America/Denver) and evalMode LEGACY (Does not support inputs ending with 'd' or 'f'. Does not support 'inf'. Does not support ANSI mode. Returns 0.0 instead of null if input contains no digits). To enable all incompatible casts, set spark.comet.cast.allowIncompatible=true] +- CometScanWrapper +----------+ |l_shipmode| +----------+ | null| | null| | null| | null| | null| | null| | null| | null| | null| | null| | null| | null| | null| | null| | null| | null| | null| | null| | null| | null| +----------+ only showing top 20 rows ``` ## Comet 0.4.0 ``` scala> spark.read.parquet("/mnt/bigdata/tpch/sf100/lineitem.parquet").createTempView("lineitem") 25/01/08 13:57:31 INFO core/src/lib.rs: Comet native library version 0.4.0 initialized scala> spark.sql("select cast(l_shipmode as decimal(12,2)) from lineitem").show +----------+ |l_shipmode| +----------+ | null| | null| | null| | null| | null| | null| | null| | null| | null| | null| | null| | null| | null| | null| | null| | null| | null| | null| | null| | null| +----------+ only showing top 20 rows ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org