I was trying to enable CBO on one of our jobs (using Spark 2.3.1 with partitioned parquet data) but it seemed that the rowCount statistics were being ignored. I found this JIRA which seems to describe the same issue: https://issues.apache.org/jira/browse/SPARK-25185, but it has no response so far.
Does CBO work with partitioned parquet data, or is this a known issue? Is there a workaround? Thanks, Emlyn -- Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/ --------------------------------------------------------------------- To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
