943)\n\tat
scala.collection.Iterator.foreach$(Iterator.scala:943)\n\tat
scala.collection.AbstractIterator.foreach(Iterator.scala:1431)\n\tat
scala.collection.TraversableOnce.foldLeft(TraversableOnce.scala:199)\n\tat
scala.collect...
From: "Sharma, Anup"
Date: Tuesday, February 20, 2024
Hi Spark team,
We ran into a dataframe issue after upgrading from spark 3.1 to 4.
query_result.explain(extended=True)\n File
\"…/spark/python/lib/pyspark.zip/pyspark/sql/dataframe.py\"
raise Py4JJavaError(\npy4j.protocol.Py4JJavaError: An error occurred while
calling z:org.apache.spark.sql.ap
