Spark version is 3.2.2
I want to observe row count before write to jdbc using observation:
ds.observe("stepName", F.count(F.lit(1)).as("_rc"))
And I add QueryExecutionListener to my spark session. code like :
val metrics = qe.observedMetrics
> logInfo(s"Function $funcName success. Try send me
I am trying to use Spark 3.5.3 in an old CDH cluster. The previous version
on this CDH cluster of Spark was 3.3.2.
When I submit a task to Yarn, netty prompts a conversion error:
Caused by: java.lang.ClassCastException:
> io.netty.util.Recycler$DefaultHandle cannot be cast to
> io.netty.util.Recy
