Dmitry created SPARK-51608: ------------------------------ Summary: Better log exception in python udf worker. Key: SPARK-51608 URL: https://issues.apache.org/jira/browse/SPARK-51608 Project: Spark Issue Type: Improvement Components: PySpark Affects Versions: 4.0.0 Reporter: Dmitry
It was possible to see the error in the logs: {{24/12/27 20:25:04 WARN PythonUDFWithNamedArgumentsRunner: Failed to stop worker}} However, it does not reaveal what exactely happened. It really makes sense to include exception information to the logs. -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org