Craiu Constantin-Tiberiu created SPARK-59762:
------------------------------------------------
Summary: Release Python UDF init message before processing rows
Key: SPARK-59762
URL: https://issues.apache.org/jira/browse/SPARK-59762
Project: Spark
Issue Type: Improvement
Components: PySpark
Affects Versions: 4.3.0
Reporter: Craiu Constantin-Tiberiu
Init message should be released in Python UDF to avoid memory usage increase
from extra storage of closure.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]