[
https://issues.apache.org/jira/browse/SPARK-53355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-53355.
----------------------------------
Fix Version/s: 4.1.0
Resolution: Fixed
Issue resolved by pull request 52105
[https://github.com/apache/spark/pull/52105]
> Capture input / output type behavior of pyspark udfs
> ------------------------------------------------------
>
> Key: SPARK-53355
> URL: https://issues.apache.org/jira/browse/SPARK-53355
> Project: Spark
> Issue Type: Task
> Components: PySpark
> Affects Versions: 4.1.0
> Reporter: Ben Hurdelhey
> Assignee: Ben Hurdelhey
> Priority: Major
> Labels: pull-request-available
> Fix For: 4.1.0
>
>
> * add pandas_udf coverage script from
> [https://github.com/apache/spark/pull/51635] and link where appropriate. We
> already have one for python udfs in type_coercion_udf.py
> ([https://issues.apache.org/jira/projects/SPARK/issues/SPARK-52952?filter=allissues])
> * consider automatically running these in CI and comparing their results to
> stored files to catch
> * consider adding more tests/tables for how input types get converted to
> python types
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
