Jerry Su created SPARK-60163:
--------------------------------
Summary: Remove type: ignore[no-untyped-def] in pyspark.sql
Key: SPARK-60163
URL: https://issues.apache.org/jira/browse/SPARK-60163
Project: Spark
Issue Type: Improvement
Components: PySpark
Affects Versions: 4.4.0
Reporter: Jerry Su
Add type annotations to four internal functions in pyspark.sql and remove the
corresponding "# type: ignore[no-untyped-def]" comments, so that mypy checks
their bodies:
- check_string_field in pyspark/sql/functions/builtin.py (window)
- infer_eval_type_for_udf in pyspark/sql/pandas/typehints.py
- process in pyspark/sql/connect/streaming/worker/foreach_batch_worker.py
- process in pyspark/sql/connect/streaming/worker/listener_worker.py
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
