李易庭 created SPARK-60165:
---------------------------
Summary: Remove type: ignore by fixing type annotations in Spark
Connect
Key: SPARK-60165
URL: https://issues.apache.org/jira/browse/SPARK-60165
Project: Spark
Issue Type: Improvement
Components: PySpark, Connect
Affects Versions: 4.4.0
Reporter: 李易庭
Several "# type: ignore" comments in Spark Connect exist only because of
imprecise type annotations:
* pyspark.sql.connect.session.SparkSession.createDataFrame,
pyspark.sql.connect.dataframe.DataFrame.randomSplit and
pyspark.sql.connect.tvf.TableValuedFunction.range: a value typed as the parent
pyspark.sql.DataFrame is assigned to, or returned as, the Spark Connect
DataFrame.
* pyspark.errors.exceptions.connect._convert_exception: the local variable
contexts is initialized to None without an annotation, so its inferred list
type does not match List[BaseQueryContext].
This fixes the annotations so these type: ignore comments can be removed. No
behavior change.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
