Hyukjin Kwon created SPARK-61161:
------------------------------------
Summary: Export the deprecated functions of
pyspark.sql.connect.functions, such as countDistinct and bitwiseNOT, as PySpark
does
Key: SPARK-61161
URL: https://issues.apache.org/jira/browse/SPARK-61161
Project: Spark
Issue Type: Bug
Components: Connect
Affects Versions: connect-rust-4.3.0
Reporter: Hyukjin Kwon
pyspark.sql.connect.functions re-exported only pyspark.sql.functions.__all__,
so countDistinct, sumDistinct, approxCountDistinct, chr, toDegrees, toRadians,
shiftLeft, shiftRight, shiftRightUnsigned, bitwiseNOT, random, uuid and
py_random were missing: "from pyspark.sql.connect.functions import
countDistinct" raised ImportError. PySpark's package star-imports its builtin
module, which has no __all__, so these names are there. The fix makes the
package star-import the builtin module, and the builtin module exposes
py_random.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
