Yicong Huang created SPARK-58067:
------------------------------------
Summary: Benchmark
SQL_TRANSFORM_WITH_STATE_PYTHON_ROW_INIT_STATE_UDF
Key: SPARK-58067
URL: https://issues.apache.org/jira/browse/SPARK-58067
Project: Spark
Issue Type: Sub-task
Components: PySpark
Affects Versions: 4.3.0
Reporter: Yicong Huang
Add an ASV microbenchmark for the
SQL_TRANSFORM_WITH_STATE_PYTHON_ROW_INIT_STATE_UDF eval type, mirroring the
existing SQL_TRANSFORM_WITH_STATE_PANDAS_INIT_STATE_UDF benchmark (SPARK-57704)
and the non-init Row benchmark (SPARK-57903). This measures the stateful
streaming transformation path that uses PySpark Row objects with an initial
state (TransformWithStateInPySparkRowInitStateSerializer), to guard against
regressions in the upcoming serializer refactor.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
