[ https://issues.apache.org/jira/browse/SPARK-60148 ]
Nicolas Lu deleted comment on SPARK-60148:
------------------------------------
was (Author: JIRAUSER314057):
I'm working on this and will open a PR shortly
> Add unit tests for pyspark.traceback_utils
> ------------------------------------------
>
> Key: SPARK-60148
> URL: https://issues.apache.org/jira/browse/SPARK-60148
> Project: Spark
> Issue Type: Test
> Components: PySpark
> Affects Versions: 4.4.0
> Reporter: Nicolas Lu
> Priority: Minor
> Labels: pull-request-available
>
> {{pyspark/traceback_utils.py}} has no dedicated unit tests. It is only
> exercised indirectly through RDD and DataFrame actions
> ({{{}core/context.py{}}}, {{{}core/rdd.py{}}},
> {{{}sql/classic/dataframe.py{}}}), so several branches are never checked
> directly.
> This ticket adds {{python/pyspark/tests/test_traceback_utils.py}} and
> registers it in {{{}dev/sparktestsupport/modules.py{}}}. It covers:
> * {{{}first_spark_call(){}}}: empty stack returns {{{}None{}}}; returns the
> user's file and line for the first Spark frame; only the first Spark frame is
> used; Spark frame at the bottom of the stack.
> * {{{}SCCallSiteSync{}}}: sets and clears the call site; fallback message
> when the call site is unknown; nested usage sets the call site only at the
> outermost level; the call site is cleared when the block raises.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
