[jira] [Assigned] (SPARK-52980) Support Arrow Python UDTFs

2025-08-04 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang reassigned SPARK-52980: Assignee: Allison Wang > Support Arrow Python UDTFs > --- > >

[jira] [Resolved] (SPARK-52980) Support Arrow Python UDTFs

2025-08-04 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang resolved SPARK-52980. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51692 [https://gi

[jira] [Updated] (SPARK-53030) Support Arrow writer for streaming data sources

2025-07-30 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-53030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-53030: - Description: Support Arrow writer for streaming data sources similar to the batch writer: https:

[jira] [Created] (SPARK-53030) Support Arrow writer for streaming data sources

2025-07-30 Thread Allison Wang (Jira)
Allison Wang created SPARK-53030: Summary: Support Arrow writer for streaming data sources Key: SPARK-53030 URL: https://issues.apache.org/jira/browse/SPARK-53030 Project: Spark Issue Type: S

[jira] [Created] (SPARK-53029) Support return type coercion for Arrow Python UDTFs

2025-07-30 Thread Allison Wang (Jira)
Allison Wang created SPARK-53029: Summary: Support return type coercion for Arrow Python UDTFs Key: SPARK-53029 URL: https://issues.apache.org/jira/browse/SPARK-53029 Project: Spark Issue Typ

[jira] [Created] (SPARK-53012) Support Arrow Python UDTF in Spark Connect

2025-07-29 Thread Allison Wang (Jira)
Allison Wang created SPARK-53012: Summary: Support Arrow Python UDTF in Spark Connect Key: SPARK-53012 URL: https://issues.apache.org/jira/browse/SPARK-53012 Project: Spark Issue Type: Sub-ta

[jira] [Created] (SPARK-53009) Infer determinism of SQL UDFs

2025-07-29 Thread Allison Wang (Jira)
Allison Wang created SPARK-53009: Summary: Infer determinism of SQL UDFs Key: SPARK-53009 URL: https://issues.apache.org/jira/browse/SPARK-53009 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-53008) Derive SQL Data Access routine of SQL UDFs

2025-07-29 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-53008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-53008: - Description: Infer  Derive the SQL data access routine of the function and check if the SQL fu

[jira] [Updated] (SPARK-53008) Infer SQL Data Access routine of SQL UDFs

2025-07-29 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-53008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-53008: - Description: Derive the SQL data access routine of the function and check if the SQL function m

[jira] [Updated] (SPARK-53008) Infer SQL Data Access routine of SQL UDFs

2025-07-29 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-53008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-53008: - Summary: Infer SQL Data Access routine of SQL UDFs (was: Derive SQL Data Access routine of SQL

[jira] [Created] (SPARK-53008) Derive SQL Data Access routine of SQL UDFs

2025-07-29 Thread Allison Wang (Jira)
Allison Wang created SPARK-53008: Summary: Derive SQL Data Access routine of SQL UDFs Key: SPARK-53008 URL: https://issues.apache.org/jira/browse/SPARK-53008 Project: Spark Issue Type: Sub-ta

[jira] [Created] (SPARK-52982) Disallow Lateral Join with Arrow Python UDTFs

2025-07-28 Thread Allison Wang (Jira)
Allison Wang created SPARK-52982: Summary: Disallow Lateral Join with Arrow Python UDTFs Key: SPARK-52982 URL: https://issues.apache.org/jira/browse/SPARK-52982 Project: Spark Issue Type: Sub

[jira] [Updated] (SPARK-52981) Support table arguments in Arrow Python UDTFs

2025-07-28 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-52981: - Summary: Support table arguments in Arrow Python UDTFs (was: Support Arrow Python UDTFs with ta

[jira] [Created] (SPARK-52981) Support Arrow Python UDTFs with table argument

2025-07-28 Thread Allison Wang (Jira)
Allison Wang created SPARK-52981: Summary: Support Arrow Python UDTFs with table argument Key: SPARK-52981 URL: https://issues.apache.org/jira/browse/SPARK-52981 Project: Spark Issue Type: Su

[jira] [Updated] (SPARK-52980) Support Arrow Python UDTFs

2025-07-28 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-52980: - Summary: Support Arrow Python UDTFs (was: Support Vectorized Python UDTFs ) > Support Arrow P

[jira] [Created] (SPARK-52980) Support Vectorized Python UDTFs

2025-07-28 Thread Allison Wang (Jira)
Allison Wang created SPARK-52980: Summary: Support Vectorized Python UDTFs Key: SPARK-52980 URL: https://issues.apache.org/jira/browse/SPARK-52980 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-52979) Python Arrow UDTF

2025-07-28 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-52979: - Description: Similar to Arrow UDFs https://issues.apache.org/jira/browse/SPARK-52214, we can in

[jira] [Created] (SPARK-52979) Python Arrow UDTF

2025-07-28 Thread Allison Wang (Jira)
Allison Wang created SPARK-52979: Summary: Python Arrow UDTF Key: SPARK-52979 URL: https://issues.apache.org/jira/browse/SPARK-52979 Project: Spark Issue Type: Umbrella Components:

[jira] [Assigned] (SPARK-52979) Python Arrow UDTF

2025-07-28 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang reassigned SPARK-52979: Assignee: Allison Wang > Python Arrow UDTF > - > > Key: S

[jira] [Resolved] (SPARK-52147) Detect temp object usage in persistent SQL functions

2025-07-23 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang resolved SPARK-52147. -- Fix Version/s: 4.1.0 4.0.1 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-52147) Detect temp object usage in persistent SQL functions

2025-07-23 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang reassigned SPARK-52147: Assignee: Allison Wang > Detect temp object usage in persistent SQL functions > -

[jira] [Updated] (SPARK-52719) Support using scalar UDFs in TVFs

2025-07-22 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-52719: - Summary: Support using scalar UDFs in TVFs (was: Support using scalar UFDs in in TVFs) > Suppo

[jira] [Commented] (SPARK-46057) Support SQL user-defined functions

2025-07-18 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18008120#comment-18008120 ] Allison Wang commented on SPARK-46057: -- [~ajantha] The documentation for SQL UDFs h

[jira] [Created] (SPARK-52735) Fix missing error class definition

2025-07-09 Thread Allison Wang (Jira)
Allison Wang created SPARK-52735: Summary: Fix missing error class definition Key: SPARK-52735 URL: https://issues.apache.org/jira/browse/SPARK-52735 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-52719) Support using scalar UFDs in in TVFs

2025-07-08 Thread Allison Wang (Jira)
Allison Wang created SPARK-52719: Summary: Support using scalar UFDs in in TVFs Key: SPARK-52719 URL: https://issues.apache.org/jira/browse/SPARK-52719 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-51919) Allow overwriting statically registered Python Data Source

2025-07-08 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang reassigned SPARK-51919: Assignee: Haoyu Weng > Allow overwriting statically registered Python Data Source > -

[jira] [Resolved] (SPARK-51919) Allow overwriting statically registered Python Data Source

2025-07-08 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang resolved SPARK-51919. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50716 [https://gi

[jira] [Created] (SPARK-52698) Improve type hints in datasource module

2025-07-07 Thread Allison Wang (Jira)
Allison Wang created SPARK-52698: Summary: Improve type hints in datasource module Key: SPARK-52698 URL: https://issues.apache.org/jira/browse/SPARK-52698 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-52590) Add SQL query tests on optional return types

2025-06-26 Thread Allison Wang (Jira)
Allison Wang created SPARK-52590: Summary: Add SQL query tests on optional return types Key: SPARK-52590 URL: https://issues.apache.org/jira/browse/SPARK-52590 Project: Spark Issue Type: Sub-

[jira] [Updated] (SPARK-52499) Add more SQL query tests for different data types

2025-06-26 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-52499: - Summary: Add more SQL query tests for different data types (was: Add more tests for data types)

[jira] [Created] (SPARK-52497) Add documentation for SQL UDFs

2025-06-16 Thread Allison Wang (Jira)
Allison Wang created SPARK-52497: Summary: Add documentation for SQL UDFs Key: SPARK-52497 URL: https://issues.apache.org/jira/browse/SPARK-52497 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-52499) Add more tests for data types

2025-06-16 Thread Allison Wang (Jira)
Allison Wang created SPARK-52499: Summary: Add more tests for data types Key: SPARK-52499 URL: https://issues.apache.org/jira/browse/SPARK-52499 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-52148) Fix CREATE OR REPLACE for SQL TVFs

2025-06-16 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-52148: - Parent: SPARK-52282 Issue Type: Sub-task (was: Bug) > Fix CREATE OR REPLACE for SQL TVF

[jira] [Updated] (SPARK-52148) Fix CREATE OR REPLACE for SQL TVFs

2025-06-16 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-52148: - Summary: Fix CREATE OR REPLACE for SQL TVFs (was: Fix CREATE OR REPLACE for SQL UDFs) > Fix CR

[jira] [Updated] (SPARK-52148) Fix CREATE OR REPLACE for SQL UDFs

2025-06-16 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-52148: - Description: – !query CREATE FUNCTION foo3_3at(x INT) RETURNS TABLE (a DOUBLE) RETURN SELECT 1 /

[jira] [Assigned] (SPARK-51430) Stop PySpark context logger from propagating to stdout

2025-05-23 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang reassigned SPARK-51430: Assignee: Allison Wang > Stop PySpark context logger from propagating to stdout > ---

[jira] [Resolved] (SPARK-51430) Stop PySpark context logger from propagating to stdout

2025-05-23 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang resolved SPARK-51430. -- Fix Version/s: 4.1.0 4.0.1 Resolution: Fixed Issue resolved by pull

[jira] [Updated] (SPARK-52147) Detect temp object usage in persistent SQL functions

2025-05-23 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-52147: - Parent: SPARK-52282 Issue Type: Sub-task (was: Improvement) > Detect temp object usage

[jira] [Updated] (SPARK-52146) Detect cyclic function usage in SQL UDFs

2025-05-23 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-52146: - Parent: (was: SPARK-46057) Issue Type: Improvement (was: Sub-task) > Detect cyclic

[jira] [Updated] (SPARK-52146) Detect cyclic function usage in SQL UDFs

2025-05-23 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-52146: - Parent: SPARK-52282 Issue Type: Sub-task (was: Improvement) > Detect cyclic function us

[jira] [Updated] (SPARK-52147) Detect temp object usage in persistent SQL functions

2025-05-23 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-52147: - Parent: (was: SPARK-52282) Issue Type: Improvement (was: Sub-task) > Detect temp ob

[jira] [Updated] (SPARK-52147) Detect temp object usage in persistent SQL functions

2025-05-23 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-52147: - Parent: (was: SPARK-46057) Issue Type: Improvement (was: Sub-task) > Detect temp ob

[jira] [Updated] (SPARK-52147) Detect temp object usage in persistent SQL functions

2025-05-23 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-52147: - Parent: SPARK-52282 Issue Type: Sub-task (was: Improvement) > Detect temp object usage

[jira] [Updated] (SPARK-50698) Refactor CreateUserDefinedFunction command to extend from UnaryRunnableCommand

2025-05-23 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-50698: - Parent: SPARK-52282 Issue Type: Sub-task (was: Improvement) > Refactor CreateUserDefine

[jira] [Updated] (SPARK-50698) Refactor CreateUserDefinedFunction command to extend from UnaryRunnableCommand

2025-05-23 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-50698: - Parent: (was: SPARK-46057) Issue Type: Improvement (was: Sub-task) > Refactor Creat

[jira] [Updated] (SPARK-52282) Improve SQL User-defined Functions

2025-05-23 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-52282: - Issue Type: Umbrella (was: Improvement) > Improve SQL User-defined Functions >

[jira] [Created] (SPARK-52282) Improve SQL User-defined Functions

2025-05-23 Thread Allison Wang (Jira)
Allison Wang created SPARK-52282: Summary: Improve SQL User-defined Functions Key: SPARK-52282 URL: https://issues.apache.org/jira/browse/SPARK-52282 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-52148) Fix CREATE OR REPLACE for SQL UDFs

2025-05-14 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-52148: - Description: -- !query CREATE OR REPLACE FUNCTION foo3_3a(x INT) RETURNS DOUBLE RETURN 1 / x --

[jira] [Updated] (SPARK-52148) Fix create or replace SQL UDFs

2025-05-14 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-52148: - Description: CREATE OR REPLACE FUNCTION foo3_3at(x INT) RETURNS TABLE (a DOUBLE) RETURN SELECT

[jira] [Updated] (SPARK-52148) Fix CREATE OR REPLACE for SQL UDFs

2025-05-14 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-52148: - Summary: Fix CREATE OR REPLACE for SQL UDFs (was: Fix create or replace SQL UDFs) > Fix CREATE

[jira] [Updated] (SPARK-52148) Fix create or replace SQL UDFs

2025-05-14 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-52148: - Description: This should work: -- !query CREATE OR REPLACE FUNCTION foo3_3a(x INT) RETURNS DOUB

[jira] [Created] (SPARK-52148) Fix create or replace SQL UDFs

2025-05-14 Thread Allison Wang (Jira)
Allison Wang created SPARK-52148: Summary: Fix create or replace SQL UDFs Key: SPARK-52148 URL: https://issues.apache.org/jira/browse/SPARK-52148 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-52147) Detect temp object usage in persistent SQL functions

2025-05-14 Thread Allison Wang (Jira)
Allison Wang created SPARK-52147: Summary: Detect temp object usage in persistent SQL functions Key: SPARK-52147 URL: https://issues.apache.org/jira/browse/SPARK-52147 Project: Spark Issue Ty

[jira] [Created] (SPARK-52146) Detect cyclic function usage in SQL UDFs

2025-05-14 Thread Allison Wang (Jira)
Allison Wang created SPARK-52146: Summary: Detect cyclic function usage in SQL UDFs Key: SPARK-52146 URL: https://issues.apache.org/jira/browse/SPARK-52146 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-51989) Add missing Filter subclasses to __all__ list in pyspark.sql.datasource

2025-05-06 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang reassigned SPARK-51989: Assignee: Allison Wang > Add missing Filter subclasses to __all__ list in pyspark.sql.dat

[jira] [Resolved] (SPARK-51989) Add missing Filter subclasses to __all__ list in pyspark.sql.datasource

2025-05-06 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang resolved SPARK-51989. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50782 [https://gi

[jira] [Created] (SPARK-51989) Add missing Filter subclasses to __all__ list in pyspark.sql.datasource

2025-05-02 Thread Allison Wang (Jira)
Allison Wang created SPARK-51989: Summary: Add missing Filter subclasses to __all__ list in pyspark.sql.datasource Key: SPARK-51989 URL: https://issues.apache.org/jira/browse/SPARK-51989 Project: Spar

[jira] [Created] (SPARK-51979) Add more SQL query tests for table function return columns

2025-05-01 Thread Allison Wang (Jira)
Allison Wang created SPARK-51979: Summary: Add more SQL query tests for table function return columns Key: SPARK-51979 URL: https://issues.apache.org/jira/browse/SPARK-51979 Project: Spark Is

[jira] [Created] (SPARK-51939) Refine data source docstring to add arrow batch examples

2025-04-28 Thread Allison Wang (Jira)
Allison Wang created SPARK-51939: Summary: Refine data source docstring to add arrow batch examples Key: SPARK-51939 URL: https://issues.apache.org/jira/browse/SPARK-51939 Project: Spark Issu

[jira] [Assigned] (SPARK-51271) Python Data Sources Filter Pushdown API

2025-04-04 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang reassigned SPARK-51271: Assignee: Haoyu Weng > Python Data Sources Filter Pushdown API >

[jira] [Resolved] (SPARK-51566) Recover Python traceback from JVM error message

2025-03-27 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang resolved SPARK-51566. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50313 [https://gi

[jira] [Assigned] (SPARK-51566) Recover Python traceback from JVM error message

2025-03-27 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang reassigned SPARK-51566: Assignee: Haoyu Weng > Recover Python traceback from JVM error message >

[jira] [Assigned] (SPARK-51439) Support default arguments in SQL UDFs

2025-03-24 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang reassigned SPARK-51439: Assignee: Haoyu Weng > Support default arguments in SQL UDFs > --

[jira] [Resolved] (SPARK-51271) Python Data Sources Filter Pushdown API

2025-03-19 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang resolved SPARK-51271. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 49961 [https://gi

[jira] [Updated] (SPARK-51439) Support default arguments in SQL UDFs

2025-03-18 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-51439: - Description: Support default arguments in SQL UDFs, e.g CREATE FUNCTION foo(x INT, y INT DEFAUL

[jira] [Created] (SPARK-51439) Support default arguments in SQL UDFs

2025-03-07 Thread Allison Wang (Jira)
Allison Wang created SPARK-51439: Summary: Support default arguments in SQL UDFs Key: SPARK-51439 URL: https://issues.apache.org/jira/browse/SPARK-51439 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-51430) Stop PySpark context logger from propagating to stdout

2025-03-06 Thread Allison Wang (Jira)
Allison Wang created SPARK-51430: Summary: Stop PySpark context logger from propagating to stdout Key: SPARK-51430 URL: https://issues.apache.org/jira/browse/SPARK-51430 Project: Spark Issue

[jira] [Resolved] (SPARK-50858) Optionally hide Python stack trace from analyze_udtf

2025-01-27 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang resolved SPARK-50858. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49535 [https://gi

[jira] [Created] (SPARK-50858) Optionally hide Python stack trace from analyze_udtf

2025-01-16 Thread Allison Wang (Jira)
Allison Wang created SPARK-50858: Summary: Optionally hide Python stack trace from analyze_udtf Key: SPARK-50858 URL: https://issues.apache.org/jira/browse/SPARK-50858 Project: Spark Issue T

[jira] [Created] (SPARK-50762) Add Analyzer rule for resolving SQL scalar UDFs

2025-01-07 Thread Allison Wang (Jira)
Allison Wang created SPARK-50762: Summary: Add Analyzer rule for resolving SQL scalar UDFs Key: SPARK-50762 URL: https://issues.apache.org/jira/browse/SPARK-50762 Project: Spark Issue Type:

[jira] [Created] (SPARK-50763) Add Analyzer rule for resolving SQL table UDFs

2025-01-07 Thread Allison Wang (Jira)
Allison Wang created SPARK-50763: Summary: Add Analyzer rule for resolving SQL table UDFs Key: SPARK-50763 URL: https://issues.apache.org/jira/browse/SPARK-50763 Project: Spark Issue Type: Su

[jira] [Assigned] (SPARK-48730) Implement CreateSQLFunctionCommand for SQL Scalar and Table Functions

2025-01-06 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang reassigned SPARK-48730: Assignee: Allison Wang > Implement CreateSQLFunctionCommand for SQL Scalar and Table Func

[jira] [Resolved] (SPARK-48730) Implement CreateSQLFunctionCommand for SQL Scalar and Table Functions

2025-01-06 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang resolved SPARK-48730. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49126 [https://gi

[jira] [Created] (SPARK-50734) Add catalog API for creating and registering SQL UDFs

2025-01-05 Thread Allison Wang (Jira)
Allison Wang created SPARK-50734: Summary: Add catalog API for creating and registering SQL UDFs Key: SPARK-50734 URL: https://issues.apache.org/jira/browse/SPARK-50734 Project: Spark Issue T

[jira] [Updated] (SPARK-50698) Refactor CreateUserDefinedFunction command to extend from UnaryRunnableCommand

2025-01-04 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-50698: - Description: Refactor CreateUserDefinedFunction command to extend from UnaryRunnableCommand, si

[jira] [Created] (SPARK-50698) Refactor CreateUserDefinedFunction command to extend from UnaryRunnableCommand

2024-12-29 Thread Allison Wang (Jira)
Allison Wang created SPARK-50698: Summary: Refactor CreateUserDefinedFunction command to extend from UnaryRunnableCommand Key: SPARK-50698 URL: https://issues.apache.org/jira/browse/SPARK-50698 Projec

[jira] [Updated] (SPARK-48730) Implement CreateSQLFunctionCommand for SQL Scalar and Table Functions

2024-12-09 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-48730: - Description: Implement CreateSQLFunctionCommand to support the creation of SQL scalar and table

[jira] [Updated] (SPARK-48730) Implement CreateSQLFunctionCommand for SQL Scalar and Table Functions

2024-12-09 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-48730: - Summary: Implement CreateSQLFunctionCommand for SQL Scalar and Table Functions (was: Support cr

[jira] [Updated] (SPARK-48730) Support create persistent SQL UDFs

2024-12-09 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-48730: - Summary: Support create persistent SQL UDFs (was: Support creating persistent SQL UDFs) > Supp

[jira] [Updated] (SPARK-48730) Support creating persistent SQL UDFs

2024-12-09 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-48730: - Summary: Support creating persistent SQL UDFs (was: Support create persistent SQL UDFs) > Supp

[jira] [Updated] (SPARK-48730) Support creating persistent SQL UDFs

2024-12-09 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-48730: - Summary: Support creating persistent SQL UDFs (was: Support creating persistent SQL UDFs in par

[jira] [Updated] (SPARK-50511) Avoid wrapping Python data source error messages thrown during planning

2024-12-06 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-50511: - Summary: Avoid wrapping Python data source error messages thrown during planning (was: Improve

[jira] [Created] (SPARK-50511) Improve Python data source error thrown during planning

2024-12-06 Thread Allison Wang (Jira)
Allison Wang created SPARK-50511: Summary: Improve Python data source error thrown during planning Key: SPARK-50511 URL: https://issues.apache.org/jira/browse/SPARK-50511 Project: Spark Issue

[jira] [Updated] (SPARK-50471) Support Arrow-Based Python Data Source Writer

2024-12-02 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-50471: - Summary: Support Arrow-Based Python Data Source Writer (was: Support arrow-based Python Data So

[jira] [Created] (SPARK-50471) Support arrow-based Python Data Source Writer

2024-12-02 Thread Allison Wang (Jira)
Allison Wang created SPARK-50471: Summary: Support arrow-based Python Data Source Writer Key: SPARK-50471 URL: https://issues.apache.org/jira/browse/SPARK-50471 Project: Spark Issue Type: Sub

[jira] [Updated] (SPARK-50348) Make static import Python data source configurable

2024-12-02 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-50348: - Description: (was: Currently, Spark will automatically discover and make ) > Make static im

[jira] [Created] (SPARK-50426) Avoid static Python data source lookup when using builtin or Java data sources

2024-11-26 Thread Allison Wang (Jira)
Allison Wang created SPARK-50426: Summary: Avoid static Python data source lookup when using builtin or Java data sources Key: SPARK-50426 URL: https://issues.apache.org/jira/browse/SPARK-50426 Projec

[jira] [Updated] (SPARK-50348) Make static import Python data source configurable

2024-11-19 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-50348: - Description: Currently, Spark will automatically discover and make  > Make static import Python

[jira] [Created] (SPARK-50348) Make static import Python data source configurable

2024-11-19 Thread Allison Wang (Jira)
Allison Wang created SPARK-50348: Summary: Make static import Python data source configurable Key: SPARK-50348 URL: https://issues.apache.org/jira/browse/SPARK-50348 Project: Spark Issue Type

[jira] [Resolved] (SPARK-50075) Add DataFrame API for table-valued functions

2024-10-30 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang resolved SPARK-50075. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48603 [https://gi

[jira] [Updated] (SPARK-49771) Improve Pandas Scalar Iter UDF error when output rows exceed input rows

2024-09-24 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-49771: - Summary: Improve Pandas Scalar Iter UDF error when output rows exceed input rows (was: Improve

[jira] [Created] (SPARK-49771) Improve Pandas Iter UDF error when output rows exceed input rows

2024-09-24 Thread Allison Wang (Jira)
Allison Wang created SPARK-49771: Summary: Improve Pandas Iter UDF error when output rows exceed input rows Key: SPARK-49771 URL: https://issues.apache.org/jira/browse/SPARK-49771 Project: Spark

[jira] [Resolved] (SPARK-48999) [SS] Divide PythonStreamingDataSourceSimpleSuite

2024-07-26 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang resolved SPARK-48999. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47479 [https://gi

[jira] [Assigned] (SPARK-48999) [SS] Divide PythonStreamingDataSourceSimpleSuite

2024-07-26 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang reassigned SPARK-48999: Assignee: Siying Dong > [SS] Divide PythonStreamingDataSourceSimpleSuite > --

[jira] [Created] (SPARK-48938) Improve error message when registering UDTFs

2024-07-18 Thread Allison Wang (Jira)
Allison Wang created SPARK-48938: Summary: Improve error message when registering UDTFs Key: SPARK-48938 URL: https://issues.apache.org/jira/browse/SPARK-48938 Project: Spark Issue Type: Sub-

[jira] [Created] (SPARK-48825) Unify the 'See Also' section formatting across PySpark docstrings

2024-07-05 Thread Allison Wang (Jira)
Allison Wang created SPARK-48825: Summary: Unify the 'See Also' section formatting across PySpark docstrings Key: SPARK-48825 URL: https://issues.apache.org/jira/browse/SPARK-48825 Project: Spark

[jira] [Created] (SPARK-48785) Add a simple data source example in the user guide

2024-07-02 Thread Allison Wang (Jira)
Allison Wang created SPARK-48785: Summary: Add a simple data source example in the user guide Key: SPARK-48785 URL: https://issues.apache.org/jira/browse/SPARK-48785 Project: Spark Issue Type

[jira] [Created] (SPARK-48783) Update the table-valued function documentation

2024-07-02 Thread Allison Wang (Jira)
Allison Wang created SPARK-48783: Summary: Update the table-valued function documentation Key: SPARK-48783 URL: https://issues.apache.org/jira/browse/SPARK-48783 Project: Spark Issue Type: Su

[jira] [Updated] (SPARK-48479) Support creating temp SQL functions in parser

2024-06-26 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-48479: - Summary: Support creating temp SQL functions in parser (was: Support creating SQL functions in

[jira] [Created] (SPARK-48730) Support creating persistent SQL UDFs in parser

2024-06-26 Thread Allison Wang (Jira)
Allison Wang created SPARK-48730: Summary: Support creating persistent SQL UDFs in parser Key: SPARK-48730 URL: https://issues.apache.org/jira/browse/SPARK-48730 Project: Spark Issue Type: Su

  1   2   3   4   5   >