[jira] [Resolved] (SPARK-53120) Recover _source directory for PySpark documentation

2025-08-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-53120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-53120. -- Fix Version/s: 4.1.0 4.0.1 3.5.7 Assignee: Hyukj

[jira] [Updated] (SPARK-53120) Recover _source directory for PySpark documentation

2025-08-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-53120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-53120: - Issue Type: Documentation (was: Test) > Recover _source directory for PySpark documentation > -

[jira] [Created] (SPARK-53120) Recover _source directory for PySpark documentation

2025-08-04 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-53120: Summary: Recover _source directory for PySpark documentation Key: SPARK-53120 URL: https://issues.apache.org/jira/browse/SPARK-53120 Project: Spark Issue Typ

[jira] [Assigned] (SPARK-53054) The Scala Spark Connect DataFrameReader does not use the correct default format

2025-08-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-53054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-53054: Assignee: Robert Dillitz > The Scala Spark Connect DataFrameReader does not use the corre

[jira] [Resolved] (SPARK-53054) The Scala Spark Connect DataFrameReader does not use the correct default format

2025-08-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-53054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-53054. -- Fix Version/s: 4.1.0 4.0.1 3.5.7 Resolution: Fixed

[jira] [Resolved] (SPARK-53036) Enable doctest `pyspark.sql.pandas.functions`

2025-07-31 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-53036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-53036. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51741 [https://gi

[jira] [Assigned] (SPARK-53036) Enable doctest `pyspark.sql.pandas.functions`

2025-07-31 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-53036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-53036: Assignee: Ruifeng Zheng > Enable doctest `pyspark.sql.pandas.functions` > ---

[jira] [Resolved] (SPARK-53014) Make Arrow UDF public

2025-07-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-53014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-53014. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51718 [https://gi

[jira] [Assigned] (SPARK-53014) Make Arrow UDF public

2025-07-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-53014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-53014: Assignee: Ruifeng Zheng > Make Arrow UDF public > - > >

[jira] [Assigned] (SPARK-53013) Fix Arrow-optimized Python UDTF returning no rows on lateral join

2025-07-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-53013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-53013: Assignee: Takuya Ueshin > Fix Arrow-optimized Python UDTF returning no rows on lateral jo

[jira] [Resolved] (SPARK-53013) Fix Arrow-optimized Python UDTF returning no rows on lateral join

2025-07-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-53013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-53013. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51717 [https://gi

[jira] [Assigned] (SPARK-53018) ArrowStreamArrowUDFSerializer should respect argument arrow_cast

2025-07-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-53018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-53018: Assignee: Ruifeng Zheng > ArrowStreamArrowUDFSerializer should respect argument arrow_cas

[jira] [Resolved] (SPARK-53018) ArrowStreamArrowUDFSerializer should respect argument arrow_cast

2025-07-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-53018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-53018. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51723 [https://gi

[jira] [Resolved] (SPARK-52992) Restore API reference of `pandas_udf`

2025-07-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52992. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51699 [https://gi

[jira] [Assigned] (SPARK-52992) Restore API reference of `pandas_udf`

2025-07-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52992: Assignee: Ruifeng Zheng > Restore API reference of `pandas_udf` > ---

[jira] [Resolved] (SPARK-52952) Add PySpark UDF Type Coercion Dev Script

2025-07-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52952. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51663 [https://gi

[jira] [Assigned] (SPARK-52952) Add PySpark UDF Type Coercion Dev Script

2025-07-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52952: Assignee: Amanda Liu > Add PySpark UDF Type Coercion Dev Script > ---

[jira] [Resolved] (SPARK-52890) Implement the to_time function in Python

2025-07-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52890. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51585 [https://gi

[jira] [Resolved] (SPARK-52891) Implement the try_to_time function in Python

2025-07-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52891. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51585 [https://gi

[jira] [Assigned] (SPARK-52890) Implement the to_time function in Python

2025-07-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52890: Assignee: Uroš Bojanić > Implement the to_time function in Python > -

[jira] [Assigned] (SPARK-52891) Implement the try_to_time function in Python

2025-07-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52891: Assignee: Uroš Bojanić > Implement the try_to_time function in Python > -

[jira] [Assigned] (SPARK-52894) Implement the second function in Python for TIME type

2025-07-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52894: Assignee: Uroš Bojanić > Implement the second function in Python for TIME type >

[jira] [Resolved] (SPARK-52892) Implement the hour function in Python for TIME type

2025-07-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52892. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51586 [https://gi

[jira] [Resolved] (SPARK-52888) Implement the make_time function in Python

2025-07-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52888. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51582 [https://gi

[jira] [Resolved] (SPARK-52894) Implement the second function in Python for TIME type

2025-07-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52894. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51586 [https://gi

[jira] [Assigned] (SPARK-52893) Implement the minute function in Python for TIME type

2025-07-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52893: Assignee: Uroš Bojanić > Implement the minute function in Python for TIME type >

[jira] [Resolved] (SPARK-52893) Implement the minute function in Python for TIME type

2025-07-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52893. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51586 [https://gi

[jira] [Assigned] (SPARK-52892) Implement the hour function in Python for TIME type

2025-07-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52892: Assignee: Uroš Bojanić > Implement the hour function in Python for TIME type > --

[jira] [Assigned] (SPARK-52888) Implement the make_time function in Python

2025-07-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52888: Assignee: Uroš Bojanić > Implement the make_time function in Python > ---

[jira] [Resolved] (SPARK-52970) Upgrade PyArrow version in 3.5 client <> master build

2025-07-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52970. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51681 [https://gi

[jira] [Assigned] (SPARK-52970) Upgrade PyArrow version in 3.5 client <> master build

2025-07-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52970: Assignee: Hyukjin Kwon > Upgrade PyArrow version in 3.5 client <> master build >

[jira] [Created] (SPARK-52970) Upgrade PyArrow version in 3.5 client <> master build

2025-07-27 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-52970: Summary: Upgrade PyArrow version in 3.5 client <> master build Key: SPARK-52970 URL: https://issues.apache.org/jira/browse/SPARK-52970 Project: Spark Issue T

[jira] [Resolved] (SPARK-52961) Fix Python UDTF with 0-arg eval on lateral join

2025-07-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52961. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51672 [https://gi

[jira] [Assigned] (SPARK-52961) Fix Python UDTF with 0-arg eval on lateral join

2025-07-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52961: Assignee: Takuya Ueshin > Fix Python UDTF with 0-arg eval on lateral join > -

[jira] [Resolved] (SPARK-52950) Enable ANSI mode in DataSourceV2StrategySuite

2025-07-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52950. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51660 [https://gi

[jira] [Assigned] (SPARK-52950) Enable ANSI mode in DataSourceV2StrategySuite

2025-07-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52950: Assignee: Hyukjin Kwon > Enable ANSI mode in DataSourceV2StrategySuite >

[jira] [Deleted] (SPARK-52951) Skip local-cluster tests in Connect-only build

2025-07-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon deleted SPARK-52951: - > Skip local-cluster tests in Connect-only build > -- >

[jira] [Created] (SPARK-52951) Skip local-cluster tests in Connect-only build

2025-07-24 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-52951: Summary: Skip local-cluster tests in Connect-only build Key: SPARK-52951 URL: https://issues.apache.org/jira/browse/SPARK-52951 Project: Spark Issue Type: Bu

[jira] [Created] (SPARK-52950) Enable ANSI mode in DataSourceV2StrategySuite

2025-07-24 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-52950: Summary: Enable ANSI mode in DataSourceV2StrategySuite Key: SPARK-52950 URL: https://issues.apache.org/jira/browse/SPARK-52950 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-52947) Fix image path in declarative pipelines programming guide

2025-07-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52947. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51657 [https://gi

[jira] [Resolved] (SPARK-50889) Fix Flaky Test: `SparkSessionE2ESuite.interrupt operation` (Hang)

2025-07-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-50889. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51638 [https://gi

[jira] [Assigned] (SPARK-50889) Fix Flaky Test: `SparkSessionE2ESuite.interrupt operation` (Hang)

2025-07-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-50889: Assignee: Dongjoon Hyun > Fix Flaky Test: `SparkSessionE2ESuite.interrupt operation` (Han

[jira] [Resolved] (SPARK-52940) Add arrow udf unit tests for complex return types

2025-07-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52940. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51649 [https://gi

[jira] [Assigned] (SPARK-52940) Add arrow udf unit tests for complex return types

2025-07-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52940: Assignee: Ruifeng Zheng > Add arrow udf unit tests for complex return types > ---

[jira] [Assigned] (SPARK-52821) Support int to DecimalType return type coercion in Pandas UDFs (useArrow=True)

2025-07-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52821: Assignee: Ben Hurdelhey > Support int to DecimalType return type coercion in Pandas UDFs

[jira] [Resolved] (SPARK-52821) Support int to DecimalType return type coercion in Pandas UDFs (useArrow=True)

2025-07-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52821. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51538 [https://gi

[jira] [Updated] (SPARK-52791) Inferring a UDT errors when first element is null

2025-07-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-52791: - Component/s: (was: PS) > Inferring a UDT errors when first element is null > ---

[jira] [Updated] (SPARK-52791) Inferring a UDT errors when first element is null

2025-07-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-52791: - Fix Version/s: 4.0.1 3.5.7 > Inferring a UDT errors when first element is nul

[jira] [Resolved] (SPARK-52920) Improve memory profiler doc to clarify generator UDFs are unsupported

2025-07-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52920. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51624 [https://gi

[jira] [Assigned] (SPARK-52920) Improve memory profiler doc to clarify generator UDFs are unsupported

2025-07-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52920: Assignee: Xinrong Meng > Improve memory profiler doc to clarify generator UDFs are unsupp

[jira] [Assigned] (SPARK-52791) Inferring a UDT errors when first element is null

2025-07-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52791: Assignee: Peter Nguyen > Inferring a UDT errors when first element is null >

[jira] [Resolved] (SPARK-52791) Inferring a UDT errors when first element is null

2025-07-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52791. -- Fix Version/s: 4.1.0 (was: 3.5.0) Resolution: Fixed Issue resolv

[jira] [Resolved] (SPARK-52877) Improve Python UDF Arrow Serializer Performance

2025-07-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52877. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51225 [https://gi

[jira] [Assigned] (SPARK-52877) Improve Python UDF Arrow Serializer Performance

2025-07-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52877: Assignee: Amanda Liu > Improve Python UDF Arrow Serializer Performance >

[jira] [Resolved] (SPARK-52852) Remove spark_conf argument from create_streaming_table

2025-07-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52852. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51607 [https://gi

[jira] [Assigned] (SPARK-52852) Remove spark_conf argument from create_streaming_table

2025-07-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52852: Assignee: Sandy Ryza > Remove spark_conf argument from create_streaming_table > -

[jira] [Resolved] (SPARK-52771) Fix float32 type widening in `truediv`/`floordiv`

2025-07-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52771. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51456 [https://gi

[jira] [Assigned] (SPARK-52771) Fix float32 type widening in `truediv`/`floordiv`

2025-07-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52771: Assignee: Xinrong Meng > Fix float32 type widening in `truediv`/`floordiv` >

[jira] [Resolved] (SPARK-52448) Add simplified Struct Expression.Literal

2025-07-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52448. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51561 [https://gi

[jira] [Assigned] (SPARK-52448) Add simplified Struct Expression.Literal

2025-07-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52448: Assignee: Yihong He > Add simplified Struct Expression.Literal >

[jira] [Assigned] (SPARK-52811) Improve ArrowTableToRowsConversion.convert performance

2025-07-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52811: Assignee: Takuya Ueshin > Improve ArrowTableToRowsConversion.convert performance > --

[jira] [Resolved] (SPARK-52811) Improve ArrowTableToRowsConversion.convert performance

2025-07-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52811. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51508 [https://gi

[jira] [Resolved] (SPARK-52673) [CONNECT][CLIENT] Add grpc RetryInfo handling to Spark Connect retry policies

2025-07-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52673. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51363 [https://gi

[jira] [Assigned] (SPARK-52673) [CONNECT][CLIENT] Add grpc RetryInfo handling to Spark Connect retry policies

2025-07-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52673: Assignee: Alex Khakhlyuk > [CONNECT][CLIENT] Add grpc RetryInfo handling to Spark Connect

[jira] [Assigned] (SPARK-52786) Make pyspark-client package to upload with preview naming

2025-07-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52786: Assignee: Hyukjin Kwon > Make pyspark-client package to upload with preview naming >

[jira] [Resolved] (SPARK-52786) Make pyspark-client package to upload with preview naming

2025-07-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52786. -- Fix Version/s: 4.1.0 4.0.1 Resolution: Fixed Issue resolved by pull

[jira] [Created] (SPARK-52786) Make pyspark-client package to upload with preview naming

2025-07-13 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-52786: Summary: Make pyspark-client package to upload with preview naming Key: SPARK-52786 URL: https://issues.apache.org/jira/browse/SPARK-52786 Project: Spark Iss

[jira] [Resolved] (SPARK-52781) Typo 'dtyeps' in internal.py

2025-07-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52781. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51463 [https://gi

[jira] [Assigned] (SPARK-52781) Typo 'dtyeps' in internal.py

2025-07-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52781: Assignee: Peter Nguyen > Typo 'dtyeps' in internal.py > > >

[jira] [Updated] (SPARK-52716) [SDP] Remove comment field and references from Flow schema

2025-07-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-52716: - Affects Version/s: 4.1.0 (was: 4.1) > [SDP] Remove comment field and

[jira] [Resolved] (SPARK-52716) [SDP] Remove comment field and references from Flow schema

2025-07-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52716. -- Fix Version/s: 4.1.0 Assignee: Jacky Wang Resolution: Fixed Fixed in https://g

[jira] [Resolved] (SPARK-52768) "moveing" typo in pandas/series.py

2025-07-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52768. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51452 [https://gi

[jira] [Assigned] (SPARK-52768) "moveing" typo in pandas/series.py

2025-07-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52768: Assignee: Peter Nguyen > "moveing" typo in pandas/series.py > ---

[jira] [Assigned] (SPARK-52766) Allow manual dispatches of dry runs in the forked repository

2025-07-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52766: Assignee: Hyukjin Kwon > Allow manual dispatches of dry runs in the forked repository > -

[jira] [Resolved] (SPARK-52766) Allow manual dispatches of dry runs in the forked repository

2025-07-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52766. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51450 [https://gi

[jira] [Created] (SPARK-52766) Allow manual dispatches of dry runs in the forked repository

2025-07-10 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-52766: Summary: Allow manual dispatches of dry runs in the forked repository Key: SPARK-52766 URL: https://issues.apache.org/jira/browse/SPARK-52766 Project: Spark

[jira] [Resolved] (SPARK-52750) Fix flaky test LocalTableScanExec

2025-07-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52750. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51425 [https://gi

[jira] [Assigned] (SPARK-52750) Fix flaky test LocalTableScanExec

2025-07-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52750: Assignee: Alek Jarmov > Fix flaky test LocalTableScanExec > -

[jira] [Assigned] (SPARK-52749) Replace preview1 to dev1 in its PyPI package name

2025-07-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52749: Assignee: Hyukjin Kwon > Replace preview1 to dev1 in its PyPI package name >

[jira] [Resolved] (SPARK-52749) Replace preview1 to dev1 in its PyPI package name

2025-07-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52749. -- Fix Version/s: 4.1.0 4.0.1 3.5.7 Resolution: Fixed

[jira] [Created] (SPARK-52749) Replace preview1 to dev1 in its PyPI package name

2025-07-10 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-52749: Summary: Replace preview1 to dev1 in its PyPI package name Key: SPARK-52749 URL: https://issues.apache.org/jira/browse/SPARK-52749 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-52739) Apply a patch to unittest to avoid unexpectedly passing when setUpClass fails

2025-07-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52739. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51429 [https://gi

[jira] [Assigned] (SPARK-52739) Apply a patch to unittest to avoid unexpectedly passing when setUpClass fails

2025-07-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52739: Assignee: Takuya Ueshin > Apply a patch to unittest to avoid unexpectedly passing when se

[jira] [Resolved] (SPARK-52735) Fix missing error class definition

2025-07-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52735. -- Fix Version/s: 4.1.0 4.0.1 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-52736) Typo Moveing in pyspark pandas generic.py

2025-07-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52736. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51426 [https://gi

[jira] [Assigned] (SPARK-52736) Typo Moveing in pyspark pandas generic.py

2025-07-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52736: Assignee: Peter Nguyen > Typo Moveing in pyspark pandas generic.py >

[jira] [Resolved] (SPARK-52717) Escape special characters when redacting the log files

2025-07-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52717. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51405 [https://gi

[jira] [Assigned] (SPARK-52717) Escape special characters when redacting the log files

2025-07-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52717: Assignee: Hyukjin Kwon > Escape special characters when redacting the log files > ---

[jira] [Assigned] (SPARK-52563) _assert_pandas_almost_equal uses wrong var instead of parameters

2025-07-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52563: Assignee: Peter Nguyen > _assert_pandas_almost_equal uses wrong var instead of parameters

[jira] [Resolved] (SPARK-52563) _assert_pandas_almost_equal uses wrong var instead of parameters

2025-07-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52563. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51253 [https://gi

[jira] [Created] (SPARK-52717) Escape special characters when redacting the log files

2025-07-08 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-52717: Summary: Escape special characters when redacting the log files Key: SPARK-52717 URL: https://issues.apache.org/jira/browse/SPARK-52717 Project: Spark Issue

[jira] [Resolved] (SPARK-52625) SPIP: Monthly preview release

2025-07-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52625. -- Resolution: Done > SPIP: Monthly preview release > - > >

[jira] [Assigned] (SPARK-52707) Remove preview postfix when looking up the JIRA versions

2025-07-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52707: Assignee: Hyukjin Kwon > Remove preview postfix when looking up the JIRA versions > -

[jira] [Resolved] (SPARK-52707) Remove preview postfix when looking up the JIRA versions

2025-07-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52707. -- Fix Version/s: 4.1.0 4.0.1 3.5.7 Resolution: Fixed

[jira] [Updated] (SPARK-52707) Replace preview postfix when looking up the JIRA versions

2025-07-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-52707: - Summary: Replace preview postfix when looking up the JIRA versions (was: Do not look up version

[jira] [Updated] (SPARK-52707) Remove preview postfix when looking up the JIRA versions

2025-07-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-52707: - Summary: Remove preview postfix when looking up the JIRA versions (was: Replace preview postfix

[jira] [Created] (SPARK-52707) Do not look up versions for preview releases

2025-07-08 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-52707: Summary: Do not look up versions for preview releases Key: SPARK-52707 URL: https://issues.apache.org/jira/browse/SPARK-52707 Project: Spark Issue Type: Sub-

[jira] [Updated] (SPARK-52707) Do not look up versions for preview releases

2025-07-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-52707: - Affects Version/s: 3.5.6 > Do not look up versions for preview releases > --

[jira] [Reopened] (SPARK-52698) Improve type hints in datasource module

2025-07-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-52698: -- Assignee: (was: Allison Wang) Reverted at https://github.com/apache/spark/commit/00cf5d

[jira] [Updated] (SPARK-52698) Improve type hints in datasource module

2025-07-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-52698: - Fix Version/s: (was: 4.1.0) > Improve type hints in datasource module >

  1   2   3   4   5   6   7   8   9   10   >