[jira] [Created] (SPARK-51679) Support `dtypes` for `DataFrame`

2025-04-04 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-51679: - Summary: Support `dtypes` for `DataFrame` Key: SPARK-51679 URL: https://issues.apache.org/jira/browse/SPARK-51679 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-51686) Link the execution id list of sub-executions for current execution if any

2025-04-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51686: - Assignee: Kent Yao > Link the execution id list of sub-executions for current execution

[jira] [Created] (SPARK-51712) Swallow errors in spark.catalog.listTables()

2025-04-04 Thread Yihong He (Jira)
Yihong He created SPARK-51712: - Summary: Swallow errors in spark.catalog.listTables() Key: SPARK-51712 URL: https://issues.apache.org/jira/browse/SPARK-51712 Project: Spark Issue Type: Improvemen

[jira] [Created] (SPARK-51723) Add DSv2 APIs for create/get table constraints

2025-04-04 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-51723: -- Summary: Add DSv2 APIs for create/get table constraints Key: SPARK-51723 URL: https://issues.apache.org/jira/browse/SPARK-51723 Project: Spark Issue Type

[jira] [Created] (SPARK-51699) Upgrade to Apache parent pom 34

2025-04-04 Thread Vlad Rozov (Jira)
Vlad Rozov created SPARK-51699: -- Summary: Upgrade to Apache parent pom 34 Key: SPARK-51699 URL: https://issues.apache.org/jira/browse/SPARK-51699 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-51724) RocksDB StateStore's lineage manager should be synchronized

2025-04-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51724: --- Labels: pull-request-available (was: ) > RocksDB StateStore's lineage manager should be syn

[jira] [Updated] (SPARK-51723) Add DSv2 APIs for create/get table constraints

2025-04-04 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-51723: --- Description: Adds the following DSv2 APIs as per SPIP [doc|https://docs.google.com/document

[jira] [Updated] (SPARK-51723) Add DSv2 APIs for create/get table constraints

2025-04-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51723: --- Labels: pull-request-available (was: ) > Add DSv2 APIs for create/get table constraints > -

[jira] [Resolved] (SPARK-51650) Support delete ml cached objects in batch

2025-04-04 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-51650. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50441 [https://

[jira] [Created] (SPARK-51704) Eliminate unnecessary collect operation

2025-04-04 Thread zhoubin (Jira)
zhoubin created SPARK-51704: --- Summary: Eliminate unnecessary collect operation Key: SPARK-51704 URL: https://issues.apache.org/jira/browse/SPARK-51704 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-51726) Migrate DSv2 StagingTableCatalog to use TableInfo

2025-04-04 Thread Anoop Johnson (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Johnson updated SPARK-51726: -- Description: This is a followup of [SPARK-51372|https://issues.apache.org/jira/browse/SPARK-51

[jira] [Created] (SPARK-51726) Migrate DSv2 StagingTableCatalog to use TableInfo

2025-04-04 Thread Anoop Johnson (Jira)
Anoop Johnson created SPARK-51726: - Summary: Migrate DSv2 StagingTableCatalog to use TableInfo Key: SPARK-51726 URL: https://issues.apache.org/jira/browse/SPARK-51726 Project: Spark Issue Typ

[jira] [Updated] (SPARK-51726) Migrate DSv2 StagingTableCatalog to use TableInfo

2025-04-04 Thread Anoop Johnson (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Johnson updated SPARK-51726: -- Description: This is a followup of [SPARK-51372|https://issues.apache.org/jira/browse/SPARK-51

[jira] [Resolved] (SPARK-51667) [TWS + Python] Disable Nagle's algorithm between Python worker and State Server

2025-04-04 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-51667. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50460 [https://gi

[jira] [Resolved] (SPARK-51698) Include sql/api/src/main/gen/ in gitignore

2025-04-04 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-51698. Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50498 [https:

[jira] [Assigned] (SPARK-51527) Make codegen log level configurable via SQLConf

2025-04-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-51527: Assignee: Cheng Pan > Make codegen log level configurable via SQLConf > -

[jira] [Created] (SPARK-51724) RocksDB StateStore's lineage manager should be synchronized

2025-04-04 Thread Siying Dong (Jira)
Siying Dong created SPARK-51724: --- Summary: RocksDB StateStore's lineage manager should be synchronized Key: SPARK-51724 URL: https://issues.apache.org/jira/browse/SPARK-51724 Project: Spark Is

[jira] [Assigned] (SPARK-51685) Excessive Info logging from RocksDb operations causing too big executor stderr files

2025-04-04 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-51685: Assignee: Vinod KC > Excessive Info logging from RocksDb operations causing too big execu

[jira] [Created] (SPARK-51559) Make max broadcast table size configurable

2025-04-04 Thread Chao Sun (Jira)
Chao Sun created SPARK-51559: Summary: Make max broadcast table size configurable Key: SPARK-51559 URL: https://issues.apache.org/jira/browse/SPARK-51559 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-51533) Performance Degradation with mapInPandas in Spark 3.5.*

2025-04-04 Thread Jesuino (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesuino updated SPARK-51533: Description: After upgrading to Spark 3.5.*, I noticed a significant performance degradation when using `

[jira] [Assigned] (SPARK-51708) Add `CaseInsensitiveDictionary`

2025-04-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51708: - Assignee: Dongjoon Hyun > Add `CaseInsensitiveDictionary` > ---

[jira] [Created] (SPARK-51719) Support `table` for `SparkSession` and `DataFrame`

2025-04-04 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-51719: - Summary: Support `table` for `SparkSession` and `DataFrame` Key: SPARK-51719 URL: https://issues.apache.org/jira/browse/SPARK-51719 Project: Spark Issue Ty

[jira] [Resolved] (SPARK-51718) Update `README.md` with Spark 4.0.0 RC3

2025-04-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51718. --- Fix Version/s: connect-swift-0.1.0 Resolution: Fixed Issue resolved by pull request 4

[jira] [Updated] (SPARK-51646) Fix propagating collation to views with default collation

2025-04-04 Thread Marko Ilic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marko Ilic updated SPARK-51646: --- Issue Type: Bug (was: Test) > Fix propagating collation to views with default collation > -

[jira] [Updated] (SPARK-51712) Swallow non-fatal Throwables in spark.catalog.listTables()

2025-04-04 Thread Yihong He (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yihong He updated SPARK-51712: -- Summary: Swallow non-fatal Throwables in spark.catalog.listTables() (was: Swallow non-fatal throwable

[jira] [Updated] (SPARK-51712) Swallow non-fatal throwables in spark.catalog.listTables()

2025-04-04 Thread Yihong He (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yihong He updated SPARK-51712: -- Summary: Swallow non-fatal throwables in spark.catalog.listTables() (was: Swallow errors in spark.cat

[jira] [Created] (SPARK-51583) Improve error message when to_timestamp function has arguments of wrong type

2025-04-04 Thread Mihailo Aleksic (Jira)
Mihailo Aleksic created SPARK-51583: --- Summary: Improve error message when to_timestamp function has arguments of wrong type Key: SPARK-51583 URL: https://issues.apache.org/jira/browse/SPARK-51583 Pr

[jira] [Updated] (SPARK-51595) pyspark pip install fails with latest setuptools (78.0.1)

2025-04-04 Thread Francesco Macagno (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Francesco Macagno updated SPARK-51595: -- Summary: pyspark pip install fails with latest setuptools (78.0.1) (was: pyspark pip

[jira] [Created] (SPARK-51582) Improve codegen for ExpandExec with high number of projections

2025-04-04 Thread Shardul Mahadik (Jira)
Shardul Mahadik created SPARK-51582: --- Summary: Improve codegen for ExpandExec with high number of projections Key: SPARK-51582 URL: https://issues.apache.org/jira/browse/SPARK-51582 Project: Spark

[jira] [Created] (SPARK-51580) Fix error message when lambda function is out of place in `HigherOrderFunction`

2025-04-04 Thread Mihailo Timotic (Jira)
Mihailo Timotic created SPARK-51580: --- Summary: Fix error message when lambda function is out of place in `HigherOrderFunction` Key: SPARK-51580 URL: https://issues.apache.org/jira/browse/SPARK-51580

[jira] [Assigned] (SPARK-51704) Eliminate unnecessary collect operation

2025-04-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-51704: Assignee: zhoubin > Eliminate unnecessary collect operation > ---

[jira] [Resolved] (SPARK-51704) Eliminate unnecessary collect operation

2025-04-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-51704. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50494 [https://github.com

[jira] [Assigned] (SPARK-51720) Add Cross Join as legal in recursion of Recursive CTE

2025-04-04 Thread Peter Toth (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth reassigned SPARK-51720: -- Assignee: Pavle Martinović > Add Cross Join as legal in recursion of Recursive CTE >

[jira] [Resolved] (SPARK-51720) Add Cross Join as legal in recursion of Recursive CTE

2025-04-04 Thread Peter Toth (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth resolved SPARK-51720. Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50308 [https://github

[jira] [Updated] (SPARK-51712) Swallow non-fatal Throwables during resolving tables in spark.catalog.listTables()

2025-04-04 Thread Yihong He (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yihong He updated SPARK-51712: -- Summary: Swallow non-fatal Throwables during resolving tables in spark.catalog.listTables() (was: Swa

[jira] [Assigned] (SPARK-51646) Fix propagating collation to views with default collation

2025-04-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-51646: Assignee: Marko Ilic > Fix propagating collation to views with default collation > --

[jira] [Updated] (SPARK-51720) Add Cross Join as legal in recursion of Recursive CTE

2025-04-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51720: --- Labels: pull-request-available (was: ) > Add Cross Join as legal in recursion of Recursive

[jira] [Updated] (SPARK-51721) Change default value of ANALYZER_SINGLE_PASS_RESOLVER_RELATION_BRIDGING_ENABLED flag

2025-04-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51721: --- Labels: pull-request-available (was: ) > Change default value of > ANALYZER_SINGLE_PASS_RE

[jira] [Created] (SPARK-51710) Using Dataframe.dropDuplicates with an empty array as argument behaves unexpectedly

2025-04-04 Thread David Kunzmann (Jira)
David Kunzmann created SPARK-51710: -- Summary: Using Dataframe.dropDuplicates with an empty array as argument behaves unexpectedly Key: SPARK-51710 URL: https://issues.apache.org/jira/browse/SPARK-51710

[jira] [Created] (SPARK-51720) Add Cross Join as legal in recursion of Recursive CTE

2025-04-04 Thread Jira
Pavle Martinović created SPARK-51720: Summary: Add Cross Join as legal in recursion of Recursive CTE Key: SPARK-51720 URL: https://issues.apache.org/jira/browse/SPARK-51720 Project: Spark

[jira] [Created] (SPARK-51721) Change default value of ANALYZER_SINGLE_PASS_RESOLVER_RELATION_BRIDGING_ENABLED flag

2025-04-04 Thread Mihailo Aleksic (Jira)
Mihailo Aleksic created SPARK-51721: --- Summary: Change default value of ANALYZER_SINGLE_PASS_RESOLVER_RELATION_BRIDGING_ENABLED flag Key: SPARK-51721 URL: https://issues.apache.org/jira/browse/SPARK-51721

[jira] [Updated] (SPARK-51721) Set default value of ANALYZER_SINGLE_PASS_RESOLVER_RELATION_BRIDGING_ENABLED flag to !Utils.isTesting

2025-04-04 Thread Mihailo Aleksic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Aleksic updated SPARK-51721: Summary: Set default value of ANALYZER_SINGLE_PASS_RESOLVER_RELATION_BRIDGING_ENABLED flag

[jira] [Updated] (SPARK-51721) Change default value of ANALYZER_SINGLE_PASS_RESOLVER_RELATION_BRIDGING_ENABLED flag

2025-04-04 Thread Mihailo Aleksic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Aleksic updated SPARK-51721: Summary: Change default value of ANALYZER_SINGLE_PASS_RESOLVER_RELATION_BRIDGING_ENABLED f

[jira] [Resolved] (SPARK-51646) Fix propagating collation to views with default collation

2025-04-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-51646. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50436 [https://github.com

[jira] [Assigned] (SPARK-51702) Revise `sparkSession/read/write/columns/schema/dtypes/storageLevel` API

2025-04-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51702: - Assignee: Dongjoon Hyun > Revise `sparkSession/read/write/columns/schema/dtypes/storage

[jira] [Updated] (SPARK-51691) SerializationDebugger should swallow exception when try to find the reason of serialization problem

2025-04-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51691: --- Labels: pull-request-available (was: ) > SerializationDebugger should swallow exception whe

[jira] [Updated] (SPARK-51712) Swallow non-fatal Throwables in spark.catalog.listTables()

2025-04-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51712: --- Labels: pull-request-available (was: ) > Swallow non-fatal Throwables in spark.catalog.list

[jira] [Resolved] (SPARK-51674) Remove unnecessary Spark Connect doc link from Spark website

2025-04-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-51674. -- Resolution: Fixed Fixed in https://github.com/apache/spark/pull/50469 > Remove unnecessary Sp

[jira] [Updated] (SPARK-51712) Swallow non-fatal Throwables when resolving tables in spark.catalog.listTables()

2025-04-04 Thread Yihong He (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yihong He updated SPARK-51712: -- Summary: Swallow non-fatal Throwables when resolving tables in spark.catalog.listTables() (was: Swall

[jira] [Created] (SPARK-51705) [CONNECT] Support Broadcast

2025-04-04 Thread Jayadeep Jayaraman (Jira)
Jayadeep Jayaraman created SPARK-51705: -- Summary: [CONNECT] Support Broadcast Key: SPARK-51705 URL: https://issues.apache.org/jira/browse/SPARK-51705 Project: Spark Issue Type: Improveme

[jira] [Created] (SPARK-51695) Introduce Parser Changes for Table Constraints (CHECK, UNIQUE, PK, FK)

2025-04-04 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-51695: -- Summary: Introduce Parser Changes for Table Constraints (CHECK, UNIQUE, PK, FK) Key: SPARK-51695 URL: https://issues.apache.org/jira/browse/SPARK-51695 Project: S

[jira] [Created] (SPARK-51579) Spark CSV Read Low Performance: EOFExceptions in Univocity Parser

2025-04-04 Thread Jira
Ángel Álvarez Pascua created SPARK-51579: Summary: Spark CSV Read Low Performance: EOFExceptions in Univocity Parser Key: SPARK-51579 URL: https://issues.apache.org/jira/browse/SPARK-51579 Pro

[jira] [Updated] (SPARK-51404) Support parser data type json "time(n)" as TimeType

2025-04-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51404: --- Labels: pull-request-available (was: ) > Support parser data type json "time(n)" as TimeTyp

[jira] [Assigned] (SPARK-51569) Don't reinstantiate InSubquery in InTypeCoercion if there are no changes

2025-04-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-51569: --- Assignee: Mihailo Timotic > Don't reinstantiate InSubquery in InTypeCoercion if there are n

[jira] [Updated] (SPARK-51707) Should handling of `IllegalStateException` where the message contains the keyword `Memory leaked` in the `afterAll` method of `RemoteSparkSession`

2025-04-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51707: --- Labels: pull-request-available (was: ) > Should handling of `IllegalStateException` where t

[jira] [Assigned] (SPARK-51556) Add the try_to_time() function

2025-04-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-51556: Assignee: Max Gekk > Add the try_to_time() function > -- > >

[jira] [Resolved] (SPARK-51572) Support `binary` type in `show` and `collect`

2025-04-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51572. --- Fix Version/s: connect-swift-0.1.0 Resolution: Fixed Issue resolved by pull request 2

[jira] [Commented] (SPARK-51212) Add a separated PySpark package for Spark Connect by default.

2025-04-04 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-51212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17937956#comment-17937956 ] Björn Boschman commented on SPARK-51212: [~ueshin][~cloud_fan] Could this be por

[jira] [Updated] (SPARK-51717) Possible SST mismatch error for the second snapshot created for a new query

2025-04-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51717: --- Labels: pull-request-available (was: ) > Possible SST mismatch error for the second snapsho

[jira] [Assigned] (SPARK-51404) Support parser data type json "time(n)" as TimeType

2025-04-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-51404: Assignee: Max Gekk > Support parser data type json "time(n)" as TimeType > --

[jira] [Created] (SPARK-51541) Support the TIME data type in Literal methods

2025-04-04 Thread Max Gekk (Jira)
Max Gekk created SPARK-51541: Summary: Support the TIME data type in Literal methods Key: SPARK-51541 URL: https://issues.apache.org/jira/browse/SPARK-51541 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-51596) Fix concurrent StateStoreProvider maintenance and closing

2025-04-04 Thread Livia Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Livia Zhu updated SPARK-51596: -- Description: Currently, both the task thread and maintenance thread can call unload() on a provider.

[jira] [Assigned] (SPARK-51271) Python Data Sources Filter Pushdown API

2025-04-04 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang reassigned SPARK-51271: Assignee: Haoyu Weng > Python Data Sources Filter Pushdown API >

[jira] [Updated] (SPARK-51722) Remove "stop" origin from ParseException

2025-04-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51722: --- Labels: pull-request-available (was: ) > Remove "stop" origin from ParseException > --

[jira] [Resolved] (SPARK-51697) PySpark - Fix list state test failure for TWS

2025-04-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-51697. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50501 [https://gi

[jira] [Updated] (SPARK-51616) Run CollationTypeCasts explicitly before assigning aliases

2025-04-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51616: --- Labels: pull-request-available (was: ) > Run CollationTypeCasts explicitly before assigning

[jira] [Created] (SPARK-51722) Remove "stop" origin from ParseException

2025-04-04 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-51722: -- Summary: Remove "stop" origin from ParseException Key: SPARK-51722 URL: https://issues.apache.org/jira/browse/SPARK-51722 Project: Spark Issue Type: Tas