[jira] [Created] (SPARK-50844) make ML model to be loaded by ServiceLoader

2025-01-16 Thread Bobby Wang (Jira)
Bobby Wang created SPARK-50844: -- Summary: make ML model to be loaded by ServiceLoader Key: SPARK-50844 URL: https://issues.apache.org/jira/browse/SPARK-50844 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-50847) Deny ApplyCharTypePadding from applying on specific In expressions

2025-01-16 Thread Mihailo Aleksic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Aleksic updated SPARK-50847: Description: java.lang.ClassCastException > Deny ApplyCharTypePadding from applying on spe

[jira] [Updated] (SPARK-50847) Deny ApplyCharTypePadding from applying on specific In expressions

2025-01-16 Thread Mihailo Aleksic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Aleksic updated SPARK-50847: Environment: (was: `ApplyCharTypePadding` rule shouldn't be applied to `In` expression

[jira] [Updated] (SPARK-50847) Deny ApplyCharTypePadding from applying on specific In expressions

2025-01-16 Thread Mihailo Aleksic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Aleksic updated SPARK-50847: Description: `ApplyCharTypePadding` rule shouldn't be applied to `In` expressions where el

[jira] [Created] (SPARK-50847) Deny ApplyCharTypePadding from applying on specific In expressions

2025-01-16 Thread Mihailo Aleksic (Jira)
Mihailo Aleksic created SPARK-50847: --- Summary: Deny ApplyCharTypePadding from applying on specific In expressions Key: SPARK-50847 URL: https://issues.apache.org/jira/browse/SPARK-50847 Project: Spa

[jira] [Updated] (SPARK-50847) Deny ApplyCharTypePadding from applying on specific In expressions

2025-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50847: --- Labels: pull-request-available (was: ) > Deny ApplyCharTypePadding from applying on specifi

[jira] [Assigned] (SPARK-50830) Return single-pass result as the dual run analysis result

2025-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-50830: -- Assignee: (was: Apache Spark) > Return single-pass result as the dual run analysi

[jira] [Resolved] (SPARK-50825) Support Tree Classifiers in ML Connect

2025-01-16 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-50825. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49525 [https://

[jira] [Created] (SPARK-50846) Consolidate Aggregator handling in ColumnNodeToProtoConverter

2025-01-16 Thread Pengfei Xu (Jira)
Pengfei Xu created SPARK-50846: -- Summary: Consolidate Aggregator handling in ColumnNodeToProtoConverter Key: SPARK-50846 URL: https://issues.apache.org/jira/browse/SPARK-50846 Project: Spark Is

[jira] [Updated] (SPARK-50846) Consolidate Aggregator handling in ColumnNodeToProtoConverter

2025-01-16 Thread Pengfei Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengfei Xu updated SPARK-50846: --- Issue Type: Improvement (was: Bug) > Consolidate Aggregator handling in ColumnNodeToProtoConverter

[jira] [Assigned] (SPARK-50830) Return single-pass result as the dual run analysis result

2025-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-50830: -- Assignee: Apache Spark > Return single-pass result as the dual run analysis result >

[jira] [Resolved] (SPARK-50830) Return single-pass result as the dual run analysis result

2025-01-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-50830. - Resolution: Fixed Issue resolved by pull request 49509 [https://github.com/apache/spark/pull/495

[jira] [Updated] (SPARK-50848) [Connect] Add example/sample project(s) for Spark Server Libraries

2025-01-16 Thread Venkata Sai Akhil Gudesa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venkata Sai Akhil Gudesa updated SPARK-50848: - Description: As a follow-up to [https://github.com/apache/spark/pull/48

[jira] [Updated] (SPARK-50848) [Connect] Add example/sample project(s) for Spark Server Libraries

2025-01-16 Thread Venkata Sai Akhil Gudesa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venkata Sai Akhil Gudesa updated SPARK-50848: - Description: As a follow-up to [https://github.com/apache/spark/pull/489

[jira] [Created] (SPARK-50848) [Connect] Add example/sample project(s) for Spark Server Libraries

2025-01-16 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-50848: Summary: [Connect] Add example/sample project(s) for Spark Server Libraries Key: SPARK-50848 URL: https://issues.apache.org/jira/browse/SPARK-50848

[jira] [Created] (SPARK-50850) Plan ID changes when executing an SQL string

2025-01-16 Thread Changgyoo Park (Jira)
Changgyoo Park created SPARK-50850: -- Summary: Plan ID changes when executing an SQL string Key: SPARK-50850 URL: https://issues.apache.org/jira/browse/SPARK-50850 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-50830) Return single-pass result as the dual run analysis result

2025-01-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-50830: --- Assignee: Mihailo Aleksic > Return single-pass result as the dual run analysis result > ---

[jira] [Resolved] (SPARK-50827) Support plugin for Spark Connect ML

2025-01-16 Thread Martin Grund (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Grund resolved SPARK-50827. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49503 [https://gi

[jira] [Assigned] (SPARK-50792) Format binary data as a binary literal in JDBC.

2025-01-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-50792: --- Assignee: Xiaoguang Sun > Format binary data as a binary literal in JDBC. > ---

[jira] [Updated] (SPARK-50844) make ML model to be loaded by ServiceLoader

2025-01-16 Thread Bobby Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bobby Wang updated SPARK-50844: --- Description: Currently, Since most of models from Spark.ml doesn't have a public no-arguments const

[jira] [Updated] (SPARK-50852) Add Java 21 Maven Daily GitHub Action job for `branch-4.0`

2025-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50852: --- Labels: pull-request-available (was: ) > Add Java 21 Maven Daily GitHub Action job for `bra

[jira] [Created] (SPARK-50852) Add Java 21 Maven Daily GitHub Action job for `branch-4.0`

2025-01-16 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-50852: - Summary: Add Java 21 Maven Daily GitHub Action job for `branch-4.0` Key: SPARK-50852 URL: https://issues.apache.org/jira/browse/SPARK-50852 Project: Spark

[jira] [Updated] (SPARK-50852) Add Java 21 Daily GitHub Action job for `branch-4.0`

2025-01-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-50852: -- Summary: Add Java 21 Daily GitHub Action job for `branch-4.0` (was: Add Java 21 Maven Daily G

[jira] [Resolved] (SPARK-50829) Add flag to disable session collation by default

2025-01-16 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-50829. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49505 [https://github.com

[jira] [Assigned] (SPARK-50852) Add Java 21 Daily GitHub Action job for `branch-4.0`

2025-01-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-50852: - Assignee: Dongjoon Hyun > Add Java 21 Daily GitHub Action job for `branch-4.0` > --

[jira] [Created] (SPARK-50853) Temp shuffle files not closed

2025-01-16 Thread Michael Chen (Jira)
Michael Chen created SPARK-50853: Summary: Temp shuffle files not closed Key: SPARK-50853 URL: https://issues.apache.org/jira/browse/SPARK-50853 Project: Spark Issue Type: Bug Compo

[jira] [Updated] (SPARK-50853) Temp shuffle files not closed

2025-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50853: --- Labels: pull-request-available (was: ) > Temp shuffle files not closed > --

[jira] [Updated] (SPARK-50851) Express ML params with `proto.Expression`

2025-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50851: --- Labels: pull-request-available (was: ) > Express ML params with `proto.Expression` > --

[jira] [Resolved] (SPARK-50831) Enable trimming collation by default

2025-01-16 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-50831. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 49510 [https://github.com

[jira] [Assigned] (SPARK-50831) Enable trimming collation by default

2025-01-16 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-50831: Assignee: Stevo Mitric > Enable trimming collation by default > -

[jira] [Created] (SPARK-50851) Express ML params with `proto.Expression`

2025-01-16 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50851: - Summary: Express ML params with `proto.Expression` Key: SPARK-50851 URL: https://issues.apache.org/jira/browse/SPARK-50851 Project: Spark Issue Type: Sub-t

[jira] [Resolved] (SPARK-50850) Plan ID changes when executing an SQL string

2025-01-16 Thread Changgyoo Park (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Changgyoo Park resolved SPARK-50850. Resolution: Invalid > Plan ID changes when executing an SQL string > -

[jira] [Resolved] (SPARK-46934) Read/write roundtrip for struct type with special characters with HMS

2025-01-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46934. --- Resolution: Fixed Issue resolved by pull request 49506 [https://github.com/apache/spark/pull

[jira] [Assigned] (SPARK-46934) Read/write roundtrip for struct type with special characters with HMS

2025-01-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46934: - Assignee: Kent Yao > Read/write roundtrip for struct type with special characters with

[jira] [Updated] (SPARK-50852) Add Java 21 Daily GitHub Action job for `branch-4.0`

2025-01-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-50852: -- Fix Version/s: 4.0.0 (was: 4.1.0) > Add Java 21 Daily GitHub Action job

[jira] [Resolved] (SPARK-50852) Add Java 21 Daily GitHub Action job for `branch-4.0`

2025-01-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-50852. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 49530 [https://

[jira] [Assigned] (SPARK-50860) Clarify Exclusion of Doc-Only Updates from User-Facing Changes

2025-01-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-50860: Assignee: Gengliang Wang > Clarify Exclusion of Doc-Only Updates from User-Facing Changes

[jira] [Updated] (SPARK-50866) Limit GHA job execution time to up to 2 hours

2025-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50866: --- Labels: pull-request-available (was: ) > Limit GHA job execution time to up to 2 hours > --

[jira] [Assigned] (SPARK-50263) Intermittent ReattachableExecuteSuite failure

2025-01-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-50263: Assignee: Changgyoo Park > Intermittent ReattachableExecuteSuite failure > --

[jira] [Resolved] (SPARK-50263) Intermittent ReattachableExecuteSuite failure

2025-01-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-50263. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49003 [https://gi

[jira] [Created] (SPARK-50869) Support evaluator

2025-01-16 Thread Bobby Wang (Jira)
Bobby Wang created SPARK-50869: -- Summary: Support evaluator Key: SPARK-50869 URL: https://issues.apache.org/jira/browse/SPARK-50869 Project: Spark Issue Type: Sub-task Components: Conn

[jira] [Resolved] (SPARK-50866) Limit GHA job execution time to up to 2 hours

2025-01-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-50866. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49544 [https://

[jira] [Assigned] (SPARK-50866) Limit GHA job execution time to up to 2 hours

2025-01-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-50866: - Assignee: Dongjoon Hyun > Limit GHA job execution time to up to 2 hours > -

[jira] [Resolved] (SPARK-50860) Clarify Exclusion of Doc-Only Updates from User-Facing Changes

2025-01-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-50860. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49534 [https://gi

[jira] [Created] (SPARK-50866) Limit GHA job execution time to up to 2 hours

2025-01-16 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-50866: - Summary: Limit GHA job execution time to up to 2 hours Key: SPARK-50866 URL: https://issues.apache.org/jira/browse/SPARK-50866 Project: Spark Issue Type: S

[jira] [Updated] (SPARK-50851) Express ML params with `proto.Expression.Literal`

2025-01-16 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-50851: -- Summary: Express ML params with `proto.Expression.Literal` (was: Express ML params with `prot

[jira] [Assigned] (SPARK-50863) Skip slow pytorch tests

2025-01-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-50863: - Assignee: Ruifeng Zheng > Skip slow pytorch tests > --- > >

[jira] [Resolved] (SPARK-50863) Skip slow pytorch tests

2025-01-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-50863. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49539 [https://

[jira] [Resolved] (SPARK-50867) Move search_jar and SPARK_HOME to sqlutils.py

2025-01-16 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-50867. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49543 [https://

[jira] [Created] (SPARK-50867) Move search_jar and SPARK_HOME to sqlutils.py

2025-01-16 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50867: - Summary: Move search_jar and SPARK_HOME to sqlutils.py Key: SPARK-50867 URL: https://issues.apache.org/jira/browse/SPARK-50867 Project: Spark Issue Type: T

[jira] [Updated] (SPARK-50867) Move search_jar and SPARK_HOME to sqlutils.py

2025-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50867: --- Labels: pull-request-available (was: ) > Move search_jar and SPARK_HOME to sqlutils.py > --

[jira] [Created] (SPARK-50868) Upgrade `scalafmt` to 3.8.5

2025-01-16 Thread Pan Bingkun (Jira)
Pan Bingkun created SPARK-50868: --- Summary: Upgrade `scalafmt` to 3.8.5 Key: SPARK-50868 URL: https://issues.apache.org/jira/browse/SPARK-50868 Project: Spark Issue Type: Improvement C

[jira] [Resolved] (SPARK-50618) Refactor Data[Frame|Stream]Reader to leverage the analyzer

2025-01-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-50618. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49238 [https://gith

[jira] [Created] (SPARK-50860) Clarify Exclusion of Doc-Only Updates from User-Facing Changes

2025-01-16 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-50860: -- Summary: Clarify Exclusion of Doc-Only Updates from User-Facing Changes Key: SPARK-50860 URL: https://issues.apache.org/jira/browse/SPARK-50860 Project: Spark

[jira] [Updated] (SPARK-50860) Clarify Exclusion of Doc-Only Updates from User-Facing Changes

2025-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50860: --- Labels: pull-request-available (was: ) > Clarify Exclusion of Doc-Only Updates from User-Fa

[jira] [Updated] (SPARK-50863) Skip slow pytorch tests

2025-01-16 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-50863: -- Component/s: ML > Skip slow pytorch tests > --- > > Key: S

[jira] [Created] (SPARK-50864) Optimize and reeanble slow pytorch tests

2025-01-16 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50864: - Summary: Optimize and reeanble slow pytorch tests Key: SPARK-50864 URL: https://issues.apache.org/jira/browse/SPARK-50864 Project: Spark Issue Type: Test

[jira] [Created] (SPARK-50863) Skip slow pytorch tests

2025-01-16 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50863: - Summary: Skip slow pytorch tests Key: SPARK-50863 URL: https://issues.apache.org/jira/browse/SPARK-50863 Project: Spark Issue Type: Test Componen

[jira] [Created] (SPARK-50857) Mark GraphX as deprecated

2025-01-16 Thread Holden Karau (Jira)
Holden Karau created SPARK-50857: Summary: Mark GraphX as deprecated Key: SPARK-50857 URL: https://issues.apache.org/jira/browse/SPARK-50857 Project: Spark Issue Type: Improvement C

[jira] [Created] (SPARK-50858) Optionally hide Python stack trace from analyze_udtf

2025-01-16 Thread Allison Wang (Jira)
Allison Wang created SPARK-50858: Summary: Optionally hide Python stack trace from analyze_udtf Key: SPARK-50858 URL: https://issues.apache.org/jira/browse/SPARK-50858 Project: Spark Issue T

[jira] [Created] (SPARK-50856) Spark Connect Support for TransformWithStateInPandas In Python

2025-01-16 Thread Jing Zhan (Jira)
Jing Zhan created SPARK-50856: - Summary: Spark Connect Support for TransformWithStateInPandas In Python Key: SPARK-50856 URL: https://issues.apache.org/jira/browse/SPARK-50856 Project: Spark Iss

[jira] [Created] (SPARK-50861) Upgrade dropwizard metrics to 4.2.30

2025-01-16 Thread Pan Bingkun (Jira)
Pan Bingkun created SPARK-50861: --- Summary: Upgrade dropwizard metrics to 4.2.30 Key: SPARK-50861 URL: https://issues.apache.org/jira/browse/SPARK-50861 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-50714) Enable schema evolution for TransformWithState when Avro encoding is used

2025-01-16 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-50714. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49277 [https://gi

[jira] [Assigned] (SPARK-50714) Enable schema evolution for TransformWithState when Avro encoding is used

2025-01-16 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-50714: Assignee: Eric Marnadi > Enable schema evolution for TransformWithState when Avro encodin

[jira] [Updated] (SPARK-50861) Upgrade dropwizard metrics to 4.2.30

2025-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50861: --- Labels: pull-request-available (was: ) > Upgrade dropwizard metrics to 4.2.30 > ---

[jira] [Created] (SPARK-50854) Usage of relative path in `DataStreamWriter` writes parquet files in unexpected location

2025-01-16 Thread Vlad Rozov (Jira)
Vlad Rozov created SPARK-50854: -- Summary: Usage of relative path in `DataStreamWriter` writes parquet files in unexpected location Key: SPARK-50854 URL: https://issues.apache.org/jira/browse/SPARK-50854

[jira] [Commented] (SPARK-50854) Usage of relative path in `DataStreamWriter` writes parquet files in unexpected location

2025-01-16 Thread Vlad Rozov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17913851#comment-17913851 ] Vlad Rozov commented on SPARK-50854: Please assign it to me. > Usage of relative pa

[jira] [Resolved] (SPARK-50859) Upgrade AWS SDK v2 to 2.25.53

2025-01-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-50859. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 49533 [https://

[jira] [Updated] (SPARK-50859) Upgrade AWS SDK v2 to 2.25.53

2025-01-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-50859: -- Fix Version/s: 4.0.0 (was: 4.1.0) > Upgrade AWS SDK v2 to 2.25.53 > ---

[jira] [Updated] (SPARK-45720) Upgrade AWS SDK to v2 for Spark Kinesis connector

2025-01-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45720: -- Target Version/s: (was: 4.0.0) > Upgrade AWS SDK to v2 for Spark Kinesis connector > ---

[jira] [Updated] (SPARK-50714) Enable schema evolution for TransformWithState when Avro encoding is used

2025-01-16 Thread Anish Shrigondekar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anish Shrigondekar updated SPARK-50714: --- Epic Link: SPARK-46815 > Enable schema evolution for TransformWithState when Avro en

[jira] [Created] (SPARK-50855) Spark Connect Support for TransformWithState In Scala

2025-01-16 Thread Jing Zhan (Jira)
Jing Zhan created SPARK-50855: - Summary: Spark Connect Support for TransformWithState In Scala Key: SPARK-50855 URL: https://issues.apache.org/jira/browse/SPARK-50855 Project: Spark Issue Type: T

[jira] [Commented] (SPARK-50840) TimestampType wrongly gets mapped to TimestampNTZ when reloading metadata from Hive, if timestamp alias is set to NTZ

2025-01-16 Thread Wing Yew Poon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17913899#comment-17913899 ] Wing Yew Poon commented on SPARK-50840: --- Point 2) in the description about mapping

[jira] [Comment Edited] (SPARK-50840) TimestampType wrongly gets mapped to TimestampNTZ when reloading metadata from Hive, if timestamp alias is set to NTZ

2025-01-16 Thread Wing Yew Poon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17913899#comment-17913899 ] Wing Yew Poon edited comment on SPARK-50840 at 1/17/25 12:52 AM: -

[jira] [Updated] (SPARK-50429) Move Unsupported Batch Query to non-temp error class

2025-01-16 Thread Jing Zhan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhan updated SPARK-50429: -- Close this ticket as Batch query is supported now. > Move Unsupported Batch Query to non-temp error class

[jira] [Resolved] (SPARK-50429) Move Unsupported Batch Query to non-temp error class

2025-01-16 Thread Jing Zhan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhan resolved SPARK-50429. --- Resolution: Done > Move Unsupported Batch Query to non-temp error class > --

[jira] [Resolved] (SPARK-47733) Add operational metrics for TWS operators

2025-01-16 Thread Anish Shrigondekar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anish Shrigondekar resolved SPARK-47733. Resolution: Fixed > Add operational metrics for TWS operators > --

[jira] [Updated] (SPARK-50858) Optionally hide Python stack trace from analyze_udtf

2025-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50858: --- Labels: pull-request-available (was: ) > Optionally hide Python stack trace from analyze_ud

[jira] [Updated] (SPARK-50863) Skip slow pytorch tests

2025-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50863: --- Labels: pull-request-available (was: ) > Skip slow pytorch tests > ---