[jira] [Updated] (SPARK-50884) Evaluator: support isLargerBetter on connect ML

2025-01-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50884: --- Labels: pull-request-available (was: ) > Evaluator: support isLargerBetter on connect ML >

[jira] [Created] (SPARK-50961) Add a `removalListener` for `SparkSession.sessions`

2025-01-23 Thread Yang Jie (Jira)
Yang Jie created SPARK-50961: Summary: Add a `removalListener` for `SparkSession.sessions` Key: SPARK-50961 URL: https://issues.apache.org/jira/browse/SPARK-50961 Project: Spark Issue Type: Impro

[jira] [Resolved] (SPARK-50959) ImportError: sys.meta_path is None, Python is likely shutting down Exception ignored in:

2025-01-23 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-50959. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49615 [https://

[jira] [Assigned] (SPARK-50959) ImportError: sys.meta_path is None, Python is likely shutting down Exception ignored in:

2025-01-23 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-50959: - Assignee: Bobby Wang > ImportError: sys.meta_path is None, Python is likely shutting do

[jira] [Assigned] (SPARK-50947) Assign appropriate error class for duplicated artifacts

2025-01-23 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-50947: Assignee: Haejoon Lee > Assign appropriate error class for duplicated artifacts > ---

[jira] [Updated] (SPARK-50961) `SparkSession.sessions` may have a risk of memory leak.

2025-01-23 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-50961: - Summary: `SparkSession.sessions` may have a risk of memory leak. (was: Add a `removalListener` for `Spa

[jira] [Resolved] (SPARK-50939) Support Word2Vec on Connect

2025-01-23 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-50939. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49614 [https://

[jira] [Updated] (SPARK-50961) `SparkSession.sessions` may have a risk of memory leak.

2025-01-23 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-50961: - Issue Type: Bug (was: Improvement) > `SparkSession.sessions` may have a risk of memory leak. >

[jira] [Updated] (SPARK-50961) `SparkSession.sessions` may have a risk of memory leak.

2025-01-23 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-50961: - Attachment: image-2025-01-23-17-04-52-305.png > `SparkSession.sessions` may have a risk of memory leak.

[jira] [Resolved] (SPARK-50947) Assign appropriate error class for duplicated artifacts

2025-01-23 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-50947. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49598 [https://github.com

[jira] [Assigned] (SPARK-50884) Evaluator: support isLargerBetter on connect ML

2025-01-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-50884: -- Assignee: Apache Spark > Evaluator: support isLargerBetter on connect ML > --

[jira] [Assigned] (SPARK-50884) Evaluator: support isLargerBetter on connect ML

2025-01-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-50884: -- Assignee: (was: Apache Spark) > Evaluator: support isLargerBetter on connect ML >

[jira] [Created] (SPARK-50962) StringIndexOutOfBoundsException in AttributeNameParser

2025-01-23 Thread Kent Yao (Jira)
Kent Yao created SPARK-50962: Summary: StringIndexOutOfBoundsException in AttributeNameParser Key: SPARK-50962 URL: https://issues.apache.org/jira/browse/SPARK-50962 Project: Spark Issue Type: Bu

[jira] [Updated] (SPARK-50961) `SparkSession.sessions` may have a risk of memory leak.

2025-01-23 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-50961: - Description: After running the test with `build/sbt clean "connect-client-jvm/test" -Phive`, I see the

[jira] [Updated] (SPARK-50961) `SparkSession.sessions` may have a risk of memory leak.

2025-01-23 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-50961: - Description: After running the test with `build/sbt clean "connect-client-jvm/test" -Phive`, I see the

[jira] [Commented] (SPARK-50846) Consolidate Aggregator handling in ColumnNodeToProtoConverter

2025-01-23 Thread Dmytro Tsyliuryk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17916329#comment-17916329 ] Dmytro Tsyliuryk commented on SPARK-50846: -- Got it, thank you [~xupaddy]! > Co

[jira] [Updated] (SPARK-50962) StringIndexOutOfBoundsException in AttributeNameParser

2025-01-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50962: --- Labels: pull-request-available (was: ) > StringIndexOutOfBoundsException in AttributeNamePa

[jira] [Created] (SPARK-50963) Support Tokenizers, SQLTransform and StopWordsRemover on Connect

2025-01-23 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50963: - Summary: Support Tokenizers, SQLTransform and StopWordsRemover on Connect Key: SPARK-50963 URL: https://issues.apache.org/jira/browse/SPARK-50963 Project: Spark

[jira] [Updated] (SPARK-50963) Support Tokenizers, SQLTransform and StopWordsRemover on Connect

2025-01-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50963: --- Labels: pull-request-available (was: ) > Support Tokenizers, SQLTransform and StopWordsRemo

[jira] [Updated] (SPARK-50919) Support LinearSVC on connect

2025-01-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50919: --- Labels: pull-request-available (was: ) > Support LinearSVC on connect > ---

[jira] [Updated] (SPARK-50935) Support DCT on Connect

2025-01-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50935: --- Labels: pull-request-available (was: ) > Support DCT on Connect > -- >

[jira] [Updated] (SPARK-50961) `SparkSession.sessions` may have a risk of memory leak.

2025-01-23 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-50961: - Affects Version/s: 3.5.4 > `SparkSession.sessions` may have a risk of memory leak. > ---

[jira] [Reopened] (SPARK-50812) Support pyspark.ml on Connect

2025-01-23 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reopened SPARK-50812: --- > Support pyspark.ml on Connect > - > > Key: SPARK-5

[jira] [Created] (SPARK-50964) Use StaticInvoke to implement `VariantGet` codegen

2025-01-23 Thread Pan Bingkun (Jira)
Pan Bingkun created SPARK-50964: --- Summary: Use StaticInvoke to implement `VariantGet` codegen Key: SPARK-50964 URL: https://issues.apache.org/jira/browse/SPARK-50964 Project: Spark Issue Type:

[jira] [Updated] (SPARK-50964) Use StaticInvoke to implement `VariantGet` codegen

2025-01-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50964: --- Labels: pull-request-available (was: ) > Use StaticInvoke to implement `VariantGet` codegen

[jira] [Created] (SPARK-50966) Remove Google Analytics from old Spark versions (0.6.1 to 0.7.3)

2025-01-23 Thread Niall Pemberton (Jira)
Niall Pemberton created SPARK-50966: --- Summary: Remove Google Analytics from old Spark versions (0.6.1 to 0.7.3) Key: SPARK-50966 URL: https://issues.apache.org/jira/browse/SPARK-50966 Project: Spark

[jira] [Commented] (SPARK-50966) Remove Google Analytics from old Spark versions (0.6.1 to 0.7.3)

2025-01-23 Thread Niall Pemberton (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17916459#comment-17916459 ] Niall Pemberton commented on SPARK-50966: - See https://github.com/apache/spark-w

[jira] [Created] (SPARK-50965) Making sure that multiple parameterized queries work on SparkConnect

2025-01-23 Thread Jira
Viktor Lučić created SPARK-50965: Summary: Making sure that multiple parameterized queries work on SparkConnect Key: SPARK-50965 URL: https://issues.apache.org/jira/browse/SPARK-50965 Project: Spark

[jira] [Updated] (SPARK-50965) Making sure that multiple parameterized queries work on SparkConnect

2025-01-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50965: --- Labels: pull-request-available (was: ) > Making sure that multiple parameterized queries wo

[jira] [Resolved] (SPARK-50962) StringIndexOutOfBoundsException in AttributeNameParser

2025-01-23 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-50962. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49622 [https://github.com

[jira] [Assigned] (SPARK-50962) StringIndexOutOfBoundsException in AttributeNameParser

2025-01-23 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-50962: Assignee: Kent Yao > StringIndexOutOfBoundsException in AttributeNameParser > ---

[jira] [Updated] (SPARK-50895) Create common interface for expressions which produce default string type

2025-01-23 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-50895: - Fix Version/s: 4.0.0 (was: 4.1.0) > Create common interface for expressions which

[jira] [Created] (SPARK-50969) Fix GaussianMixtureModel.gaussians

2025-01-23 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50969: - Summary: Fix GaussianMixtureModel.gaussians Key: SPARK-50969 URL: https://issues.apache.org/jira/browse/SPARK-50969 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-50928) Support GaussianMixture on Connect

2025-01-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50928: --- Labels: pull-request-available (was: ) > Support GaussianMixture on Connect > -

[jira] [Updated] (SPARK-50853) Close temp shuffle file writable channel

2025-01-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-50853: -- Summary: Close temp shuffle file writable channel (was: Temp shuffle files not closed) > Clo

[jira] [Updated] (SPARK-50666) Support hint for reading in JDBC data source

2025-01-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-50666: -- Summary: Support hint for reading in JDBC data source (was: DataFrameReader supporting SQL hi

[jira] [Created] (SPARK-50967) Skip processing keys for FMGWS as part of initial state

2025-01-23 Thread Anish Shrigondekar (Jira)
Anish Shrigondekar created SPARK-50967: -- Summary: Skip processing keys for FMGWS as part of initial state Key: SPARK-50967 URL: https://issues.apache.org/jira/browse/SPARK-50967 Project: Spark

[jira] [Created] (SPARK-50971) Combine the two retrievals of `taskDescription` in `CoarseGrainedExecutorBackend#statusUpdate`

2025-01-23 Thread Yang Jie (Jira)
Yang Jie created SPARK-50971: Summary: Combine the two retrievals of `taskDescription` in `CoarseGrainedExecutorBackend#statusUpdate` Key: SPARK-50971 URL: https://issues.apache.org/jira/browse/SPARK-50971

[jira] [Updated] (SPARK-50971) Combine the two retrievals of `taskDescription` in `CoarseGrainedExecutorBackend#statusUpdate`

2025-01-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50971: --- Labels: pull-request-available (was: ) > Combine the two retrievals of `taskDescription` in

[jira] [Created] (SPARK-50972) Upgrade Guava to 33.4.0-jre

2025-01-23 Thread Yang Jie (Jira)
Yang Jie created SPARK-50972: Summary: Upgrade Guava to 33.4.0-jre Key: SPARK-50972 URL: https://issues.apache.org/jira/browse/SPARK-50972 Project: Spark Issue Type: Improvement Compone

[jira] [Updated] (SPARK-50972) Upgrade Guava to 33.4.0-jre

2025-01-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50972: --- Labels: pull-request-available (was: ) > Upgrade Guava to 33.4.0-jre >

[jira] [Assigned] (SPARK-50940) Support CrossValidator on Connect

2025-01-23 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-50940: - Assignee: Bobby Wang (was: Ruifeng Zheng) > Support CrossValidator on Connect > --

[jira] [Assigned] (SPARK-50933) Support Feature Selectors on Connect

2025-01-23 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-50933: - Assignee: Ruifeng Zheng > Support Feature Selectors on Connect > --

[jira] [Resolved] (SPARK-50933) Support Feature Selectors on Connect

2025-01-23 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-50933. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49641 [https://

[jira] [Updated] (SPARK-50933) Support Feature Selectors on Connect

2025-01-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50933: --- Labels: pull-request-available (was: ) > Support Feature Selectors on Connect > ---

[jira] [Created] (SPARK-50974) CrossValidator: foldCol is not supported

2025-01-23 Thread Bobby Wang (Jira)
Bobby Wang created SPARK-50974: -- Summary: CrossValidator: foldCol is not supported Key: SPARK-50974 URL: https://issues.apache.org/jira/browse/SPARK-50974 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-50940) Support CrossValidator on Connect

2025-01-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50940: --- Labels: pull-request-available (was: ) > Support CrossValidator on Connect > --

[jira] [Resolved] (SPARK-50931) Support Binarizer on connect

2025-01-23 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-50931. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49637 [https://

[jira] [Resolved] (SPARK-50971) Combine the two retrievals of `taskDescription` in `CoarseGrainedExecutorBackend#statusUpdate`

2025-01-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-50971. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49638 [https://

[jira] [Assigned] (SPARK-50971) Combine the two retrievals of `taskDescription` in `CoarseGrainedExecutorBackend#statusUpdate`

2025-01-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-50971: - Assignee: Yang Jie > Combine the two retrievals of `taskDescription` in > `CoarseGrain

[jira] [Resolved] (SPARK-50972) Upgrade Guava to 33.4.0-jre

2025-01-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-50972. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49639 [https://

[jira] [Updated] (SPARK-50972) Upgrade Guava to 33.4.0-jre

2025-01-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-50972: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Upgrade Guava to 33.4.0

[jira] [Assigned] (SPARK-50972) Upgrade Guava to 33.4.0-jre

2025-01-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-50972: - Assignee: Yang Jie > Upgrade Guava to 33.4.0-jre > --- > >

[jira] [Resolved] (SPARK-50853) Temp shuffle files not closed

2025-01-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-50853. --- Fix Version/s: 4.0.0 3.5.5 Assignee: Michael Chen Resoluti

[jira] [Resolved] (SPARK-50884) Evaluator: support isLargerBetter on connect ML

2025-01-23 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-50884. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49620 [https://

[jira] [Updated] (SPARK-50931) Support Binarizer on connect

2025-01-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50931: --- Labels: pull-request-available (was: ) > Support Binarizer on connect > ---

[jira] [Updated] (SPARK-50907) Recover CI in Python scheduled build

2025-01-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-50907: - Summary: Recover CI in Python scheduled build (was: Recover CI in scheduled build) > Recover C

[jira] [Commented] (SPARK-50914) Fix flaky ResourceProfileTests.test_profile_before_sc_for_connect

2025-01-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17916543#comment-17916543 ] Hyukjin Kwon commented on SPARK-50914: -- Taking a look now > Fix flaky ResourceProf

[jira] [Resolved] (SPARK-50963) Support Tokenizers, SQLTransform and StopWordsRemover on Connect

2025-01-23 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-50963. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49624 [https://

[jira] [Assigned] (SPARK-50963) Support Tokenizers, SQLTransform and StopWordsRemover on Connect

2025-01-23 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-50963: - Assignee: Ruifeng Zheng > Support Tokenizers, SQLTransform and StopWordsRemover on Conn

[jira] [Resolved] (SPARK-50919) Support LinearSVC on connect

2025-01-23 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-50919. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49625 [https://

[jira] [Resolved] (SPARK-50770) Removing package scope for transformWithState operator APIs

2025-01-23 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-50770. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49417 [https://gi

[jira] [Updated] (SPARK-50908) Fix flacky pyspark.sql.tests.pandas.test_pandas_transform_with_state.TransformWithStateInPandasTests

2025-01-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50908: --- Labels: pull-request-available (was: ) > Fix flacky > pyspark.sql.tests.pandas.test_pandas

[jira] [Updated] (SPARK-50968) Fix the usage of `Column.__new__`.

2025-01-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50968: --- Labels: pull-request-available (was: ) > Fix the usage of `Column.__new__`. > -

[jira] [Updated] (SPARK-50666) DataFrameReader supporting SQL hint

2025-01-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-50666: -- Parent: SPARK-47361 Issue Type: Sub-task (was: Improvement) > DataFrameReader support

[jira] [Resolved] (SPARK-50910) Fix flaky test KafkaMicroBatchV1SourceWithConsumerSuite

2025-01-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-50910. -- Resolution: Invalid Will focus on Python build in this JIRA. > Fix flaky test KafkaMicroBatch

[jira] [Resolved] (SPARK-50968) Fix the usage of `Column.__new__`.

2025-01-23 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-50968. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49631 [https://

[jira] [Assigned] (SPARK-50968) Fix the usage of `Column.__new__`.

2025-01-23 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin reassigned SPARK-50968: - Assignee: Takuya Ueshin > Fix the usage of `Column.__new__`. >

[jira] [Created] (SPARK-50973) Cleanup deprecated api usage related to `avro.Schema#toString(boolean)`

2025-01-23 Thread Yang Jie (Jira)
Yang Jie created SPARK-50973: Summary: Cleanup deprecated api usage related to `avro.Schema#toString(boolean)` Key: SPARK-50973 URL: https://issues.apache.org/jira/browse/SPARK-50973 Project: Spark

[jira] [Updated] (SPARK-50973) Cleanup deprecated api usage related to `avro.Schema#toString(boolean)`

2025-01-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50973: --- Labels: pull-request-available (was: ) > Cleanup deprecated api usage related to `avro.Sche

[jira] [Assigned] (SPARK-50884) Evaluator: support isLargerBetter on connect ML

2025-01-23 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-50884: - Assignee: Bobby Wang > Evaluator: support isLargerBetter on connect ML > --

[jira] [Assigned] (SPARK-50928) Support GaussianMixture on Connect

2025-01-23 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-50928: - Assignee: Ruifeng Zheng > Support GaussianMixture on Connect >

[jira] [Resolved] (SPARK-50928) Support GaussianMixture on Connect

2025-01-23 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-50928. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49633 [https://

[jira] [Assigned] (SPARK-50935) Support DCT on Connect

2025-01-23 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-50935: - Assignee: Ruifeng Zheng > Support DCT on Connect > -- > >

[jira] [Resolved] (SPARK-50935) Support DCT on Connect

2025-01-23 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-50935. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49626 [https://

[jira] [Updated] (SPARK-50967) Document processing keys for FMGWS as part of initial state

2025-01-23 Thread Anish Shrigondekar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anish Shrigondekar updated SPARK-50967: --- Summary: Document processing keys for FMGWS as part of initial state (was: Skip pro

[jira] [Updated] (SPARK-50967) Document processing keys for FMGWS as part of initial state

2025-01-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50967: --- Labels: pull-request-available (was: ) > Document processing keys for FMGWS as part of init

[jira] [Created] (SPARK-50968) Fix the usage of `Column.__new__`.

2025-01-23 Thread Takuya Ueshin (Jira)
Takuya Ueshin created SPARK-50968: - Summary: Fix the usage of `Column.__new__`. Key: SPARK-50968 URL: https://issues.apache.org/jira/browse/SPARK-50968 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-50908) Fix flacky pyspark.sql.tests.pandas.test_pandas_transform_with_state.TransformWithStateInPandasTests

2025-01-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-50908. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 49634 [https://gi

[jira] [Assigned] (SPARK-50908) Fix flacky pyspark.sql.tests.pandas.test_pandas_transform_with_state.TransformWithStateInPandasTests

2025-01-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-50908: Assignee: Hyukjin Kwon > Fix flacky > pyspark.sql.tests.pandas.test_pandas_transform_wit