Re: [PR] [SPARK-50871][BUILD] Upgrade `scala-parallel-collections` to 1.2.0 [spark]

2025-01-18 Thread via GitHub
LuciferYang commented on PR #49548: URL: https://github.com/apache/spark/pull/49548#issuecomment-2599626742 Thanks @dongjoon-hyun ~ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

Re: [PR] [SPARK-49014][BUILD][DOCS][FOLLOWUP] Synchronize the Avro version in `SparkBuild.scala/docs/comments to` 1.12.0. [spark]

2025-01-18 Thread via GitHub
LuciferYang commented on PR #49552: URL: https://github.com/apache/spark/pull/49552#issuecomment-2599626647 Thanks @dongjoon-hyun -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

Re: [PR] [SPARK-50868][BUILD] Upgrade `scalafmt` to 3.8.5 [spark]

2025-01-18 Thread via GitHub
LuciferYang commented on code in PR #49545: URL: https://github.com/apache/spark/pull/49545#discussion_r1921103851 ## connector/connect/client/jvm/src/main/scala/org/apache/spark/sql/SparkSession.scala: ## @@ -377,8 +377,8 @@ class SparkSession private[sql] ( */ @Since("4

Re: [PR] [WIP][SPARK-24815] [CORE] Trigger Interval based DRA for Structured Streaming [spark]

2025-01-18 Thread via GitHub
pkotikalapudi commented on PR #42352: URL: https://github.com/apache/spark/pull/42352#issuecomment-2599672230 Hi Folks, Whoever commenting on this PR and Interested in this feature, Please Subscribe to [dev mailing list ](https://spark.apache.org/community.html)and reply to [this email thr

[PR] [SPARK-50885][BUILD] Change to use `SbtPomKeys` to obtain `io.grpc.version` in `SparkBuild.scala` [spark]

2025-01-18 Thread via GitHub
LuciferYang opened a new pull request, #49562: URL: https://github.com/apache/spark/pull/49562 ### What changes were proposed in this pull request? ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change? ### How

Re: [PR] [SPARK-50885][BUILD] Change to use `SbtPomKeys` to obtain `io.grpc.version` in `SparkBuild.scala` [spark]

2025-01-18 Thread via GitHub
LuciferYang commented on code in PR #49562: URL: https://github.com/apache/spark/pull/49562#discussion_r1921047077 ## project/SparkBuild.scala: ## @@ -90,8 +90,6 @@ object BuildCommons { // Google Protobuf version used for generating the protobuf. // SPARK-41247: needs to

Re: [PR] [SPARK-50868][BUILD] Upgrade `scalafmt` to 3.8.5 [spark]

2025-01-18 Thread via GitHub
LuciferYang commented on PR #49545: URL: https://github.com/apache/spark/pull/49545#issuecomment-2599792745 I have checked locally and it is safe to merge this PR at the moment. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [PR] [SPARK-50868][BUILD] Upgrade `scalafmt` to 3.8.5 [spark]

2025-01-18 Thread via GitHub
LuciferYang commented on PR #49545: URL: https://github.com/apache/spark/pull/49545#issuecomment-2599793183 Merged into master/branch-4.0. Thanks @panbingkun Merging this into branch-4.0 is to avoid formatting conflicts with recent backports related to connect. -- This is an autom

Re: [PR] [SPARK-50868][BUILD] Upgrade `scalafmt` to 3.8.5 [spark]

2025-01-18 Thread via GitHub
LuciferYang closed pull request #49545: [SPARK-50868][BUILD] Upgrade `scalafmt` to 3.8.5 URL: https://github.com/apache/spark/pull/49545 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] [SPARK-50720][CORE] Support external shuffle service enablement in local-cluster mode [spark]

2025-01-18 Thread via GitHub
Ngone51 commented on code in PR #49350: URL: https://github.com/apache/spark/pull/49350#discussion_r1921068473 ## core/src/test/scala/org/apache/spark/deploy/ExternalShuffleServiceSuite.scala: ## @@ -102,14 +77,18 @@ class ExternalShuffleServiceSuite extends ShuffleSuite with B

Re: [PR] [SPARK-50868][BUILD] Upgrade `scalafmt` to 3.8.5 [spark]

2025-01-18 Thread via GitHub
LuciferYang commented on code in PR #49545: URL: https://github.com/apache/spark/pull/49545#discussion_r1921103851 ## connector/connect/client/jvm/src/main/scala/org/apache/spark/sql/SparkSession.scala: ## @@ -377,8 +377,8 @@ class SparkSession private[sql] ( */ @Since("4