Re: [PR] Char varchar serde [spark]

2025-04-19 Thread via GitHub
github-actions[bot] closed pull request #49415: Char varchar serde URL: https://github.com/apache/spark/pull/49415 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscrib

Re: [PR] [SPARK-48334] [CORE] Release RpcEnv when SparkContext Initialization Fails [spark]

2025-04-19 Thread via GitHub
github-actions[bot] closed pull request #49292: [SPARK-48334] [CORE] Release RpcEnv when SparkContext Initialization Fails URL: https://github.com/apache/spark/pull/49292 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use th

Re: [PR] [SPARK-50469][SQL] V1Writes should respect the output ordering [spark]

2025-04-19 Thread via GitHub
github-actions[bot] commented on PR #49027: URL: https://github.com/apache/spark/pull/49027#issuecomment-2816921901 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue manageable.

Re: [PR] [SPARK-48334] [CORE] Release RpcEnv when SparkContext Initialization Fails [spark]

2025-04-19 Thread via GitHub
mridulm commented on code in PR #49292: URL: https://github.com/apache/spark/pull/49292#discussion_r2051572186 ## core/src/main/scala/org/apache/spark/SparkContext.scala: ## @@ -721,6 +723,15 @@ class SparkContext(config: SparkConf) extends Logging { } catch { case NonFa

Re: [PR] [SPARK-48334] [CORE] Release RpcEnv when SparkContext Initialization Fails [spark]

2025-04-19 Thread via GitHub
mridulm commented on code in PR #49292: URL: https://github.com/apache/spark/pull/49292#discussion_r2051572186 ## core/src/main/scala/org/apache/spark/SparkContext.scala: ## @@ -721,6 +723,15 @@ class SparkContext(config: SparkConf) extends Logging { } catch { case NonFa

Re: [PR] [SPARK-48334] [CORE] Release RpcEnv when SparkContext Initialization Fails [spark]

2025-04-19 Thread via GitHub
mridulm commented on code in PR #49292: URL: https://github.com/apache/spark/pull/49292#discussion_r2051572186 ## core/src/main/scala/org/apache/spark/SparkContext.scala: ## @@ -721,6 +723,15 @@ class SparkContext(config: SparkConf) extends Logging { } catch { case NonFa

Re: [PR] [SPARK-48568][SQL] Improve Performance of CodeFormatter [spark]

2025-04-19 Thread via GitHub
github-actions[bot] commented on PR #49261: URL: https://github.com/apache/spark/pull/49261#issuecomment-2816921889 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue manageable.

Re: [PR] [SPARK-50753][PYTHON] Add CachedAccessor for PySpark Plotting [spark]

2025-04-19 Thread via GitHub
github-actions[bot] closed pull request #49394: [SPARK-50753][PYTHON] Add CachedAccessor for PySpark Plotting URL: https://github.com/apache/spark/pull/49394 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

Re: [PR] [SPARK-49386][SPARK-27734][CORE][SQL] Add memory based thresholds for shuffle spill [spark]

2025-04-19 Thread via GitHub
mridulm commented on code in PR #47856: URL: https://github.com/apache/spark/pull/47856#discussion_r2051611504 ## core/src/main/scala/org/apache/spark/internal/config/package.scala: ## @@ -1582,6 +1582,16 @@ package object config { .intConf .createWithDefault(Integ

Re: [PR] [SPARK-51553][SQL] Modify EXTRACT to support TIME data type [spark]

2025-04-19 Thread via GitHub
MaxGekk commented on PR #50558: URL: https://github.com/apache/spark/pull/50558#issuecomment-2816592616 +1, LGTM. Merging to master. Thank you, @vinodkc. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [PR] [SPARK-51553][SQL] Modify EXTRACT to support TIME data type [spark]

2025-04-19 Thread via GitHub
MaxGekk closed pull request #50558: [SPARK-51553][SQL] Modify EXTRACT to support TIME data type URL: https://github.com/apache/spark/pull/50558 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

Re: [PR] [SPARK-51691][CORE] SerializationDebugger should swallow exception when try to find the reason of serialization problem [spark]

2025-04-19 Thread via GitHub
summaryzb commented on PR #50573: URL: https://github.com/apache/spark/pull/50573#issuecomment-2816594364 @LuciferYang done, PTAL -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

Re: [PR] [SPARK-51414][SQL] Add the make_time() function [spark]

2025-04-19 Thread via GitHub
MaxGekk commented on PR #50269: URL: https://github.com/apache/spark/pull/50269#issuecomment-2816594720 @robreeves There is a list of contributors of Apache Spark in JIRA. You wasn't in the list for some reasons (I guess, a previous committer forgot to add you). Now you are in the list. -

Re: [PR] [SPARK-51849][SQL] Refactoring `ResolveDDLCommandStringTypes` [spark]

2025-04-19 Thread via GitHub
vladimirg-db commented on code in PR #50609: URL: https://github.com/apache/spark/pull/50609#discussion_r2051488321 ## sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/ApplyDefaultCollationToStringType.scala: ## @@ -24,88 +24,72 @@ import org.apache.spark.sql.c

Re: [PR] [SPARK-51849][SQL] Refactoring `ResolveDDLCommandStringTypes` [spark]

2025-04-19 Thread via GitHub
vladimirg-db commented on code in PR #50609: URL: https://github.com/apache/spark/pull/50609#discussion_r2051488705 ## sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/ApplyDefaultCollationToStringType.scala: ## @@ -24,88 +24,72 @@ import org.apache.spark.sql.c

Re: [PR] [SPARK-50983][SQL]Part 1.a Add nested outer attributes for SubqueryExpression [spark]

2025-04-19 Thread via GitHub
mihailotim-db commented on code in PR #50285: URL: https://github.com/apache/spark/pull/50285#discussion_r2051423832 ## sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/FunctionTableSubqueryArgumentExpression.scala: ## @@ -86,11 +88,20 @@ case class Function

[PR] Minor update to example [spark]

2025-04-19 Thread via GitHub
CarterFendley opened a new pull request, #50647: URL: https://github.com/apache/spark/pull/50647 ### What changes were proposed in this pull request? Minor example update to prevent user error related to [CVE-2025-30065](https://nvd.nist.gov/vuln/detail/CVE-2025-30065).

Re: [PR] Minor update to example [spark]

2025-04-19 Thread via GitHub
CarterFendley commented on PR #50647: URL: https://github.com/apache/spark/pull/50647#issuecomment-2816806870 Based on discussion from #50583 cc: @HyukjinKwon @dongjoon-hyun -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi