beliefer commented on PR #50046:
URL: https://github.com/apache/spark/pull/50046#issuecomment-2676739969
Merged into branch-4.0/master
@LuciferYang Thank you!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
beliefer closed pull request #50047: [SPARK-51292][SQL] Remove unnecessary
inheritance from PlanTestBase, ExpressionEvalHelper and PlanTest
URL: https://github.com/apache/spark/pull/50047
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
LuciferYang closed pull request #50049:
[SPARK-51293][CORE][SQL][SS][MLLIB][TESTS] Cleanup unused private functions
from test suites
URL: https://github.com/apache/spark/pull/50049
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub
LuciferYang commented on PR #50049:
URL: https://github.com/apache/spark/pull/50049#issuecomment-2676746744
Merged into master. Thanks @dongjoon-hyun and @beliefer
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
U
beliefer commented on PR #50047:
URL: https://github.com/apache/spark/pull/50047#issuecomment-2676747067
Merged into branch-4.0/master
@LuciferYang Thank you!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
chenhao-db opened a new pull request, #50052:
URL: https://github.com/apache/spark/pull/50052
### What changes were proposed in this pull request?
### Why are the changes needed?
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch te
stefankandic opened a new pull request, #50053:
URL: https://github.com/apache/spark/pull/50053
### What changes were proposed in this pull request?
### Why are the changes needed?
### Does this PR introduce _any_ user-facing change?
### Ho
dusantism-db commented on code in PR #50027:
URL: https://github.com/apache/spark/pull/50027#discussion_r1966931924
##
sql/core/src/main/scala/org/apache/spark/sql/scripting/SqlScriptingExecutionNode.scala:
##
@@ -599,6 +599,116 @@ class CaseStatementExec(
}
}
+/**
+ * Exe
dusantism-db commented on code in PR #50027:
URL: https://github.com/apache/spark/pull/50027#discussion_r1966944493
##
sql/core/src/main/scala/org/apache/spark/sql/scripting/SqlScriptingExecutionNode.scala:
##
@@ -599,6 +599,116 @@ class CaseStatementExec(
}
}
+/**
+ * Exe
HyukjinKwon opened a new pull request, #50054:
URL: https://github.com/apache/spark/pull/50054
### What changes were proposed in this pull request?
This PR fixes the installation page for PySpark to clarify spark.remote and
spark.master in pyspark-connect and pyspark-client at install
HyukjinKwon commented on code in PR #50053:
URL: https://github.com/apache/spark/pull/50053#discussion_r1966967731
##
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/ResolveDDLCommandStringTypes.scala:
##
@@ -28,6 +29,10 @@ import org.apache.spark.sql.types.{D
HyukjinKwon commented on PR #50050:
URL: https://github.com/apache/spark/pull/50050#issuecomment-2677269920
Merged to master and branch-4.0.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the sp
wangyum commented on PR #50004:
URL: https://github.com/apache/spark/pull/50004#issuecomment-2677280562
```scala
spark.sql("set spark.sql.autoBroadcastJoinThreshold=-1")
spark.range(1000).selectExpr("id", "id + 1 as
new_id").write.saveAsTable("t1")
spark.range(10).selectExpr("id
HyukjinKwon closed pull request #50050: [SPARK-51294][SQL][CONNECT][TESTS]
Improve the readability by split the variable of jars and configs for
SparkConnectServerUtils.
URL: https://github.com/apache/spark/pull/50050
--
This is an automated message from the Apache Git Service.
To respond to
llphxd commented on PR #50048:
URL: https://github.com/apache/spark/pull/50048#issuecomment-2676709230
> > I would love to, but I failed to register jira and have to wait 24
hours. So I'll create the issue later.
>
> Please tell me if the issue is ready.
issue is ready.
[ht
beliefer closed pull request #50046: [SPARK-51258][SQL][FOLLOWUP] Remove
unnecessary inheritance from SQLConfHelper
URL: https://github.com/apache/spark/pull/50046
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL a
ahshahid commented on code in PR #50033:
URL: https://github.com/apache/spark/pull/50033#discussion_r1966860945
##
core/src/test/scala/org/apache/spark/scheduler/DAGSchedulerSuite.scala:
##
@@ -3185,16 +3217,103 @@ class DAGSchedulerSuite extends SparkFunSuite with
TempLocalSpa
dusantism-db commented on code in PR #50027:
URL: https://github.com/apache/spark/pull/50027#discussion_r1966944493
##
sql/core/src/main/scala/org/apache/spark/sql/scripting/SqlScriptingExecutionNode.scala:
##
@@ -599,6 +599,116 @@ class CaseStatementExec(
}
}
+/**
+ * Exe
dusantism-db commented on code in PR #50027:
URL: https://github.com/apache/spark/pull/50027#discussion_r1966944963
##
sql/core/src/main/scala/org/apache/spark/sql/scripting/SqlScriptingExecutionNode.scala:
##
@@ -599,6 +599,116 @@ class CaseStatementExec(
}
}
+/**
+ * Exe
github-actions[bot] commented on PR #48861:
URL: https://github.com/apache/spark/pull/48861#issuecomment-2677214294
We're closing this PR because it hasn't been updated in a while. This isn't
a judgement on the merit of the PR in any way. It's just a way of keeping the
PR queue manageable.
github-actions[bot] closed pull request #48825: [SPARK-50292] Add MapStatus
RowCount optimize skewed job
URL: https://github.com/apache/spark/pull/48825
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go
github-actions[bot] commented on PR #48849:
URL: https://github.com/apache/spark/pull/48849#issuecomment-2677214302
We're closing this PR because it hasn't been updated in a while. This isn't
a judgement on the merit of the PR in any way. It's just a way of keeping the
PR queue manageable.
HyukjinKwon closed pull request #50054: [MINOR][DOCS] Clarify spark.remote and
spark.master in pyspark-connect and pyspark-client at install.rst
URL: https://github.com/apache/spark/pull/50054
--
This is an automated message from the Apache Git Service.
To respond to the message, please log o
HyukjinKwon commented on PR #50054:
URL: https://github.com/apache/spark/pull/50054#issuecomment-2677426348
Merged to master and branch-4.0.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the sp
jiwen624 commented on PR #50055:
URL: https://github.com/apache/spark/pull/50055#issuecomment-2677443309
@dongjoon-hyun @cloud-fan could you let me know your thoughts about this
fix? Thanks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log
zhengruifeng commented on PR #50041:
URL: https://github.com/apache/spark/pull/50041#issuecomment-2677458005
Let me convert it to draft for now, to make it easy to debug another issue
https://issues.apache.org/jira/browse/SPARK-51118
--
This is an automated message from the Apache Git Ser
beliefer commented on code in PR #50040:
URL: https://github.com/apache/spark/pull/50040#discussion_r1967061151
##
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala:
##
@@ -5545,6 +5545,15 @@ object SQLConf {
.booleanConf
.createWithDefault(false)
beliefer commented on code in PR #50040:
URL: https://github.com/apache/spark/pull/50040#discussion_r1967072225
##
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala:
##
@@ -5545,6 +5545,15 @@ object SQLConf {
.booleanConf
.createWithDefault(false)
itholic opened a new pull request, #50056:
URL: https://github.com/apache/spark/pull/50056
### What changes were proposed in this pull request?
This PR proposes to fix broken link for `ps.sql`
### Why are the changes needed?
There is broken link in official documentation
zhengruifeng commented on code in PR #49941:
URL: https://github.com/apache/spark/pull/49941#discussion_r1967091437
##
python/pyspark/sql/conversion.py:
##
@@ -0,0 +1,543 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreement
pan3793 opened a new pull request, #50057:
URL: https://github.com/apache/spark/pull/50057
### What changes were proposed in this pull request?
Bump zstd-jni to the latest version.
### Why are the changes needed?
https://github.com/facebook/zstd/releases/tag/v1.5.
pan3793 commented on PR #50057:
URL: https://github.com/apache/spark/pull/50057#issuecomment-2677646689
cc @dongjoon-hyun @LuciferYang
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specifi
davidm-db commented on code in PR #50027:
URL: https://github.com/apache/spark/pull/50027#discussion_r1967153704
##
sql/core/src/main/scala/org/apache/spark/sql/scripting/SqlScriptingExecutionNode.scala:
##
@@ -599,6 +599,116 @@ class CaseStatementExec(
}
}
+/**
+ * Execut
cloud-fan commented on code in PR #50026:
URL: https://github.com/apache/spark/pull/50026#discussion_r1967012051
##
sql/core/src/main/scala/org/apache/spark/sql/scripting/SqlScriptingExecutionNode.scala:
##
@@ -206,6 +207,15 @@ class TriggerToExceptionHandlerMap(
def getNotFo
wangyum commented on PR #50022:
URL: https://github.com/apache/spark/pull/50022#issuecomment-2677370449
@shrprasa Does it work after applying the patch?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to
dongjoon-hyun commented on code in PR #50040:
URL: https://github.com/apache/spark/pull/50040#discussion_r1967023059
##
sql/core/src/test/scala/org/apache/spark/sql/DataFrameWriterV2Suite.scala:
##
@@ -839,4 +839,26 @@ class DataFrameWriterV2Suite extends QueryTest with
SharedS
dongjoon-hyun commented on code in PR #50040:
URL: https://github.com/apache/spark/pull/50040#discussion_r1967023059
##
sql/core/src/test/scala/org/apache/spark/sql/DataFrameWriterV2Suite.scala:
##
@@ -839,4 +839,26 @@ class DataFrameWriterV2Suite extends QueryTest with
SharedS
cloud-fan commented on code in PR #50040:
URL: https://github.com/apache/spark/pull/50040#discussion_r1966991532
##
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala:
##
@@ -5545,6 +5545,15 @@ object SQLConf {
.booleanConf
.createWithDefault(false
pan3793 commented on code in PR #50022:
URL: https://github.com/apache/spark/pull/50022#discussion_r1967007721
##
sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClientImpl.scala:
##
@@ -1407,13 +1409,62 @@ private[hive] object HiveClientImpl extends Logging {
beliefer commented on PR #50048:
URL: https://github.com/apache/spark/pull/50048#issuecomment-2677392603
Merged into branch-4.0/master
@llphxd @HyukjinKwon @yaooqinn Thank you all!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to G
jiwen624 opened a new pull request, #50055:
URL: https://github.com/apache/spark/pull/50055
### What changes were proposed in this pull request?
This PR proposes to use `initValue` of a metric in
`org.apache.spark.util.MetricUtils.stringValue` instead of a hardcoded init
value to filter
pan3793 commented on code in PR #50022:
URL: https://github.com/apache/spark/pull/50022#discussion_r1967004950
##
sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala:
##
@@ -81,14 +82,18 @@ private[spark] class HiveExternalCatalog(conf: SparkConf,
hadoop
beliefer commented on PR #50050:
URL: https://github.com/apache/spark/pull/50050#issuecomment-2677381793
@HyukjinKwon Thank you very much!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the spec
beliefer closed pull request #50048: [SPARK-51297][DOCS] Fixed the scope of the
query option in sql-data-sources-jdbc.md
URL: https://github.com/apache/spark/pull/50048
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
itholic commented on code in PR #50038:
URL: https://github.com/apache/spark/pull/50038#discussion_r1967030513
##
python/pyspark/logger/logger.py:
##
@@ -66,10 +67,21 @@ def format(self, record: logging.LogRecord) -> str:
}
if record.exc_info:
exc_
HyukjinKwon commented on code in PR #50054:
URL: https://github.com/apache/spark/pull/50054#discussion_r1967033629
##
python/docs/source/getting_started/install.rst:
##
@@ -96,9 +96,7 @@ If you want to make Spark Connect default, you can install
and additional librar
It will a
HyukjinKwon commented on code in PR #50054:
URL: https://github.com/apache/spark/pull/50054#discussion_r1967033498
##
python/docs/source/getting_started/install.rst:
##
@@ -96,9 +96,7 @@ If you want to make Spark Connect default, you can install
and additional librar
It will a
dongjoon-hyun commented on code in PR #50054:
URL: https://github.com/apache/spark/pull/50054#discussion_r1967034041
##
python/docs/source/getting_started/install.rst:
##
@@ -96,9 +96,7 @@ If you want to make Spark Connect default, you can install
and additional librar
It will
dongjoon-hyun commented on code in PR #50054:
URL: https://github.com/apache/spark/pull/50054#discussion_r1967030929
##
python/docs/source/getting_started/install.rst:
##
@@ -96,9 +96,7 @@ If you want to make Spark Connect default, you can install
and additional librar
It will
49 matches
Mail list logo
