dongjoon-hyun opened a new pull request, #75:
URL: https://github.com/apache/spark-connect-swift/pull/75
### What changes were proposed in this pull request?
### Why are the changes needed?
### Does this PR introduce _any_ user-facing change?
zhengruifeng closed pull request #50650:
[SPARK-51838][PYTHON][TESTS][FOLLWO-UP] Skip `test_wildcard_import` in low
python versions
URL: https://github.com/apache/spark/pull/50650
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub
zhengruifeng commented on PR #50650:
URL: https://github.com/apache/spark/pull/50650#issuecomment-2817490433
merged to master
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
LuciferYang closed pull request #50573: [SPARK-51691][CORE]
SerializationDebugger should swallow exception when try to find the reason of
serialization problem
URL: https://github.com/apache/spark/pull/50573
--
This is an automated message from the Apache Git Service.
To respond to the messa
LuciferYang commented on PR #50573:
URL: https://github.com/apache/spark/pull/50573#issuecomment-2817497841
Merged into master. Thanks @summaryzb and @mridulm
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL ab
dongjoon-hyun commented on PR #75:
URL:
https://github.com/apache/spark-connect-swift/pull/75#issuecomment-2817618006
Let me merge this because this is an extension of the existing API.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on t
dongjoon-hyun closed pull request #75: [SPARK-51853] Improve `DataFrame.show`
API to support all signatures
URL: https://github.com/apache/spark-connect-swift/pull/75
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
UR
dongjoon-hyun opened a new pull request, #76:
URL: https://github.com/apache/spark-connect-swift/pull/76
…
### What changes were proposed in this pull request?
### Why are the changes needed?
### Does this PR introduce _any_ user-facing change?
dongjoon-hyun commented on PR #76:
URL:
https://github.com/apache/spark-connect-swift/pull/76#issuecomment-2817640576
Thank you so much, @viirya ~
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
viirya commented on PR #76:
URL:
https://github.com/apache/spark-connect-swift/pull/76#issuecomment-2817640294
Nice cleanup!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
dongjoon-hyun closed pull request #76: [SPARK-51854] Remove `SwiftyTextTable`
dependency and unused `import` statements
URL: https://github.com/apache/spark-connect-swift/pull/76
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub an
dongjoon-hyun commented on PR #76:
URL:
https://github.com/apache/spark-connect-swift/pull/76#issuecomment-2817642471
Merged to main.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific
HyukjinKwon closed pull request #50651: [SPARK-51838][PYTHON][TESTS][FOLLOW-UP]
Skip `test_wildcard_import` in Python 3.10 and below
URL: https://github.com/apache/spark/pull/50651
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub
HyukjinKwon commented on PR #50651:
URL: https://github.com/apache/spark/pull/50651#issuecomment-2817653905
Merged to master.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
HeartSaVioR commented on code in PR #50572:
URL: https://github.com/apache/spark/pull/50572#discussion_r2051420015
##
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala:
##
@@ -2569,10 +2569,11 @@ object SQLConf {
.internal()
.doc("State format
mridulm commented on code in PR #47856:
URL: https://github.com/apache/spark/pull/47856#discussion_r2051909101
##
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala:
##
@@ -3148,6 +3148,14 @@ object SQLConf {
.intConf
.createWithDefault(SHUFFL
zhengruifeng commented on PR #50644:
URL: https://github.com/apache/spark/pull/50644#issuecomment-2817547329
remove `[TESTS]` from title since it seems a new user-facing feature
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub
zhengruifeng commented on PR #50643:
URL: https://github.com/apache/spark/pull/50643#issuecomment-2817565670
cc @WeichenXu123
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment
HyukjinKwon commented on PR #50650:
URL: https://github.com/apache/spark/pull/50650#issuecomment-2817595101
reverted:
```
Traceback (most recent call last):
File "", line 198, in _run_module_as_main
File "", line 88, in _run_code
File "/__w/spark/spark/python/pyspark/
HyukjinKwon commented on PR #50651:
URL: https://github.com/apache/spark/pull/50651#issuecomment-2817597557
cc @zhengruifeng
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
HyukjinKwon opened a new pull request, #50651:
URL: https://github.com/apache/spark/pull/50651
### What changes were proposed in this pull request?
Retry of https://github.com/apache/spark/pull/50650.
### Why are the changes needed?
To make the build passing.
### D
cloud-fan commented on PR #50629:
URL: https://github.com/apache/spark/pull/50629#issuecomment-2817683112
thanks, merging to master!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific c
cloud-fan closed pull request #50629: [SPARK-51833][SQL] Normalize relations in
NormalizePlan
URL: https://github.com/apache/spark/pull/50629
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the spec
dongjoon-hyun opened a new pull request, #77:
URL: https://github.com/apache/spark-connect-swift/pull/77
### What changes were proposed in this pull request?
### Why are the changes needed?
### Does this PR introduce _any_ user-facing change?
viirya commented on code in PR #77:
URL:
https://github.com/apache/spark-connect-swift/pull/77#discussion_r2052018258
##
Package.swift:
##
@@ -49,6 +49,10 @@ let package = Package(
.product(name: "FlatBuffers", package: "flatbuffers"),
]
),
+.executable
dongjoon-hyun commented on code in PR #77:
URL:
https://github.com/apache/spark-connect-swift/pull/77#discussion_r2052035069
##
Package.swift:
##
@@ -49,6 +49,10 @@ let package = Package(
.product(name: "FlatBuffers", package: "flatbuffers"),
]
),
+.exe
dongjoon-hyun closed pull request #77: [SPARK-51855] Support `Spark SQL REPL`
URL: https://github.com/apache/spark-connect-swift/pull/77
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific c
dongjoon-hyun commented on PR #72:
URL:
https://github.com/apache/spark-connect-swift/pull/72#issuecomment-2817355093
Thank you, @viirya ! Merged to main.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above
dongjoon-hyun commented on PR #73:
URL:
https://github.com/apache/spark-connect-swift/pull/73#issuecomment-2817355308
Thank you, @viirya ! Merged to main.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above
dongjoon-hyun closed pull request #72: [SPARK-51850] Fix `DataFrame.execute` to
reset previously received Arrow batch data
URL: https://github.com/apache/spark-connect-swift/pull/72
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub
dongjoon-hyun closed pull request #73: [SPARK-51851] Refactor to use `withGPRC`
wrappers
URL: https://github.com/apache/spark-connect-swift/pull/73
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to th
dongjoon-hyun opened a new pull request, #74:
URL: https://github.com/apache/spark-connect-swift/pull/74
### What changes were proposed in this pull request?
### Why are the changes needed?
### Does this PR introduce _any_ user-facing change?
HyukjinKwon commented on PR #50587:
URL: https://github.com/apache/spark/pull/50587#issuecomment-2817385311
Thanks, made a Pr at https://github.com/apache/spark/pull/50648
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and us
HyukjinKwon opened a new pull request, #50648:
URL: https://github.com/apache/spark/pull/50648
### What changes were proposed in this pull request?
This PR is a followup of https://github.com/apache/spark/pull/50587 that
logs strings properly instead of `Option`s
### Why are th
HyukjinKwon commented on PR #47493:
URL: https://github.com/apache/spark/pull/47493#issuecomment-2817385415
Python 3.9 is being EOL soon. Can we drop Python 3.9 in the master branch,
and land this change?
--
This is an automated message from the Apache Git Service.
To respond to the messa
HyukjinKwon commented on PR #50647:
URL: https://github.com/apache/spark/pull/50647#issuecomment-2817386276
Let's fix the linter tho.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific
HyukjinKwon closed pull request #50646: [SPARK-51848][SQL] Fix parsing XML
records with defined schema of array/structs/map of Variant
URL: https://github.com/apache/spark/pull/50646
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHu
HyukjinKwon commented on PR #50646:
URL: https://github.com/apache/spark/pull/50646#issuecomment-2817386781
Merged to master.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
HyukjinKwon commented on PR #50644:
URL: https://github.com/apache/spark/pull/50644#issuecomment-2817386689
cc @asl3 fyi
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To
zhengruifeng opened a new pull request, #50650:
URL: https://github.com/apache/spark/pull/50650
Skip `test_wildcard_import` in low python versions, to address
https://github.com/apache/spark/pull/50634
--
This is an automated message from the Apache Git Service.
To respond to the message,
HyukjinKwon commented on PR #50649:
URL: https://github.com/apache/spark/pull/50649#issuecomment-2817464427
Merged to master.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
zhengruifeng commented on PR #50634:
URL: https://github.com/apache/spark/pull/50634#issuecomment-2817431389
> Hmm.. seems like it fails with lower Python version:
https://github.com/apache/spark/actions/runs/14561562068/job/40845550392
>
> ```
> ===
github-actions[bot] closed pull request #49027: [SPARK-50469][SQL] V1Writes
should respect the output ordering
URL: https://github.com/apache/spark/pull/49027
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above
HyukjinKwon closed pull request #50649: [SPARK-51814][SS][PYTHON][FOLLOW-UP]
Add pyspark.sql.tests.pandas.helper for testing pyspark-client
URL: https://github.com/apache/spark/pull/50649
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
HyukjinKwon commented on code in PR #47856:
URL: https://github.com/apache/spark/pull/47856#discussion_r2051888096
##
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala:
##
@@ -3148,6 +3148,14 @@ object SQLConf {
.intConf
.createWithDefault(SH
dongjoon-hyun commented on PR #74:
URL:
https://github.com/apache/spark-connect-swift/pull/74#issuecomment-2817409795
Could you review this PR when you have some time, @HyukjinKwon ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to G
HyukjinKwon commented on PR #50648:
URL: https://github.com/apache/spark/pull/50648#issuecomment-2817420418
Merged to master.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
dongjoon-hyun closed pull request #74: [SPARK-51852] Support
`SPARK_CONNECT_AUTHENTICATE_TOKEN`
URL: https://github.com/apache/spark-connect-swift/pull/74
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to g
zhengruifeng commented on PR #50640:
URL: https://github.com/apache/spark/pull/50640#issuecomment-2817420394
merged to master
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
HyukjinKwon closed pull request #50648: [SPARK-51688][PYTHON][FOLLOW-UP] Log
string instead of option instance
URL: https://github.com/apache/spark/pull/50648
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above
zhengruifeng closed pull request #50641: [SPARK-51844][PYTHON][TESTS] Add
ReusedMixedTestCase for test env with both classic and connect
URL: https://github.com/apache/spark/pull/50641
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to Git
zhengruifeng closed pull request #50640: [SPARK-51843][PYTHON][ML][TESTS] Avoid
per-test classic session start & stop
URL: https://github.com/apache/spark/pull/50640
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
zhengruifeng commented on PR #50641:
URL: https://github.com/apache/spark/pull/50641#issuecomment-2817421514
merged to master
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
dongjoon-hyun commented on PR #74:
URL:
https://github.com/apache/spark-connect-swift/pull/74#issuecomment-2817418517
Thank you, @HyukjinKwon ! Merged to main.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL a
HyukjinKwon opened a new pull request, #50649:
URL: https://github.com/apache/spark/pull/50649
### What changes were proposed in this pull request?
This PR is a followup of https://github.com/apache/spark/pull/50600 that
adds `pyspark.sql.tests.pandas.helper` for testing `pyspark-clie
HyukjinKwon commented on PR #50649:
URL: https://github.com/apache/spark/pull/50649#issuecomment-2817424752
cc @HeartSaVioR FYI
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific commen
github-actions[bot] closed pull request #49261: [SPARK-48568][SQL] Improve
Performance of CodeFormatter
URL: https://github.com/apache/spark/pull/49261
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go t
dongjoon-hyun opened a new pull request, #72:
URL: https://github.com/apache/spark-connect-swift/pull/72
…
### What changes were proposed in this pull request?
### Why are the changes needed?
### Does this PR introduce _any_ user-facing change?
dongjoon-hyun closed pull request #50623: [SPARK-51840][SQL] Restore Partition
columns in HiveExternalCatalog#alterTable
URL: https://github.com/apache/spark/pull/50623
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
dongjoon-hyun commented on PR #50623:
URL: https://github.com/apache/spark/pull/50623#issuecomment-2817124195
Merged to master for Apache Spark 4.1.0. Thank you, @yaooqinn .
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and
dongjoon-hyun opened a new pull request, #73:
URL: https://github.com/apache/spark-connect-swift/pull/73
### What changes were proposed in this pull request?
### Why are the changes needed?
### Does this PR introduce _any_ user-facing change?
61 matches
Mail list logo
