jjayadeep06 commented on code in PR #50020:
URL: https://github.com/apache/spark/pull/50020#discussion_r1983092651
##
core/src/main/scala/org/apache/spark/BarrierCoordinator.scala:
##
@@ -80,8 +82,13 @@ private[spark] class BarrierCoordinator(
states.forEachValue(1, clear
srowen commented on code in PR #50209:
URL: https://github.com/apache/spark/pull/50209#discussion_r1986124610
##
connector/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/consumer/FetchedDataPool.scala:
##
@@ -139,7 +139,7 @@ private[consumer] class FetchedDataPool(
srowen commented on code in PR #50209:
URL: https://github.com/apache/spark/pull/50209#discussion_r1986206274
##
connector/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/consumer/FetchedDataPool.scala:
##
@@ -139,7 +139,7 @@ private[consumer] class FetchedDataPool(
beliefer commented on code in PR #50209:
URL: https://github.com/apache/spark/pull/50209#discussion_r1986207234
##
connector/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/consumer/FetchedDataPool.scala:
##
@@ -139,7 +139,7 @@ private[consumer] class FetchedDataPool
srowen commented on PR #50187:
URL: https://github.com/apache/spark/pull/50187#issuecomment-2708415916
Can the examples module simply point to SNAPSHOT versions like everything
else in the build? the main branch code is always pointing at unreleased code,
but on release, those SNAPSHOT vers
LuciferYang commented on PR #50187:
URL: https://github.com/apache/spark/pull/50187#issuecomment-2708419792
> Can the examples module simply point to SNAPSHOT versions like everything
else in the build? the main branch code is always pointing at unreleased code,
but on release, those SNAPSH
hvanhovell commented on PR #50187:
URL: https://github.com/apache/spark/pull/50187#issuecomment-2704355339
@HyukjinKwon can you take a look?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the sp
AryelSouza opened a new pull request, #50216:
URL: https://github.com/apache/spark/pull/50216
an issue was open about the necessity of changing host to ip because ip
would be deprecated for the documentation
--
This is an automated message from the Apache Git Service.
To respond to th
vrozov commented on PR #49928:
URL: https://github.com/apache/spark/pull/49928#issuecomment-2708396116
@cloud-fan @LuciferYang I prefer to keep the test in the java as it does not
hurt and
1. There is similar test in R even though it is not R specific
2. Other tests in `JavaDataFr
beliefer commented on code in PR #50209:
URL: https://github.com/apache/spark/pull/50209#discussion_r1986190446
##
connector/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/consumer/FetchedDataPool.scala:
##
@@ -139,7 +139,7 @@ private[consumer] class FetchedDataPool
srowen commented on code in PR #50209:
URL: https://github.com/apache/spark/pull/50209#discussion_r1986190918
##
connector/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/consumer/FetchedDataPool.scala:
##
@@ -139,7 +139,7 @@ private[consumer] class FetchedDataPool(
github-actions[bot] commented on PR #48974:
URL: https://github.com/apache/spark/pull/48974#issuecomment-2708582247
We're closing this PR because it hasn't been updated in a while. This isn't
a judgement on the merit of the PR in any way. It's just a way of keeping the
PR queue manageable.
beliefer commented on code in PR #50209:
URL: https://github.com/apache/spark/pull/50209#discussion_r1986202471
##
connector/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/consumer/FetchedDataPool.scala:
##
@@ -139,7 +139,7 @@ private[consumer] class FetchedDataPool
beliefer commented on code in PR #50209:
URL: https://github.com/apache/spark/pull/50209#discussion_r1986202471
##
connector/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/consumer/FetchedDataPool.scala:
##
@@ -139,7 +139,7 @@ private[consumer] class FetchedDataPool
dongjoon-hyun commented on code in PR #50206:
URL: https://github.com/apache/spark/pull/50206#discussion_r1986220526
##
.github/workflows/build_maven_java21_macos15.yml:
##
@@ -36,5 +36,9 @@ jobs:
os: macos-15
envs: >-
{
- "OBJC_DISABLE_INITIALIZE
LuciferYang commented on code in PR #50206:
URL: https://github.com/apache/spark/pull/50206#discussion_r1986220726
##
.github/workflows/build_maven_java21_macos15.yml:
##
@@ -36,5 +36,9 @@ jobs:
os: macos-15
envs: >-
{
- "OBJC_DISABLE_INITIALIZE_F
dongjoon-hyun commented on code in PR #50206:
URL: https://github.com/apache/spark/pull/50206#discussion_r1986220526
##
.github/workflows/build_maven_java21_macos15.yml:
##
@@ -36,5 +36,9 @@ jobs:
os: macos-15
envs: >-
{
- "OBJC_DISABLE_INITIALIZE
LuciferYang opened a new pull request, #50218:
URL: https://github.com/apache/spark/pull/50218
### What changes were proposed in this pull request?
### Why are the changes needed?
### Does this PR introduce _any_ user-facing change?
### How
MaxGekk commented on code in PR #50194:
URL: https://github.com/apache/spark/pull/50194#discussion_r1986236836
##
dev/create-release/release-build.sh:
##
@@ -137,6 +137,12 @@ if [[ "$1" == "finalize" ]]; then
--repository-url https://upload.pypi.org/legacy/ \
"pyspark_
beliefer commented on PR #50209:
URL: https://github.com/apache/spark/pull/50209#issuecomment-2708241246
ping @srowen @dongjoon-hyun @LuciferYang
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
vicennial commented on PR #50193:
URL: https://github.com/apache/spark/pull/50193#issuecomment-2708400817
Putting this on hold ATM as some unexpected complications popped up
(particularly the interactions with response indices and response caching)
--
This is an automated message from the
sandip-db commented on code in PR #50052:
URL: https://github.com/apache/spark/pull/50052#discussion_r1986121542
##
sql/core/src/test/scala/org/apache/spark/sql/CsvFunctionsSuite.scala:
##
@@ -760,12 +760,9 @@ class CsvFunctionsSuite extends QueryTest with
SharedSparkSession {
cloud-fan commented on code in PR #49471:
URL: https://github.com/apache/spark/pull/49471#discussion_r1982863500
##
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/SessionCatalog.scala:
##
@@ -1675,6 +1676,91 @@ class SessionCatalog(
}
}
+ /**
+ *
cloud-fan commented on PR #49955:
URL: https://github.com/apache/spark/pull/49955#issuecomment-2705416036
@peter-toth Ideally recursive CTE should stop if the last iteration
generates no data. Pushing down the LIMIT and applying an early stop is an
optimization and should not change the qu
chenhao-db opened a new pull request, #50217:
URL: https://github.com/apache/spark/pull/50217
### What changes were proposed in this pull request?
The current JSON `singleVariantColumn` mode doesn't work in DSv2 and
`spark.readStream`. This PR fixes the two cases:
- DSv1 calls `Jso
hidataplus commented on code in PR #48823:
URL: https://github.com/apache/spark/pull/48823#discussion_r1986028539
##
sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala:
##
@@ -1030,7 +1030,7 @@ private[spark] class HiveExternalCatalog(conf: SparkConf,
h
LuciferYang commented on PR #50187:
URL: https://github.com/apache/spark/pull/50187#issuecomment-2708296150
I've noticed a rather peculiar issue here. It seems that the
`connect-examples` project is dependent on a released version of Spark, which
means we can only update to a new version af
ganeshashree opened a new pull request, #50215:
URL: https://github.com/apache/spark/pull/50215
### What changes were proposed in this pull request?
Changes done to set INT64 as the default timestamp type for Parquet files.
### Why are the changes needed?
attilapiros commented on code in PR #50122:
URL: https://github.com/apache/spark/pull/50122#discussion_r1986090749
##
core/src/test/scala/org/apache/spark/storage/BlockManagerSuite.scala:
##
@@ -474,6 +474,26 @@ class BlockManagerSuite extends SparkFunSuite with
Matchers with P
hidataplus commented on code in PR #48823:
URL: https://github.com/apache/spark/pull/48823#discussion_r1986020465
##
sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClientImpl.scala:
##
@@ -177,8 +179,10 @@ private[hive] class HiveClientImpl(
// got changed. We
LuciferYang commented on PR #50206:
URL: https://github.com/apache/spark/pull/50206#issuecomment-2708248561
The PR title and description will be updated after the finalization of the
plan.
--
This is an automated message from the Apache Git Service.
To respond to the message, plea
LuciferYang commented on PR #49928:
URL: https://github.com/apache/spark/pull/49928#issuecomment-2708280968
> @vrozov can you remove the java test? [#49928
(comment)](https://github.com/apache/spark/pull/49928#discussion_r1981021185)
+1, for @cloud-fan's comments
--
This is an auto
32 matches
Mail list logo
