Messages by Date
-
2025/09/19
[jira] [Created] (SPARK-53650) Make `build.gradle` and `libs.versions.toml` up-to-date with `okhttp3` usage
Dongjoon Hyun (Jira)
-
2025/09/19
[jira] [Updated] (SPARK-53650) Make `build.gradle` and `libs.versions.toml` up-to-date with `okhttp3` usage
ASF GitHub Bot (Jira)
-
2025/09/19
[jira] [Resolved] (SPARK-53648) Use `VertxHttpClientFactory` instead of `OkHttpClientFactory`
Dongjoon Hyun (Jira)
-
2025/09/19
[jira] [Resolved] (SPARK-53647) Use `io.fabric8.kubernetes.client.http.Interceptor` instead of `okhttp3.Interceptor`
Dongjoon Hyun (Jira)
-
2025/09/19
[jira] [Created] (SPARK-53649) Remove `logging-interceptor` dependency
Dongjoon Hyun (Jira)
-
2025/09/19
[jira] [Resolved] (SPARK-53649) Remove `logging-interceptor` dependency
Dongjoon Hyun (Jira)
-
2025/09/19
[jira] [Assigned] (SPARK-53649) Remove `logging-interceptor` dependency
Dongjoon Hyun (Jira)
-
2025/09/19
[jira] [Commented] (SPARK-46912) Spark-submit in cluster mode with standalone cluster uses wrong JAVA_HOME path
Aparna Garg (Jira)
-
2025/09/19
[jira] [Updated] (SPARK-53647) Use `io.fabric8.kubernetes.client.http.Interceptor` instead of `okhttp3.Interceptor`
ASF GitHub Bot (Jira)
-
2025/09/19
[jira] [Created] (SPARK-53647) Use `io.fabric8.kubernetes.client.http.Interceptor` instead of `okhttp3.Interceptor`
Dongjoon Hyun (Jira)
-
2025/09/19
[jira] [Commented] (SPARK-51051) array_position function should accept an optional 'start_index' parameter
Aparna Garg (Jira)
-
2025/09/19
[jira] [Commented] (SPARK-52937) Add support for pipeline sinks
Aparna Garg (Jira)
-
2025/09/19
[jira] [Assigned] (SPARK-53646) Improve `KubernetesMetricsInterceptorTest` to verify `http.request` metric
Dongjoon Hyun (Jira)
-
2025/09/19
[jira] [Updated] (SPARK-53646) Improve `KubernetesMetricsInterceptorTest` to verify `http.request` metric
ASF GitHub Bot (Jira)
-
2025/09/19
[jira] [Commented] (SPARK-53596) Put translatable filters to the left side of untranslatable filters
Aparna Garg (Jira)
-
2025/09/19
[jira] [Commented] (SPARK-37753) Fine tune logic to demote Broadcast hash join in DynamicJoinSelection
Aparna Garg (Jira)
-
2025/09/19
[jira] [Commented] (SPARK-52401) Unexpected behavior when using .collect() after modifying an external Spark table
Aparna Garg (Jira)
-
2025/09/19
[jira] [Commented] (SPARK-52545) Handle `""` as `"` in double quoted literal
Aparna Garg (Jira)
-
2025/09/19
[jira] [Commented] (SPARK-52505) Connection timeout on Kubernetes to decommissioned executor
Aparna Garg (Jira)
-
2025/09/19
[jira] [Commented] (SPARK-52507) Quick fallback to fallback storage on fetch failure
Aparna Garg (Jira)
-
2025/09/19
[jira] [Updated] (SPARK-53645) Implement skipna parameter for any()
ASF GitHub Bot (Jira)
-
2025/09/19
[jira] [Commented] (SPARK-46166) Add axis and skipna parameters to DataFrame.any
Peter Nguyen (Jira)
-
2025/09/19
[jira] [Created] (SPARK-53645) Implement skipna parameter for any()
Peter Nguyen (Jira)
-
2025/09/19
[jira] [Created] (SPARK-53535) Missing columns inside a struct in Parquet files are not handled correctly
Ziya Mukhtarov (Jira)
-
2025/09/19
[jira] [Assigned] (SPARK-53588) Upgrade `kubernetes-client` to 7.4.0
Dongjoon Hyun (Jira)
-
2025/09/19
[jira] [Assigned] (SPARK-53523) Named parameters respect `spark.sql.caseSensitive`
Dongjoon Hyun (Jira)
-
2025/09/19
[jira] [Updated] (SPARK-53634) Missing Sort Columns in Execution Plan Optimization with union + withColumn + sortWithinPartition
Yuki Sato (Jira)
-
2025/09/19
[jira] [Commented] (SPARK-53634) Missing Sort Columns in Execution Plan Optimization with union + withColumn + sortWithinPartition
Yuki Sato (Jira)
-
2025/09/19
[jira] [Updated] (SPARK-53634) Missing Sort Columns in Execution Plan Optimization with union + withColumn + sortWithinPartition
Yuki Sato (Jira)
-
2025/09/19
[jira] [Updated] (SPARK-53634) Missing Sort Columns in Execution Plan Optimization with union + withColumn + sortWithinPartition
Yuki Sato (Jira)
-
2025/09/18
[jira] [Updated] (SPARK-53534) Add tests for arrow udf with numpy output
ASF GitHub Bot (Jira)
-
2025/09/18
[jira] [Updated] (SPARK-46166) Add axis and skipna parameters to DataFrame.any
ASF GitHub Bot (Jira)
-
2025/09/18
[jira] [Updated] (SPARK-53578) Simplify data type handling in LiteralValueProtoConverter
Dongjoon Hyun (Jira)
-
2025/09/18
[jira] [Resolved] (SPARK-53578) Simplify data type handling in LiteralValueProtoConverter
Wenchen Fan (Jira)
-
2025/09/18
[jira] [Updated] (SPARK-53578) Simplify data type handling in LiteralValueProtoConverter
Dongjoon Hyun (Jira)
-
2025/09/18
[jira] [Updated] (SPARK-40591) ignoreCorruptFiles results data loss
Kent Yao (Jira)
-
2025/09/18
[jira] [Assigned] (SPARK-53644) Upgrade `Gradle` to 9.1.0
Dongjoon Hyun (Jira)
-
2025/09/18
[jira] [Created] (SPARK-53644) Upgrade `Gradle` to 9.1.0
Dongjoon Hyun (Jira)
-
2025/09/18
[jira] [Updated] (SPARK-53644) Upgrade `Gradle` to 9.1.0
ASF GitHub Bot (Jira)
-
2025/09/18
[jira] [Assigned] (SPARK-53642) Improve Javadoc for interfaces, class, methods, variables
Dongjoon Hyun (Jira)
-
2025/09/18
[jira] [Updated] (SPARK-53623) O(N^2) operation in readLargeTableProp in CatalogColumnStat
Dongjoon Hyun (Jira)
-
2025/09/18
[jira] [Updated] (SPARK-53623) O(N^2) operation in readLargeTableProp in CatalogColumnStat
Dongjoon Hyun (Jira)
-
2025/09/18
[jira] [Resolved] (SPARK-53642) Improve Javadoc for interfaces, class, methods, variables
Dongjoon Hyun (Jira)
-
2025/09/18
[jira] [Commented] (SPARK-48950) Corrupt data from parquet scans
Kent Yao (Jira)
-
2025/09/18
[jira] [Resolved] (SPARK-53521) Make Star trait compatible with single pass analyzer
Wenchen Fan (Jira)
-
2025/09/18
[jira] [Assigned] (SPARK-53623) O(N^2) operation in readLargeTableProp in CatalogColumnStat
Wenchen Fan (Jira)
-
2025/09/18
[jira] [Resolved] (SPARK-53625) Propagate metadata columns through projections to address ApplyCharTypePadding incompatibility in streaming
Jungtaek Lim (Jira)
-
2025/09/18
[jira] [Resolved] (SPARK-53623) O(N^2) operation in readLargeTableProp in CatalogColumnStat
Wenchen Fan (Jira)
-
2025/09/18
[jira] [Assigned] (SPARK-53625) Propagate metadata columns through projections to address ApplyCharTypePadding incompatibility in streaming
Jungtaek Lim (Jira)
-
2025/09/18
[jira] [Created] (SPARK-53643) Add Arrow UDF to user guide
Xinrong Meng (Jira)
-
2025/09/18
[jira] [Updated] (SPARK-53642) Improve Javadoc for interfaces, class, methods, variables
ASF GitHub Bot (Jira)
-
2025/09/18
[jira] [Created] (SPARK-53642) Improve Javadoc for interfaces, class, methods, variables
Dongjoon Hyun (Jira)
-
2025/09/18
[jira] [Commented] (SPARK-52032) ORC filter pushdown causes incorrect results with eqNullSafe (<=>) in DataFrame filter (Parquet works as expected)
Dongjoon Hyun (Jira)
-
2025/09/18
[jira] [Updated] (SPARK-53641) Add PARTITION BY support in Arrow UDTF user guide
ASF GitHub Bot (Jira)
-
2025/09/18
[jira] [Created] (SPARK-53641) Add PARTITION BY support in Arrow UDTF user guide
Allison Wang (Jira)
-
2025/09/18
[jira] [Created] (SPARK-53640) Operator Helm Chart: suppot additionalContainers, volumes, volumeMounts as array
Zhou JIANG (Jira)
-
2025/09/18
[jira] [Resolved] (SPARK-53632) Reenable doctest for `DataFrame.pandas_api`
Ruifeng Zheng (Jira)
-
2025/09/18
[jira] [Updated] (SPARK-53561) Catch Interruption Exception in TransformWithStateInPySparkStateServer during outputStream.flush at the thread close time to avoid the worker crash
Huanli Wang (Jira)
-
2025/09/18
[jira] [Updated] (SPARK-48950) Corrupt data from parquet scans
Dongjoon Hyun (Jira)
-
2025/09/18
[jira] [Resolved] (SPARK-53637) Demote bcprov-jdk18on to test scope
Dongjoon Hyun (Jira)
-
2025/09/18
[jira] [Commented] (SPARK-48950) Corrupt data from parquet scans
Thomas Newton (Jira)
-
2025/09/18
[jira] [Updated] (SPARK-53637) Demote bcprov-jdk18on to test scope
Dongjoon Hyun (Jira)
-
2025/09/18
[jira] [Assigned] (SPARK-53637) Demote bcprov-jdk18on to test scope
Dongjoon Hyun (Jira)
-
2025/09/18
[jira] [Updated] (SPARK-53340) Make StreamingQueryCommand in SparkConnectPlanner side effect free
ASF GitHub Bot (Jira)
-
2025/09/18
[jira] [Updated] (SPARK-53633) Reuse InputStream in vectorized Parquet reader
ASF GitHub Bot (Jira)
-
2025/09/18
[jira] [Updated] (SPARK-53632) Reenable doctest for `DataFrame.pandas_api`
ASF GitHub Bot (Jira)
-
2025/09/18
[jira] [Assigned] (SPARK-53639) Use `spark` consistently for `release-name` of Helm installation
Dongjoon Hyun (Jira)
-
2025/09/18
[jira] [Resolved] (SPARK-53639) Use `spark` consistently for `release-name` of Helm installation
Dongjoon Hyun (Jira)
-
2025/09/18
[jira] [Updated] (SPARK-53639) Use `spark` consistently for `release-name` of Helm installation
Dongjoon Hyun (Jira)
-
2025/09/18
[jira] [Updated] (SPARK-53639) Use `spark` consistently for Helm installation name
ASF GitHub Bot (Jira)
-
2025/09/18
[jira] [Created] (SPARK-53639) Use `spark` consistently for Helm installation name
Dongjoon Hyun (Jira)
-
2025/09/18
[jira] [Updated] (SPARK-53638) Limit the byte size of arrow batch for TWS to avoid OOM
ASF GitHub Bot (Jira)
-
2025/09/18
[jira] [Updated] (SPARK-53638) Limit the byte size of arrow batch for TWS to avoid OOM
Zerui Bao (Jira)
-
2025/09/18
[jira] [Created] (SPARK-53638) Limit the byte size of arrow batch for TWS
Zerui Bao (Jira)
-
2025/09/18
[jira] [Commented] (SPARK-48950) Corrupt data from parquet scans
Dongjoon Hyun (Jira)
-
2025/09/18
[jira] [Updated] (SPARK-53626) Add invalid mixed-type operations to ANSI migration guide
Dongjoon Hyun (Jira)
-
2025/09/18
[jira] [Resolved] (SPARK-53626) Add invalid mixed-type operations to ANSI migration guide
Dongjoon Hyun (Jira)
-
2025/09/18
[jira] [Assigned] (SPARK-53626) Add invalid mixed-type operations to ANSI migration guide
Dongjoon Hyun (Jira)
-
2025/09/18
[jira] [Updated] (SPARK-51119) Readers on executors resolving EXISTS_DEFAULT should not call catalogs
Dongjoon Hyun (Jira)
-
2025/09/18
[jira] [Created] (SPARK-53528) SPIP: Add llms.txt files to Spark Documentation
Allison Wang (Jira)
-
2025/09/18
[jira] [Created] (SPARK-53596) Put translatable filters to the left side of untranslatable filters
Yu Tang (Jira)
-
2025/09/18
[jira] [Updated] (SPARK-53593) [SDP] Return qualified dataset name for DefineDataset and DefineFlow RPCs
ASF GitHub Bot (Jira)
-
2025/09/18
[jira] [Commented] (SPARK-39328) Flaky Test: `SPARK-37753: Inhibit broadcast in left outer join when there are many empty partitions on outer/left side`
Dongjoon Hyun (Jira)
-
2025/09/18
[jira] [Updated] (SPARK-39328) Flaky Test: `SPARK-37753: Inhibit broadcast in left outer join when there are many empty partitions on outer/left side`
Dongjoon Hyun (Jira)
-
2025/09/18
[jira] [Created] (SPARK-53636) SortShuffleManager.unregisterShuffle is not thread safe
wuyi (Jira)
-
2025/09/18
[jira] [Created] (SPARK-53634) Missing Sort Columns in Execution Plan Optimization with union + withColumn + sortWithinPartition
Yuki Sato (Jira)
-
2025/09/18
[jira] [Comment Edited] (SPARK-50992) OOMs and performance issues with AQE in large plans
Raju Ansari (Jira)
-
2025/09/18
[jira] [Updated] (SPARK-53637) Demote bcprov-jdk18on to test scope
ASF GitHub Bot (Jira)
-
2025/09/18
[jira] [Created] (SPARK-53637) Demote bcprov-jdk18on to test scope
Cheng Pan (Jira)
-
2025/09/18
[jira] [Commented] (SPARK-39328) Flaky Test: `SPARK-37753: Inhibit broadcast in left outer join when there are many empty partitions on outer/left side`
Sungdong Kim (Jira)
-
2025/09/18
[jira] [Updated] (SPARK-53621) Add support for executing CONTINUE HANDLER
ASF GitHub Bot (Jira)
-
2025/09/18
[jira] [Updated] (SPARK-39328) Flaky Test: `SPARK-37753: Inhibit broadcast in left outer join when there are many empty partitions on outer/left side`
ASF GitHub Bot (Jira)
-
2025/09/18
[jira] [Updated] (SPARK-53636) SortShuffleManager.unregisterShuffle is not thread safe
ASF GitHub Bot (Jira)
-
2025/09/18
[jira] [Updated] (SPARK-53635) udf with array of structure in spark 4
Jiri Humpolicek (Jira)
-
2025/09/18
[jira] [Created] (SPARK-53635) udf with array of structure in spark 4
Jiri Humpolicek (Jira)
-
2025/09/18
[jira] [Assigned] (SPARK-53632) Reenable doctest for `DataFrame.pandas_api`
Ruifeng Zheng (Jira)
-
2025/09/18
[jira] [Created] (SPARK-53632) Reenable doctest for `DataFrame.pandas_api`
Ruifeng Zheng (Jira)
-
2025/09/18
[jira] [Assigned] (SPARK-53598) Check numParts field for Hive tables before reading data source schema
Wenchen Fan (Jira)
-
2025/09/18
[jira] [Resolved] (SPARK-53598) Check numParts field for Hive tables before reading data source schema
Wenchen Fan (Jira)
-
2025/09/18
[jira] [Created] (SPARK-53633) Reuse InputStream in vectorized Parquet reader
Cheng Pan (Jira)
-
2025/09/18
[jira] [Assigned] (SPARK-53323) Support df.asTable() for Arrow UDTF in Spark Connect
Ruifeng Zheng (Jira)
-
2025/09/18
[jira] [Resolved] (SPARK-53323) Support df.asTable() for Arrow UDTF in Spark Connect
Ruifeng Zheng (Jira)
-
2025/09/18
[jira] [Assigned] (SPARK-53630) Reenable doctest for dataframe.freqItems
Ruifeng Zheng (Jira)
-
2025/09/18
[jira] [Updated] (SPARK-53631) Optimize memory and perf on SHS bootstrap
ASF GitHub Bot (Jira)
-
2025/09/17
[jira] [Created] (SPARK-53607) Support Java 25
Dongjoon Hyun (Jira)
-
2025/09/17
[jira] [Commented] (SPARK-53287) Add ANSI Migration Guide
Dongjoon Hyun (Jira)
-
2025/09/17
[jira] [Updated] (SPARK-53630) Reenable doctest for dataframe.freqItems
ASF GitHub Bot (Jira)
-
2025/09/17
[jira] [Updated] (SPARK-53631) Optimize memory and perf on SHS bootstrap
Cheng Pan (Jira)
-
2025/09/17
[jira] [Created] (SPARK-53631) Optimze memory and perf on SHS bootstrap
Cheng Pan (Jira)
-
2025/09/17
[jira] [Updated] (SPARK-53553) Fix handling of null values in LiteralValueProtoConverter
Yihong He (Jira)
-
2025/09/17
[jira] [Updated] (SPARK-53615) Introduce iterator API for arrow grouped agg UDF
Ruifeng Zheng (Jira)
-
2025/09/17
[jira] [Updated] (SPARK-53554) Fix sum_distinct in spark-connect-rust
ASF GitHub Bot (Jira)
-
2025/09/17
[jira] [Commented] (SPARK-52032) ORC filter pushdown causes incorrect results with eqNullSafe (<=>) in DataFrame filter
Dongjoon Hyun (Jira)
-
2025/09/17
[jira] [Assigned] (SPARK-53399) Restore CollapseProject to merge Python UDFs
Peter Toth (Jira)
-
2025/09/17
[jira] [Resolved] (SPARK-53619) Enable doctests for toArrow/toPandas/mapInArrow/mapInPandas
Ruifeng Zheng (Jira)
-
2025/09/17
[jira] [Commented] (SPARK-53447) How to configure multiple Hive Metastores in a single Spark session?
Yuan Chen (Jira)
-
2025/09/17
[jira] [Comment Edited] (SPARK-48950) Corrupt data from parquet scans
Fei Wang (Jira)
-
2025/09/17
[jira] [Commented] (SPARK-48950) Corrupt data from parquet scans
Fei Wang (Jira)
-
2025/09/17
[jira] [Updated] (SPARK-48950) Corrupt data from parquet scans
Kent Yao (Jira)
-
2025/09/17
[jira] [Updated] (SPARK-48950) Corrupt data from parquet scans
Kent Yao (Jira)
-
2025/09/17
[jira] [Updated] (SPARK-48950) Corrupt data from parquet scans
Kent Yao (Jira)
-
2025/09/17
[jira] [Created] (SPARK-53630) Reenable doctest for dataframe.freqItems
Ruifeng Zheng (Jira)
-
2025/09/17
[jira] [Assigned] (SPARK-53619) Enable doctests for toArrow/toPandas/mapInArrow/mapInPandas
Ruifeng Zheng (Jira)
-
2025/09/17
[jira] [Updated] (SPARK-51426) Setting metadata to empty dict does not work
ASF GitHub Bot (Jira)
-
2025/09/17
[jira] [Updated] (SPARK-53608) Improve Python Aggregation UDFs
Ruifeng Zheng (Jira)
-
2025/09/17
[jira] [Updated] (SPARK-53629) Support type widening for MERGE INTO WITH SCHEMA EVOLUTION
ASF GitHub Bot (Jira)
-
2025/09/17
[jira] [Created] (SPARK-53629) Support type widening for MERGE INTO WITH SCHEMA EVOLUTION
Szehon Ho (Jira)
-
2025/09/17
[jira] [Assigned] (SPARK-53387) Support PARTITION BY clause with Arrow Python UDTFs
Allison Wang (Jira)
-
2025/09/17
[jira] [Resolved] (SPARK-53387) Support PARTITION BY clause with Arrow Python UDTFs
Allison Wang (Jira)
-
2025/09/17
[jira] [Resolved] (SPARK-53627) Update docs to recommend K8s 1.32+
Dongjoon Hyun (Jira)
-
2025/09/17
[jira] [Resolved] (SPARK-53628) Upgrade `pmd` and `spotbugs` and enable checking on Java 25
Dongjoon Hyun (Jira)
-
2025/09/17
[jira] [Assigned] (SPARK-53628) Upgrade `pmd` and `spotbugs` and enable checking on Java 25
Dongjoon Hyun (Jira)
-
2025/09/17
[jira] [Assigned] (SPARK-53627) Update docs to recommend K8s 1.32+
Dongjoon Hyun (Jira)
-
2025/09/17
[jira] [Updated] (SPARK-53521) Make Star trait compatible with single pass analyzer
ASF GitHub Bot (Jira)
-
2025/09/17
[jira] [Resolved] (SPARK-53029) Support return type coercion for Arrow Python UDTFs
Takuya Ueshin (Jira)
-
2025/09/17
[jira] [Assigned] (SPARK-52659) Misleading modulo error message in ANSI mode
Gengliang Wang (Jira)
-
2025/09/17
[jira] [Resolved] (SPARK-53507) Add Breaking Change info to Spark error classes
Hyukjin Kwon (Jira)
-
2025/09/17
[jira] [Assigned] (SPARK-53507) Add Breaking Change info to Spark error classes
Hyukjin Kwon (Jira)
-
2025/09/17
[jira] [Resolved] (SPARK-52659) Misleading modulo error message in ANSI mode
Gengliang Wang (Jira)
-
2025/09/17
[jira] [Assigned] (SPARK-53620) SparkSubmit should print stacktrace when exitFn is called
Dongjoon Hyun (Jira)
-
2025/09/17
[jira] [Updated] (SPARK-53620) SparkSubmit should print stacktrace when exitFn is called
Dongjoon Hyun (Jira)
-
2025/09/17
[jira] [Resolved] (SPARK-53620) SparkSubmit should print stacktrace when exitFn is called
Dongjoon Hyun (Jira)
-
2025/09/17
[jira] [Updated] (SPARK-53628) Upgrade `pmd` and `spotbugs` and enable checking on Java 25
ASF GitHub Bot (Jira)
-
2025/09/17
[jira] [Updated] (SPARK-53628) Upgrade `pmd` and `spotbugs` and enable checking on Java 25
Dongjoon Hyun (Jira)
-
2025/09/17
[jira] [Created] (SPARK-53628) Upgrade `pmd` and `spotbugs` to enable checking on Java 25
Dongjoon Hyun (Jira)
-
2025/09/17
[jira] [Updated] (SPARK-53620) SparkSubmit should print stacktrace when exitFn is called
ASF GitHub Bot (Jira)
-
2025/09/17
[jira] [Updated] (SPARK-53627) Update docs to recommend K8s 1.32+
ASF GitHub Bot (Jira)
-
2025/09/17
[jira] [Created] (SPARK-53627) Update docs to recommend K8s 1.32+
Dongjoon Hyun (Jira)
-
2025/09/17
[jira] [Resolved] (SPARK-53607) Support Java 25
Dongjoon Hyun (Jira)
-
2025/09/17
[jira] [Assigned] (SPARK-53607) Support Java 25
Dongjoon Hyun (Jira)
-
2025/09/17
[jira] [Resolved] (SPARK-53624) Use `bitnamisecure/kubectl:latest` for Helm Chart testing
Dongjoon Hyun (Jira)
-
2025/09/17
[jira] [Assigned] (SPARK-53624) Use `bitnamisecure/kubectl:latest` for Helm Chart testing
Dongjoon Hyun (Jira)
-
2025/09/17
[jira] [Updated] (SPARK-53626) Add invalid mixed-type operations to ANSI migration guide
ASF GitHub Bot (Jira)
-
2025/09/17
[jira] [Updated] (SPARK-53626) Add invalid mixed-type operations to ANSI migration guide
Xinrong Meng (Jira)
-
2025/09/17
[jira] [Created] (SPARK-53626) Add mixed-type operations to ANSI migration guide
Xinrong Meng (Jira)
-
2025/09/17
[jira] [Updated] (SPARK-53625) Propagate metadata columns through projections to address ApplyCharTypePadding incompatibility in streaming
ASF GitHub Bot (Jira)
-
2025/09/17
[jira] [Created] (SPARK-53625) Propagate metadata columns through projections to address ApplyCharTypePadding incompatibility in streaming
Livia Zhu (Jira)
-
2025/09/17
[jira] [Updated] (SPARK-53624) Use `bitnamisecure/kubectl:latest` for Helm Chart testing
ASF GitHub Bot (Jira)
-
2025/09/17
[jira] [Updated] (SPARK-53623) O(N^2) operation in readLargeTableProp in CatalogColumnStat
ASF GitHub Bot (Jira)
-
2025/09/17
[jira] [Created] (SPARK-53624) Use `bitnamisecure/kubectl:latest` for Helm Chart testing
Dongjoon Hyun (Jira)
-
2025/09/17
[jira] [Commented] (SPARK-53623) O(N^2) operation in readLargeTableProp in CatalogColumnStat
Yesheng Ma (Jira)
-
2025/09/17
[jira] [Assigned] (SPARK-53594) Make arrow UDF respect user-specified eval type
Ruifeng Zheng (Jira)
-
2025/09/17
[jira] [Assigned] (SPARK-53434) ColumnarRow's get should check isNullAt
Wenchen Fan (Jira)
-
2025/09/17
[jira] [Updated] (SPARK-53623) O(N^2) operation in readLargeTableProp in CatalogColumnStat
Yesheng Ma (Jira)
-
2025/09/17
[jira] [Created] (SPARK-53623) O(N^2) operation in readLargeTableProp in CatalogColumnStat
Yesheng Ma (Jira)
-
2025/09/17
[jira] [Updated] (SPARK-53622) Improve UninterruptibleThread test
ASF GitHub Bot (Jira)
-
2025/09/17
[jira] [Created] (SPARK-53523) NamedParameter respects `spark.sql.caseSensitive`
Cheng Pan (Jira)
-
2025/09/17
[jira] [Created] (SPARK-53622) Improve UninterruptibleThread test
Vlad Rozov (Jira)
-
2025/09/17
[jira] [Updated] (SPARK-53523) Named parameters respect `spark.sql.caseSensitive`
Dongjoon Hyun (Jira)
-
2025/09/17
[jira] [Created] (SPARK-53579) Support TIME in the try_make_timestamp function in Scala
Jira
-
2025/09/17
[jira] [Updated] (SPARK-53553) Fix handling of null values in LiteralValueProtoConverter
ASF GitHub Bot (Jira)
-
2025/09/17
[jira] [Updated] (SPARK-53551) Improve OffsetAndLimit by avoiding duplicate evaluation
ASF GitHub Bot (Jira)
-
2025/09/17
[jira] [Resolved] (SPARK-53432) Support Null Value in Direct Passthrough Partitioning API
Shujing Yang (Jira)
-
2025/09/17
[jira] [Updated] (SPARK-53578) Simplify data type handling in LiteralValueProtoConverter
ASF GitHub Bot (Jira)
-
2025/09/17
[jira] [Updated] (SPARK-53323) Support df.asTable() for Arrow UDTF in Spark Connect
ASF GitHub Bot (Jira)
-
2025/09/17
[jira] [Updated] (SPARK-53550) Union output partitioning should compare canonicalized attributes
Dongjoon Hyun (Jira)
-
2025/09/17
[jira] [Resolved] (SPARK-53523) Named parameters respect `spark.sql.caseSensitive`
Dongjoon Hyun (Jira)
-
2025/09/17
[jira] [Assigned] (SPARK-53479) Align `==` behavior with pandas when comparing against scalar under ANSI
Xinrong Meng (Jira)
-
2025/09/17
[jira] [Resolved] (SPARK-53613) Upgrade `google-java-format` to 1.28.0 to support Java 25
Dongjoon Hyun (Jira)
-
2025/09/17
[jira] [Updated] (SPARK-53615) Introduce iterator API for arrow grouped agg UDF
Ruifeng Zheng (Jira)
-
2025/09/17
[jira] [Updated] (SPARK-53560) Crash looping when retrying uncommitted batch in Kafka source and AvailableNow trigger
Yuchen Liu (Jira)
-
2025/09/17
[jira] [Commented] (SPARK-53364) spark spark.local.dir overwrite for yarn cluster execution
Peter Toth (Jira)
-
2025/09/17
[jira] [Assigned] (SPARK-53606) Fix MapInPandas/MapInArrow examples with barrier
Ruifeng Zheng (Jira)
-
2025/09/17
[jira] [Updated] (SPARK-53621) Add support for executing CONTINUE HANDLER
Teodor (Jira)
-
2025/09/17
[jira] [Created] (SPARK-53621) Add support for parsing CONTINUE HANDLER
Teodor (Jira)
-
2025/09/17
[jira] [Resolved] (SPARK-53438) Use CatalystConverter in LiteralExpressionProtoConverter
Wenchen Fan (Jira)
-
2025/09/17
[jira] [Assigned] (SPARK-53438) Use CatalystConverter in LiteralExpressionProtoConverter
Wenchen Fan (Jira)
-
2025/09/17
[jira] [Resolved] (SPARK-53372) [SDP] API Testing
Wenchen Fan (Jira)
-
2025/09/17
[jira] [Assigned] (SPARK-53372) [SDP] API Testing
Wenchen Fan (Jira)
-
2025/09/17
[jira] [Updated] (SPARK-52991) Implement MERGE INTO with SCHEMA EVOLUTION for V2 DataSource
Dongjoon Hyun (Jira)
-
2025/09/17
[jira] [Commented] (SPARK-53595) Add `See Also` section for xml functions
Yicong Huang (Jira)
-
2025/09/17
[jira] [Updated] (SPARK-53615) Introduce iterator API for arrow grouped agg UDF
Ruifeng Zheng (Jira)
-
2025/09/17
[jira] [Created] (SPARK-53606) Fix MapInPandas/MapInArrow examples with barrier
Ruifeng Zheng (Jira)
-
2025/09/17
[jira] [Updated] (SPARK-53438) Use CatalystConverter in LiteralExpressionProtoConverter
Yihong He (Jira)
-
2025/09/17
[jira] [Updated] (SPARK-53364) spark spark.local.dir overwrite for yarn cluster execution
Peter Toth (Jira)
-
2025/09/17
[jira] [Updated] (SPARK-47110) Reenble AmmoniteTest tests in Maven builds
ASF GitHub Bot (Jira)
-
2025/09/17
[jira] [Updated] (SPARK-52601) TransformingEncoder should work with primitive types
Dongjoon Hyun (Jira)
-
2025/09/17
[jira] [Updated] (SPARK-53611) Limit Arrow batch sizes in window agg UDFs
Ruifeng Zheng (Jira)
-
2025/09/17
[jira] [Updated] (SPARK-53605) Restore pyspark execution timeout to 2 hours after fixing test_pandas_transform_with_state
Dongjoon Hyun (Jira)
-
2025/09/17
[jira] [Created] (SPARK-53618) Turn a FULL JOIN with false condition to a UNION ALL
Tornike Gurgenidze (Jira)