Messages by Thread
-
Re: [I] [EPIC] Implement Range Partitioning [datafusion]
via GitHub
-
[I] datasource listing performs full listing despite user pruning partitions [datafusion]
via GitHub
-
[PR] CI: bump rust-cache, stale, setup-python, Python [datafusion-sqlparser-rs]
via GitHub
-
[PR] fix: Avoid panicing when stats are not available for a file group spl… [datafusion]
via GitHub
-
[PR] Branch 54 bp 23277 [datafusion]
via GitHub
-
[I] Perf: Streaming Aggregation should not be chosen unconditionally when the input is sorted [datafusion]
via GitHub
-
[PR] perf: Optimize array_has() for array needle [datafusion]
via GitHub
-
[PR] ci: reintroduce code coverage reporting with cargo-llvm-cov [datafusion]
via GitHub
-
[PR] bench: add array_has array-needle benchmarks [datafusion]
via GitHub
-
[I] Optimize `array_has` when the search element is a column [datafusion]
via GitHub
-
[PR] feat: Support BinaryView Type in approx_distinct [datafusion]
via GitHub
-
[PR] perf(physical-plan): fold PlanProperties fast-path into with_new_children_if_necessary (PR 1 of #22555) [datafusion]
via GitHub
-
[PR] v54 upgrade guide: Remove unreleased-note [datafusion]
via GitHub
-
[PR] chore(deps): bump ctor from 1.0.7 to 1.0.8 [datafusion-ballista]
via GitHub
-
[PR] chore(deps): bump bytesize from 2.4.0 to 2.4.2 [datafusion-ballista]
via GitHub
-
[PR] chore(deps): bump astral-sh/setup-uv from 8.2.0 to 8.3.0 [datafusion-ballista]
via GitHub
-
[PR] Preserve string slice function return types [datafusion]
via GitHub
-
[I] left, right, and substr always return Utf8View for Utf8 input [datafusion]
via GitHub
-
Re: [PR] feat: Support Spark expression seconds_of_time [datafusion-comet]
via GitHub
-
Re: [PR] feat: zero-copy columnar conversion for ArrowColumnVector-backed batches [datafusion-comet]
via GitHub
-
Re: [PR] feat: Support Spark expression hours_of_time [datafusion-comet]
via GitHub
-
Re: [PR] fix: insert overwrite directory native writer [datafusion-comet]
via GitHub
-
Re: [PR] feat: support Spark base64 expression [datafusion-comet]
via GitHub
-
Re: [PR] fix: Prevent String to TimestampNTZ cast from incorrectly adding UTC timezone metadata [datafusion-comet]
via GitHub
-
Re: [PR] feat: Support Spark expression window_time [datafusion-comet]
via GitHub
-
Re: [PR] chore(deps): bump pbjson-types from 0.8.0 to 0.9.0 in the proto group across 1 directory [datafusion-sandbox]
via GitHub
-
Re: [PR] Avoid redundant memory access in ArrowBytesViewMap for inline values [datafusion]
via GitHub
-
Re: [PR] Introduce `SubPool`: per-operator sub-pool for blocking spillable operators [datafusion]
via GitHub
-
Re: [PR] feat: TABLESAMPLE SYSTEM end-to-end + row-group / row sampling on ParquetSource [datafusion]
via GitHub
-
[PR] perf(sort): passthrough last stream that left in `SortPreservingMergeStream` [datafusion]
via GitHub
-
[PR] feat: reuse repeated exchanges in the distributed planner (ReuseExchange analog) [datafusion-ballista]
via GitHub
-
[PR] build(deps): bump astral-sh/setup-uv from 8.2.0 to 8.3.0 [datafusion-python]
via GitHub
-
[PR] build(deps): bump github/codeql-action/init from 4.36.2 to 4.36.3 [datafusion-python]
via GitHub
-
[PR] build(deps): bump github/codeql-action/analyze from 4.36.2 to 4.36.3 [datafusion-python]
via GitHub
-
Re: [I] Investigate use of `DynamicFilters` in ballista [datafusion-ballista]
via GitHub
-
[I] Reuse repeated exchanges/subplans in the distributed planner (ReuseExchange/ReuseSubquery analog) [datafusion-ballista]
via GitHub
-
[I] Spill large shuffle partition fetches to disk to bound decoded in-flight memory [datafusion-ballista]
via GitHub
-
[PR] feat: bound shuffle fetch with a reduce-side in-flight governor [datafusion-ballista]
via GitHub
-
[I] Adaptive query planning fails with remote object stores: "No suitable object store found" [datafusion-ballista]
via GitHub
-
[PR] feat: object-store data cache (memory tier) + cache-affinity scheduling [datafusion-comet]
via GitHub
-
[PR] feat: partial project fallback (JVM expression detour) [datafusion-comet]
via GitHub
-
[PR] fix: preserve aggregate scope when unparsing [datafusion]
via GitHub
-
Re: [I] physical_planner::tests::test_optimization_invariant_checker fails when run with release-nonlto profile [datafusion]
via GitHub
-
Re: [PR] [datafusion-spark] Support 2-argument ceil(value, scale) [datafusion]
via GitHub
-
[PR] Issue 1795 surface failed tasks [datafusion-ballista]
via GitHub
-
[I] PartitionedTopKRank over-accounts memory when a single batch has boundary ties across many partitions [datafusion]
via GitHub
-
Re: [PR] Push down topk through join [datafusion]
via GitHub
-
[PR] fix: bump iceberg-rust version to a rev with `ArrowReader` fix [datafusion-comet]
via GitHub
-
[PR] feat(scheduler): call try_acquire_job on active cache miss in update_task_statuses [datafusion-ballista]
via GitHub
-
[PR] fix: cache CLI AWS credentials until expiry [datafusion]
via GitHub
-
[PR] fix(cli): sort jobs by stage completion ratio [datafusion-ballista]
via GitHub
-
[PR] refactor(hash-aggr): Simplify aggregate hash table with tempated functions [datafusion]
via GitHub
-
Re: [PR] feat: Support Spark expression: percentile_cont [datafusion-comet]
via GitHub
-
Re: [PR] fix: Add schema validation for native_datafusion Parquet scan [datafusion-comet]
via GitHub
-
Re: [PR] bench: improve Iceberg TPC workflow and plan capture [datafusion-comet]
via GitHub
-
Re: [PR] feat: Add native support for max_by and min_by [datafusion-comet]
via GitHub
-
Re: [PR] feat: Use single spill file for multiple partitions in native shuffle [datafusion-comet]
via GitHub
-
Re: [PR] fix(substrait): normalize table names from Substrait NamedTable for Calcite interop [datafusion]
via GitHub
-
Re: [PR] [datafusion-spark] Add Spark-compatible isnan function [datafusion]
via GitHub
-
Re: [PR] Query-aware statistics requests via ScanArgs / ScanResult (RFC for #21624) [datafusion]
via GitHub
-
[PR] fix: reuse a small pool of multiplexed connections per peer for shuffle fetches [datafusion-ballista]
via GitHub
-
[PR] fix: gate debug-only assertions in physical planner test test_optimization_invariant_checker [datafusion]
via GitHub
-
[PR] fix: hold pooled shuffle connection for the response stream lifetime [datafusion-ballista]
via GitHub
-
Re: [I] Coverage jobs are failing on master: `Failed to compile tests! Error: sql_integration: linking with `cc` failed: exit status: 1"` [datafusion]
via GitHub
-
[I] Performance snapshot: Ballista vs Spark/Comet for TPC-H @ SF100 [datafusion-ballista]
via GitHub
-
[I] Shuffle fetch exhausts ephemeral ports at high target_partitions (client connection caching off by default) [datafusion-ballista]
via GitHub
-
Re: [I] Materialize Dictionaries in Group Keys [datafusion]
via GitHub
-
Re: [I] panic on SET datafusion.runtime.* when value ends with non-ASCII byte (split_at char boundary) [datafusion]
via GitHub
-
[I] chore: Explore combining `SessionConfig` and `RuntimeConfig` into same framework [datafusion]
via GitHub
-
[I] Partial project fallback: keep a projection/filter native by evaluating an unsupported subexpression in the JVM [datafusion-comet]
via GitHub
-
[PR] chore: Use native impl of `soundex` function [datafusion-comet]
via GitHub
-
[I] CLI utility does not check expiration of AWS credentials [datafusion]
via GitHub
-
[PR] feat: support reading TPC-H benchmark data from S3-compatible object storage [datafusion-ballista]
via GitHub
-
[PR] refactor(scheduler): keep submit_job non-breaking, add submit_physical_plan [datafusion-ballista]
via GitHub
-
[I] Restore backward-compatible submit_job signature after #1924 [datafusion-ballista]
via GitHub
-
[I] Add a versioned Upgrade Guide to the documentation [datafusion-ballista]
via GitHub
-
[PR] docs: add versioned upgrade guide (54.0.0) [datafusion-ballista]
via GitHub
-
[I] Add suport for `DataFrame.checkpoint()` [datafusion-ballista]
via GitHub
-
[PR] feat: support decimals in trunc UDF [datafusion]
via GitHub
-
Re: [I] Add support for `DataFrame.cache()` to Ballista [datafusion-ballista]
via GitHub
-
[PR] Add regression tests for hash-join dynamic filter expression policy [datafusion]
via GitHub
-
[PR] Enable mixed approx_count_distinct aggregation [datafusion-comet]
via GitHub
-
[I] Simplify aggregate table for ordered cases [datafusion]
via GitHub
-
Re: [PR] build: Enable Spark SQL tests for Spark 4.2 [will not merge until 4.2 is released] [datafusion-comet]
via GitHub
-
Re: [PR] feat: Optimise convert_to_state for SUM and BIT_OR_XOR [datafusion]
via GitHub
-
Re: [PR] [WIP] Explore extensible range partitioning for dynamic filters [datafusion]
via GitHub
-
[PR] fix: handle null sub-arrays in flatten [datafusion-comet]
via GitHub
-
Re: [I] [Proposal] Scan I/O acceleration: node-local fragment cache, asynchronous prefetch, and cache-affinity scheduling [datafusion-comet]
via GitHub
-
[I] SQL Unparser generates incorrect column references [datafusion]
via GitHub
-
Re: [PR] chore: deprecate record_batch macro in favor of upstream one [datafusion]
via GitHub
-
Re: [I] Rebalance deep associative binary expression chains (Add, Multiply, bitwise) to avoid protobuf recursion limit [datafusion-comet]
via GitHub
-
Re: [PR] feat: rebalance associative bitwise/Add/Multiply chains to avoid protobuf recursion limit [datafusion-comet]
via GitHub
-
[PR] fix: avoid panic parsing non-ASCII runtime config values [datafusion]
via GitHub