github  

Messages by Date

• 2025/08/19 Re: [PR] fix: remove fallback for int8 and int16 types with native Parquet readers [datafusion-comet] via GitHub
• 2025/08/19 Re: [PR] Push dynamic pushdown through cooperative and projection execs [datafusion] via GitHub
• 2025/08/19 Re: [PR] fix: [iceberg] Switch to OSS Spark and run Iceberg Spark tests in parallel [datafusion-comet] via GitHub
• 2025/08/19 Re: [PR] Push dynamic pushdown through cooperative and projection execs [datafusion] via GitHub
• 2025/08/19 Re: [PR] Push dynamic pushdown through cooperative and projection execs [datafusion] via GitHub
• 2025/08/19 [I] Dynamic filter pushdown through projection should support aliases [datafusion] via GitHub
• 2025/08/19 Re: [PR] chore(deps): bump syn from 2.0.105 to 2.0.106 [datafusion] via GitHub
• 2025/08/19 Re: [PR] Prepare for Merge Queue [datafusion] via GitHub
• 2025/08/19 Re: [PR] fix: remove fallback for int8 and int16 types with native Parquet readers [datafusion-comet] via GitHub
• 2025/08/19 Re: [PR] fix: remove fallback for int8 and int16 types with native Parquet readers [datafusion-comet] via GitHub
• 2025/08/19 Re: [I] [EPIC] A collection of items to improve developer / CI speed [datafusion] via GitHub
• 2025/08/19 Re: [PR] fix: use `spark.comet.batchSize` instead of `conf.arrowMaxRecordsPerBatch` for data that is coming from Java [datafusion-comet] via GitHub
• 2025/08/19 Re: [PR] fix: remove fallback for int8 and int16 types with native Parquet readers [datafusion-comet] via GitHub
• 2025/08/19 [PR] TESTING: Only update dynamic topk filters when value changes, without ArcSwap [datafusion] via GitHub
• 2025/08/19 Re: [PR] fix: sort should output batch_size batches [datafusion] via GitHub
• 2025/08/19 [I] decryption not supported when using `auto` scan mode to read from Parquet [datafusion-comet] via GitHub
• 2025/08/19 Re: [PR] chore: Upgrade datafusion to version 49 [datafusion-python] via GitHub
• 2025/08/19 [PR] fix: remove fallback for int8 and int16 types with native Parquet readers [datafusion-comet] via GitHub
• 2025/08/19 [PR] fix: sort should output batch_size batches [datafusion] via GitHub
• 2025/08/19 Re: [I] follow up - remove incompatibility limitation on unsigned int types in native_iceberg_compat and native_datafusion readers [datafusion-comet] via GitHub
• 2025/08/19 Re: [PR] fix: [iceberg] Switch to OSS Spark and run Iceberg Spark tests in parallel [datafusion-comet] via GitHub
• 2025/08/19 Re: [PR] chore(deps): bump serde_json from 1.0.142 to 1.0.143 [datafusion] via GitHub
• 2025/08/19 Re: [PR] feat(spark): implement Spark conditional function if [datafusion] via GitHub
• 2025/08/19 Re: [PR] fix: [branch-0.9] Backport FFI fix [datafusion-comet] via GitHub
• 2025/08/19 [PR] chore(deps): bump syn from 2.0.105 to 2.0.106 [datafusion] via GitHub
• 2025/08/19 [PR] Have T: impl FileSource implement DataSource and own FileScanConfig [datafusion] via GitHub
• 2025/08/19 Re: [PR] Format `Date32` to string given timestamp specifiers [datafusion] via GitHub
• 2025/08/19 Re: [I] Feature: support `to_char(date, timstamp format)` [datafusion] via GitHub
• 2025/08/19 Re: [PR] Format `Date32` to string given timestamp specifiers [datafusion] via GitHub
• 2025/08/19 Re: [I] Memory leak in FFI_RecordBatchStream [datafusion] via GitHub
• 2025/08/19 Re: [I] Memory leak in FFI_RecordBatchStream [datafusion] via GitHub
• 2025/08/19 [I] Memory leak in FFI_RecordBatchStream [datafusion] via GitHub
• 2025/08/19 Re: [PR] FFI_RecordBatchStream was causing a memory leak [datafusion] via GitHub
• 2025/08/19 Re: [PR] Only update TopK dynamic filters if the new ones are more selective [datafusion] via GitHub
• 2025/08/19 Re: [I] `COLLATION` Support [datafusion] via GitHub
• 2025/08/19 Re: [PR] Add drop behavior to `DROP PRIMARY/FOREIGN KEY` [datafusion-sqlparser-rs] via GitHub
• 2025/08/19 Re: [PR] Push dynamic pushdown through cooperative and projection execs [datafusion] via GitHub
• 2025/08/19 Re: [I] Prepared physical plan reusage [datafusion] via GitHub
• 2025/08/19 Re: [PR] Only update TopK dynamic filters if the new ones are more selective [datafusion] via GitHub
• 2025/08/19 Re: [I] Exponential planning time (100s of seconds) with `UNION` and `ORDER BY` queries [datafusion] via GitHub
• 2025/08/19 [PR] fix: use `spark.comet.batchSize` instead of `conf.arrowMaxRecordsPerBatch` for data that is coming from Java [datafusion-comet] via GitHub
• 2025/08/19 Re: [PR] chore: Improve shuffle fallback reporting [datafusion-comet] via GitHub
• 2025/08/19 Re: [PR] chore: Add starting point for PySpark tests [datafusion-comet] via GitHub
• 2025/08/19 Re: [PR] (feat) add support for ArrayMin scalar function [datafusion-comet] via GitHub
• 2025/08/19 Re: [PR] chore: Remove obsolete supportedSortType function after Arrow updates [datafusion-comet] via GitHub
• 2025/08/19 Re: [PR] Only update TopK dynamic filters if the new ones are more selective [datafusion] via GitHub
• 2025/08/19 Re: [PR] Feat: Impl array flatten func [datafusion-comet] via GitHub
• 2025/08/19 Re: [I] Support data source sampling with TABLESAMPLE [datafusion] via GitHub
• 2025/08/19 Re: [PR] fix: deserialization error for `FilterExec` (predicates with inlist) [datafusion] via GitHub
• 2025/08/19 Re: [I] regression: inlist deserialization error [datafusion] via GitHub
• 2025/08/19 Re: [PR] fix: deserialization error for `FilterExec` (predicates with inlist) [datafusion] via GitHub
• 2025/08/19 Re: [PR] chore: Update `CometTestBase` to stop setting the scan implementation to `native_comet` [datafusion-comet] via GitHub
• 2025/08/19 Re: [I] CometTestBase should no longer set the scan implementation to `native_comet` [datafusion-comet] via GitHub
• 2025/08/19 Re: [PR] chore: Update `CometTestBase` to stop setting the scan implementation to `native_comet` [datafusion-comet] via GitHub
• 2025/08/19 Re: [PR] Fix HashJoinExec sideways information passing for partitioned queries [datafusion] via GitHub
• 2025/08/19 Re: [PR] Only update TopK dynamic filters if the new ones are more selective [datafusion] via GitHub
• 2025/08/19 Re: [PR] Only update TopK dynamic filters if the new ones are more selective [datafusion] via GitHub
• 2025/08/19 Re: [PR] Testing: Try test optimize performance for coalesce [datafusion] via GitHub
• 2025/08/19 Re: [PR] chore: Update `CometTestBase` to stop setting the scan implementation to `native_comet` [datafusion-comet] via GitHub
• 2025/08/19 Re: [PR] docs: Update confs to bypass Iceberg Spark issues [datafusion-comet] via GitHub
• 2025/08/19 [I] Time travel support [datafusion-sqlparser-rs] via GitHub
• 2025/08/19 [I] follow up - remove incompatibility limitation on unsigned int types in native_iceberg_compat and native_datafusion readers [datafusion-comet] via GitHub
• 2025/08/19 [PR] chore(deps): bump serde_json from 1.0.142 to 1.0.143 [datafusion] via GitHub
• 2025/08/19 [PR] feat: allow to `spawn`/`spawn_blocking` on a provided runtime in `RecordBatchReceiverStreamBuilder` [datafusion] via GitHub
• 2025/08/19 Re: [PR] feat: rpad support column for second arg instead of just literal [datafusion-comet] via GitHub
• 2025/08/19 Re: [PR] trivial: remove unnecessary clone() [datafusion-comet] via GitHub
• 2025/08/19 Re: [PR] feat: Add config option to log fallback reasons [datafusion-comet] via GitHub
• 2025/08/19 [PR] chore: Improve shuffle fallback reason [datafusion-comet] via GitHub
• 2025/08/19 Re: [I] Remove emitWarning and add config option to log fallback reasons [datafusion-comet] via GitHub
• 2025/08/19 Re: [PR] feat: Add config option to log fallback reasons [datafusion-comet] via GitHub
• 2025/08/19 [PR] DRAFT: Dynamic filters blog post [datafusion-site] via GitHub
• 2025/08/19 Re: [I] Improve "unsupported Spark partitioning" fallback message [datafusion-comet] via GitHub
• 2025/08/19 Re: [PR] fix: deserialization error for `FilterExec` (predicates with inlist) [datafusion] via GitHub
• 2025/08/19 Re: [PR] Push dynamic pushdown through cooperative and projection execs [datafusion] via GitHub
• 2025/08/19 Re: [PR] Unnest Correlated Subquery [datafusion] via GitHub
• 2025/08/19 Re: [I] Improve SHA2 user-error message in serdes code [datafusion-comet] via GitHub
• 2025/08/19 Re: [PR] chore: Use Datafusion's Sha2 and remove Comet's implementation. [datafusion-comet] via GitHub
• 2025/08/19 [I] Improve SHA2 user-error message in serdes code [datafusion-comet] via GitHub
• 2025/08/19 [PR] Push dynamic pushdown through cooperative and projection execs [datafusion] via GitHub
• 2025/08/19 Re: [PR] Add support for PostgreSQL JSON function 'RETURNING' clauses [datafusion-sqlparser-rs] via GitHub
• 2025/08/19 Re: [PR] feat: Add config option to log fallback reasons [datafusion-comet] via GitHub
• 2025/08/19 Re: [I] Improve "unsupported Spark partitioning" fallback message [datafusion-comet] via GitHub
• 2025/08/19 Re: [PR] Redshift: Add support for IAM_ROLE and IGNOREHEADER COPY options [datafusion-sqlparser-rs] via GitHub
• 2025/08/19 [I] Improve "unsupported Spark partitioning" fallback message [datafusion-comet] via GitHub
• 2025/08/19 Re: [PR] feat: rpad support column for second arg instead of just literal [datafusion-comet] via GitHub
• 2025/08/19 Re: [PR] chore: Update `CometTestBase` to stop setting the scan implementation to `native_comet` [datafusion-comet] via GitHub
• 2025/08/19 [PR] docs: Add Roadmap [datafusion-comet] via GitHub
• 2025/08/19 Re: [PR] chore: replace Schema with SchemaRef in PruningExpressionBuilder [datafusion] via GitHub
• 2025/08/19 Re: [PR] fix: [iceberg] Switch to OSS Spark and run Iceberg Spark tests in parallel [datafusion-comet] via GitHub
• 2025/08/19 Re: [PR] feat: rpad support column for second arg instead of just literal [datafusion-comet] via GitHub
• 2025/08/19 [PR] Add support for VACUUM in Redshift [datafusion-sqlparser-rs] via GitHub
• 2025/08/19 Re: [I] `COLLATION` Support [datafusion] via GitHub
• 2025/08/19 [I] [native_iceberg_compat] String collation support [datafusion-comet] via GitHub
• 2025/08/19 Re: [I] `COLLATION` Support [datafusion] via GitHub
• 2025/08/19 [I] Update Iceberg integration to use `native_iceberg_compat` scan [datafusion-comet] via GitHub
• 2025/08/19 Re: [PR] feat: Add config option to log fallback reasons [datafusion-comet] via GitHub
• 2025/08/19 Re: [PR] chore: Update `CometTestBase` to stop setting the scan implementation to `native_comet` [datafusion-comet] via GitHub
• 2025/08/19 Re: [PR] chore: Update `CometTestBase` to stop setting the scan implementation to `native_comet` [datafusion-comet] via GitHub
• 2025/08/19 Re: [I] Wrap in CoalesceBatchesExec more operators [datafusion-comet] via GitHub
• 2025/08/19 [I] ParquetReadSuite `unsupport Spark type/schema tests` need reimplementing [datafusion-comet] via GitHub
• 2025/08/19 Re: [I] Wrap in CoalesceBatchesExec more operators [datafusion-comet] via GitHub
• 2025/08/19 Re: [PR] chore: Upgrade datafusion to version 49 [datafusion-python] via GitHub
• 2025/08/19 Re: [I] Wrap in CoalesceBatchesExec more operators [datafusion-comet] via GitHub
• 2025/08/19 Re: [I] Refactor SortExec to use the dynamic filter pushdown approach from #17201 [datafusion] via GitHub
• 2025/08/19 Re: [PR] Preserve `distinct` and `ignore_nulls` in window expressions during proto serde [datafusion] via GitHub
• 2025/08/19 Re: [PR] Fix Analyze Exec protobuf roundtrip [datafusion] via GitHub
• 2025/08/19 Re: [PR] Fix: ListingTableFactory hive column detection [datafusion] via GitHub
• 2025/08/19 Re: [PR] fix: Windows paths crashing core tests [datafusion] via GitHub
• 2025/08/19 Re: [PR] chore(deps): Update sqlparser to 0.58 [datafusion] via GitHub
• 2025/08/19 Re: [PR] chore(deps): Update sqlparser to 0.58 [datafusion] via GitHub
• 2025/08/19 Re: [PR] chore(deps): Update sqlparser to 0.58 [datafusion] via GitHub
• 2025/08/19 [I] Refactor SortExec to use the dynamic filter pushdown approach from #17201 [datafusion] via GitHub
• 2025/08/19 Re: [PR] Fix dynamic filter pushdown in HashJoinExec [datafusion] via GitHub
• 2025/08/19 [PR] Configure cli test that requires backtrace to be optional [datafusion] via GitHub
• 2025/08/19 Re: [I] Fast parquet order inversion [datafusion] via GitHub
• 2025/08/19 Re: [PR] Configure cli test that requires backtrace to be optional [datafusion] via GitHub
• 2025/08/19 Re: [PR] chore: add docs for how to use TrackConsumersPool [datafusion] via GitHub
• 2025/08/19 Re: [I] Dynamic Filter Pushdown is being applied to the wrong table [datafusion] via GitHub
• 2025/08/19 Re: [PR] Fix dynamic filter pushdown in HashJoinExec [datafusion] via GitHub
• 2025/08/19 [I] Wrap in CoalesceBatchesExec more operators [datafusion-comet] via GitHub
• 2025/08/19 Re: [I] Add a fine grain memory usage tracking / break down of memory usage *within* each operator [datafusion] via GitHub
• 2025/08/19 Re: [PR] Fix HashJoinExec sideways information passing for partitioned queries [datafusion] via GitHub
• 2025/08/19 Re: [I] Fast parquet order inversion [datafusion] via GitHub
• 2025/08/19 Re: [PR] Add Memory Profiling Support to DataFusion CLI [datafusion] via GitHub
• 2025/08/19 Re: [PR] Add Memory Profiling Support to DataFusion CLI [datafusion] via GitHub
• 2025/08/19 Re: [PR] chore: add docs for how to use TrackConsumersPool [datafusion] via GitHub
• 2025/08/19 Re: [PR] feat: Add optional extended metrics to sort_batch function [datafusion] via GitHub
• 2025/08/19 Re: [PR] Fix dynamic filter pushdown in HashJoinExec [datafusion] via GitHub
• 2025/08/19 Re: [PR] Fix HashJoinExec sideways information passing for partitioned queries [datafusion] via GitHub
• 2025/08/19 Re: [PR] Add Memory Profiling Support to DataFusion CLI [datafusion] via GitHub
• 2025/08/19 Re: [I] `cargo test --test fuzz` fails with "Too many open files" [datafusion] via GitHub
• 2025/08/19 Re: [PR] Minor: improve error message when file creation failed [datafusion] via GitHub
• 2025/08/18 Re: [PR] Add Memory Profiling Support to DataFusion CLI [datafusion] via GitHub
• 2025/08/18 Re: [PR] Add Memory Profiling Support to DataFusion CLI [datafusion] via GitHub
• 2025/08/18 Re: [PR] Add Memory Profiling Support to DataFusion CLI [datafusion] via GitHub
• 2025/08/18 Re: [PR] Add Memory Profiling Support to DataFusion CLI [datafusion] via GitHub
• 2025/08/18 [PR] Support `distinct` and `ignore_nulls` in window expressions [datafusion] via GitHub
• 2025/08/18 Re: [PR] Fix Analyze Exec protobuf roundtrip [datafusion] via GitHub
• 2025/08/18 Re: [I] Fast parquet order inversion [datafusion] via GitHub
• 2025/08/18 [PR] Fix Analyze Exec protobuf roundtrip [datafusion] via GitHub
• 2025/08/18 Re: [PR] Implement `partition_statistics` API for `RepartitionExec` [datafusion] via GitHub
• 2025/08/18 Re: [PR] [datafusion-spark] Implement ceil&floor function for spark [datafusion] via GitHub
• 2025/08/18 Re: [PR] Draft: Use upstream arrow `coalesce` kernel in DataFusion [datafusion] via GitHub
• 2025/08/18 Re: [PR] [Draft] Add Run End Encoding casts to Datafusion [datafusion] via GitHub
• 2025/08/18 Re: [PR] Improved experience when remote object store URL does not end in / [datafusion] via GitHub
• 2025/08/18 Re: [PR] Test experiment load page index with columns [datafusion] via GitHub
• 2025/08/18 Re: [PR] feat: Add decimal support for `round` [datafusion] via GitHub
• 2025/08/18 Re: [PR] Add dynamic filter (bounds) pushdown to HashJoinExec [datafusion] via GitHub
• 2025/08/18 Re: [PR] chore: Refactor GetArrayItem, ElementAt, GetArrayStructFields out of QueryPlanSerde [datafusion-comet] via GitHub
• 2025/08/18 Re: [PR] ignore: experiment [datafusion-comet] via GitHub
• 2025/08/18 Re: [I] Fix test `unsupported Spark types` in ParquetReadSuite [datafusion-comet] via GitHub
• 2025/08/18 Re: [I] Deprecate `native_comet` scan (remove from `auto` scan mode) [datafusion-comet] via GitHub
• 2025/08/18 [I] Deprecate `native_comet` scan (remove from `auto` scan mode) [datafusion-comet] via GitHub
• 2025/08/18 Re: [PR] chore: Use Datafusion's Sha2 and remove Comet's implementation. [datafusion-comet] via GitHub
• 2025/08/18 [I] Add roadmap to contributors guide [datafusion-comet] via GitHub
• 2025/08/18 Re: [PR] ignore: experiment [datafusion-comet] via GitHub
• 2025/08/18 Re: [PR] trivial: remove unnecessary clone() [datafusion-comet] via GitHub
• 2025/08/18 Re: [I] Error reading parquet files on S3 using native_iceberg_compat reader when the path contains URL-encode escape sequences [datafusion-comet] via GitHub
• 2025/08/18 Re: [PR] fix: Fix repeatedly url-decode path when reading parquet from s3 using native parquet reader [datafusion-comet] via GitHub
• 2025/08/18 [PR] ignore: experiment [datafusion-comet] via GitHub
• 2025/08/18 Re: [I] Add a fine grain memory usage tracking / break down of memory usage *within* each operator [datafusion] via GitHub
• 2025/08/18 Re: [PR] chore: Pass Spark configs to native `createPlan` [datafusion-comet] via GitHub
• 2025/08/18 Re: [PR] chore: Improve Arrow FFI documentation [datafusion-comet] via GitHub
• 2025/08/18 Re: [PR] docs: Update confs to bypass Iceberg Spark issues [datafusion-comet] via GitHub
• 2025/08/18 Re: [I] Support data source sampling with TABLESAMPLE [datafusion] via GitHub
• 2025/08/18 Re: [PR] chore: Improve Arrow FFI documentation [datafusion-comet] via GitHub
• 2025/08/18 Re: [PR] chore: Pass Spark configs to native `createPlan` [datafusion-comet] via GitHub
• 2025/08/18 Re: [PR] chore: Pass Spark configs to native `createPlan` [datafusion-comet] via GitHub
• 2025/08/18 Re: [PR] chore: fix typos [datafusion] via GitHub
• 2025/08/18 Re: [PR] Fix: ListingTableFactory hive column detection [datafusion] via GitHub
• 2025/08/18 Re: [PR] Fix: ListingTableFactory hive column detection [datafusion] via GitHub
• 2025/08/18 [PR] Fix: ListingTableFactory paths with dots [datafusion] via GitHub
• 2025/08/18 Re: [PR] Fix: ListingTableFactory hive column detection [datafusion] via GitHub
• 2025/08/18 [PR] Fix: ListingTableFactory hive column detection [datafusion] via GitHub
• 2025/08/18 Re: [PR] chore: Pass Spark configs to native `createPlan` [datafusion-comet] via GitHub
• 2025/08/18 Re: [PR] chore: Improve Arrow FFI documentation [datafusion-comet] via GitHub
• 2025/08/18 [I] Fix test `unsupported Spark types` in ParquetReadSuite [datafusion-comet] via GitHub
• 2025/08/18 Re: [PR] chore: fix typos [datafusion] via GitHub
• 2025/08/18 Re: [PR] chore: Update `CometTestBase` to stop setting the scan implementation to `native_comet` [datafusion-comet] via GitHub
• 2025/08/18 Re: [PR] chore: Pass Spark configs to native `createPlan` [datafusion-comet] via GitHub
• 2025/08/18 Re: [PR] chore: Update `CometTestBase` to stop setting the scan implementation to `native_comet` [datafusion-comet] via GitHub
• 2025/08/18 Re: [PR] chore: Update `CometTestBase` to stop setting the scan implementation to `native_comet` [datafusion-comet] via GitHub
• 2025/08/18 Re: [PR] chore: Update `CometTestBase` to stop setting the scan implementation to `native_comet` [datafusion-comet] via GitHub
• 2025/08/18 Re: [PR] chore: Update `CometTestBase` to stop setting the scan implementation to `native_comet` [datafusion-comet] via GitHub
• 2025/08/18 Re: [PR] chore: fix typos [datafusion] via GitHub
• 2025/08/18 Re: [PR] chore: Update `CometTestBase` to stop setting the scan implementation to `native_comet` [datafusion-comet] via GitHub
• 2025/08/18 Re: [PR] chore: Update `CometTestBase` to stop setting the scan implementation to `native_comet` [datafusion-comet] via GitHub
• 2025/08/18 Re: [PR] chore: Improve Arrow FFI documentation [datafusion-comet] via GitHub
• 2025/08/18 Re: [PR] doc: update macos standalone spark start instructions [datafusion-comet] via GitHub
• 2025/08/18 Re: [PR] chore: Update `CometTestBase` to stop setting the scan implementation to `native_comet` [datafusion-comet] via GitHub
• 2025/08/18 Re: [PR] chore: CometExecRule code cleanup [datafusion-comet] via GitHub
• 2025/08/18 Re: [I] SQL/PGQ support [datafusion-sqlparser-rs] via GitHub
• 2025/08/18 Re: [I] SQL/PGQ support [datafusion-sqlparser-rs] via GitHub
• 2025/08/18 Re: [PR] chore: fix typos [datafusion] via GitHub
• 2025/08/18 Re: [PR] chore: fix typos [datafusion] via GitHub
• 2025/08/18 Re: [I] `array_contains` test causes panic if default scan is `auto` [datafusion-comet] via GitHub
• 2025/08/18 Re: [PR] Fix dynamic filter pushdown in HashJoinExec [datafusion] via GitHub
• 2025/08/18 Re: [PR] chore: fix typos [datafusion] via GitHub
• 2025/08/18 Re: [PR] chore: fix typos [datafusion] via GitHub
• 2025/08/18 Re: [PR] Fix dynamic filter pushdown in HashJoinExec [datafusion] via GitHub

• Earlier messages
• Later messages