GitHub user alamb added a comment to the discussion: DISCUSSION: May 27, 2025 DataFusion Meetup in Amsterdam
I think those topics would be great personally BTW In my mind the dream integration scenario is something like @roeap is actively working in https://github.com/delta-incubator/deltalake-datafusion/blob/0adfc493b351da6e937e16d0c68a5b20266a8db0/crates/datafusion/examples/simple_read.rs#L11-L33 (that is for delta, but he has some plans for iceberg too) ```rust #[tokio::main(flavor = "multi_thread", worker_threads = 4)] async fn main() -> Result<(), Box<dyn std::error::Error>> { let ctx = SessionContext::new().enable_delta_kernel(None); let base = Url::from_directory_path(std::fs::canonicalize(PATH).unwrap()).unwrap(); let path = format!("{}column_mapping/delta", base.to_string()); // build a table and get the latest snapshot from it let table = Table::try_from_uri(path)?; ctx.register_delta("delta_table", table.location()).await?; let df = ctx.sql("SELECT * FROM delta_table").await?; let df = df.collect().await?; print_batches(&df)?; let log_provider = DeltaLogTableProvider::try_new(table.into())?; ctx.register_table("delta_log", Arc::new(log_provider))?; let df = ctx .sql("SELECT add['path'] as path FROM delta_log WHERE add['path'] IS NOT NULL") .await?; let df = df.collect().await?; print_batches(&df)?; Ok(()) } ``` GitHub link: https://github.com/apache/datafusion/discussions/16038#discussioncomment-13149779 ---- This is an automatically sent email for github@datafusion.apache.org. To unsubscribe, please send an email to: github-unsubscr...@datafusion.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
