Re: [IPC] Delta Dictionary Flag Clarification for Multi-Batch IPC

2024-01-24 Thread Micah Kornfield
Hi Chris, My interpretations: 1) I'm not sure it is clearly defined, but my impression is the first dictionary is never a delta dictionary (option 1) 2) I don't think they are prevented from switching state (which I supposed is more complicated?) but hopefully not by much? 3) Dictionaries are reuse

Re: [DataFusion] New Blog Post -- DataFusion 34.0

2024-01-24 Thread Micah Kornfield
+1 Nice work. On Tue, Jan 23, 2024 at 12:29 PM Antoine Pitrou wrote: > > Impressive, thank you! > > > Le 23/01/2024 à 14:06, Andrew Lamb a écrit : > > If anyone is interested, here is a new blog post about the last 6 months > in > > DataFusion[1] and where we are heading this year. > > > > Andre

Arrow R Package Development Sync Call - New meeting time and Google Calendar link

2024-01-24 Thread Nic Crane
The fortnightly Arrow R package dev community call has a new time, alternating between Mondays at 15:00 GMT (10:00 ET) and 16:00 GMT (11:00 ET) to facilitate more times that folks involved in contributing to the R package project can make. I will no longer be sending out these notifications to the

Re: [DISCUSS] Donation of a Spark native engine based on DataFusion & Arrow

2024-01-24 Thread Jacques Nadeau
For those that are interested wrt lang types/lines... Language files blankcomment code Rust

Re: [DISCUSS] Donation of a Spark native engine based on DataFusion & Arrow

2024-01-24 Thread Chao Sun
Thanks Jacques and everyone here for the feedback! We just created a PR https://github.com/apache/arrow-datafusion-comet/pull/1 for the donation vote and IP clearance. Please take a look there and provide your valuable comments. Best, Chao On Thu, Jan 18, 2024 at 5:24 PM Jacques Nadeau wrote: >