Re: [FlightSQL] Higher-level facade API to increase adoption/audience? Or does this belong as a personal project

2022-03-12 Thread Micah Kornfield
Hi Gavin, > Just curious whether there is any interest/intention of possibly making a > higher level API around the basic FlightSQL one? IIUC, I don't think this is an issue with Flight but one with generic conversion between data into Arrow. I don't think anyone is actively working on somethin

[FlightSQL] Higher-level facade API to increase adoption/audience? Or does this belong as a personal project

2022-03-12 Thread Gavin Ray
While trying to implement and introduce the idea of adopting FlightSQL, the largest challenge was the API itself I know it's meant to be low-level. But I found that most of the development time was in code to convert to/from row-based data (IE Map) and Java types, and columnar data + Arrow types.

Re: [VOTE] Release Apache Arrow 7.0.0 - Java artifacts

2022-03-12 Thread Kun Liu
+1 non-binding just uploaded the missing pom and don't need to release the 7.0.1 Thanks, Kun Rafael Telles 于2022年3月12日周六 04:18写道: > +1 > > Em sex., 11 de mar. de 2022 às 16:10, José Almeida < > jose.alme...@simbioseventures.com> escreveu: > > > +1 > > > > On Fri, Mar 11, 2022 at 4:09 PM Ray L

[RUST][DataFusion] Renaming and refactoring towards multi-tenancy

2022-03-12 Thread Andrew Lamb
Greetings to DataFusion user and developers. There is a proposed change to rename some of the core apis [1] to clarify and prepare for better multi-tenant support that I wanted to call attention to for anyone interested. Please leave comments on the PR if you would like to join in the discussion.

[DISCUSS][Rust] Performance Measurements (was Biweekly sync call for arrow/datafusion again?)

2022-03-12 Thread Andrew Lamb
Hi Bob, > - By "pipeline-breaking" I assume you mean "very slow", but can you give me details? Does this arise from some particular observation, or other reported issues? In general pipeline breaking means that the output of the operator can't be produced until it has seen *ALL* its input. For e