Re: [DISCUSS][Rust] Performance Measurements (was Biweekly sync call for arrow/datafusion again?)

2022-03-16 Thread Andrew Lamb
> > > > > - By "pipeline-breaking" I assume you mean "very slow", but can you > give > > me > > details? Does this arise from some particular observation, or other > > reported issues? > > > > In general pipeline breaking means that the output of the operator can't > be > > produced until it has se

Arrow sync call March 16 at 12:00 US/Eastern, 16:00 UTC

2022-03-16 Thread Ian Cook
Hi all, Our biweekly sync call is today at 12:00 noon Eastern time. For attendees in locations where Daylight Saving Time is observed but has not yet begun, please note that this is one hour earlier than the usual time in your local time zone. The Zoom meeting URL for this and other biweekly Arro

Add JSON data to Arrow-Testing

2022-03-16 Thread Matthew Turner
Hello, I'm working on adding some JSON functionality to DataFusion and would like to leverage on existing Arrow golden source testing data for testing purposes. I don't see JSON / NDJSON as an existing file format there (https://github.com/apache/arrow-testing/tree/master/data). Is there a rea

Re: Arrow sync call March 16 at 12:00 US/Eastern, 16:00 UTC

2022-03-16 Thread Rok Mihevc
Sorry to all who will have missed the call because of the Daylight Saving Time change. Here are the notes: Attendees: James Duong, Micah Kornfield, Eduardo Ponce, Will Jones, Rok Mihevc, David Li, Niranda Perera, Alenka Frim, Ian Joiner Discussion: * James Duong - Out of curiosity - does Arrow ha

[JAVA] JDK Support Policy?

2022-03-16 Thread Micah Kornfield
I don't think we've ever discussed a formal policy on which JDK versions we intend to support in Java. JDK8 is ending active support this month (but still has premium/security support available). Spark seems like it will continue to support JDK8 through its 3.x versions which are still under acti

[VOTE] Extend Arrow Flight SQL with GetXdbcTypeInfo, SQL type info in schemas

2022-03-16 Thread David Li
Hello, Jose Almeida and James Duong have proposed two additions to Arrow Flight SQL, an experimental protocol for interacting with SQL databases over Arrow Flight. The purpose of these additions is to provide necessary metadata for implementing a JDBC driver on top of Flight SQL [1]. The addit