Re: [Discuss] C stream interface

2020-09-01 Thread Wes McKinney
Per the other e-mail thread I think this is a good idea and will unblock a number of use cases (for example, a C FFI with no knowledge of pyarrow could consume the record batches produced by a Dataset). I'm not sure it's necessary to formalize it / freeze the ABI right away until we get some more p

Re: [Discuss] C stream interface

2020-09-01 Thread Antoine Pitrou
Also, for the record, I've temporarily uploaded a rendered version of the doc here: https://pitrou.net/arrowdevdoc/format/CStreamInterface.html Regards Antoine. Le 01/09/2020 à 17:25, Antoine Pitrou a écrit : > > Hello, > > We are proposing an experimental C stream interface which builds on

[Discuss] C stream interface

2020-09-01 Thread Antoine Pitrou
Hello, We are proposing an experimental C stream interface which builds on the existing C data interface and is defined by a single C struct: struct ArrowArrayStream { // Callbacks providing stream functionality int (*get_schema)(struct ArrowArrayStream*, struct ArrowSchema* out); int (*g