alihan-synnada commented on issue #13411: URL: https://github.com/apache/datafusion/issues/13411#issuecomment-2516855980
Partially completed in #13412 TODO: - [ ] Create decoders for Arrow and Avro. - [ ] Deserialize the stream as it becomes available, without reading the entire stream first, for Arrow and Avro. Points to keep in mind: - We can implement the ArrowDecoder locally, and then move it to upstream if it can help with deduplication and code organization. - We will leave Parquet as is, it has its own driver and does other stuff like reading in parallel. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
