Hi All, I'm proposing some Java API changes to MessageReader, with minor changes to ArrowStreamReader and MessageSerializer, as part of ARROW-2704 [1] and can be seen in the PR [2]. These changes are to improve processing an Arrow stream on a per Message basis.
A while ago I introduced the MessageReader interface in anticipation of some future work, but it fell a little short of what I needed. So after tweaking the APIs a bit, it can now allow the user to implement message stream processing without knowing specifics about the stream format and in an optimal way that avoids unnecessary buffer copying. If you have some concerns about these APIs, please discuss in the PR at [2]. If no one objects, it would be great to get these changes in version 0.10.0. Thanks! Bryan [1]: https://issues.apache.org/jira/browse/ARROW-2704 [2]: https://github.com/apache/arrow/pull/2139
