hi Animesh, I suggest you try the ArrowStreamReader/Writer or ArrowFileReader/Writer classes. See https://github.com/apache/arrow/blob/master/java/tools/src/main/java/org/apache/arrow/tools/Integration.java for example working code for this
- Wes On Thu, Dec 14, 2017 at 8:30 AM, Animesh Trivedi <animesh.triv...@gmail.com> wrote: > Hi all, > > It might be a trivial question, so please let me know if I am missing > something. > > I am trying to write and read files in the Arrow format in Java. My data is > simple flat schema with primitive types. I already have the data in Java. > So my questions are: > 1. Is this possible or am I fundamentally missing something what Arrow can > or cannot do (or is designed to do). I assume that an efficient in-memory > columnar data format should work with files too. > 2. Can you point me out to a working example? or a starting example. > Intuitively I am looking for a way to define schema, write/read column > vectors to/from files as one does with Parquet or ORC. > > I try to locate some working examples with ArrowFile[Reader/Writer] classes > in the maven tests but so far not sure where to start. > > Thanks, > -- > Animesh
