Re: Getting started guide

2016-02-27 Thread Vishnu Viswanath
Thank you everyone. On Sat, Feb 27, 2016 at 2:00 PM, Jason Altekruse wrote: > Wes it right, I should have qualified my statement about the Drill code. As > is stated in the Arrow repo initial design docs, the exact memory layout is > not finalized. That being said, while the format is designed t

Re: Getting started guide

2016-02-27 Thread Jason Altekruse
Wes it right, I should have qualified my statement about the Drill code. As is stated in the Arrow repo initial design docs, the exact memory layout is not finalized. That being said, while the format is designed to be used in-memory, it doesn't have the same sticking point about backwards compatib

Re: Getting started guide

2016-02-27 Thread Wes McKinney
Note that we have not prioritized building a lot of new software for Arrow (outside of the basic C++ implementation and the Drill Java extraction) because there are a number of details that we need to work out as a group in the coming weeks: - Lingering physical memory layout questions, see workin

Re: Getting started guide

2016-02-27 Thread Jason Altekruse
The java version of the Arrow project is reasonably consumable. The code was extracted from the Apache Drill project which has been using this columnar representation since its inception. Steven Phillips is working on finishing the extraction of the necessary interfaces from Drill over in his fork

Re: Getting started guide

2016-02-26 Thread Vishnu Viswanath
Thanks Leif, I am not trying to incorporate Arrow to any production system. I am just trying to learn this new DS. If you have come across any blogs or if you can tell what should be the starting steps in using Arrow, could you please let me know. -- Thanks and Regards, Vishnu Viswanath, *www.vis

Re: Getting started guide

2016-02-26 Thread Leif Walsh
Arrow doesn't seem to be ready for use yet. I think it's an aspirational project. I'd watch for announcements soon but I wouldn't try to incorporate today. On Fri, Feb 26, 2016 at 2:10 PM Slava B wrote: > Agree, also looking for such tutorial > > On Fri, Feb 26, 2016 at 11:05 AM, Vishnu Viswan

Re: Getting started guide

2016-02-26 Thread Slava B
Agree, also looking for such tutorial On Fri, Feb 26, 2016 at 11:05 AM, Vishnu Viswanath < vishnu.viswanat...@gmail.com> wrote: > Hi All, > > I just joined this list, and would like to know if there is any > documentation on how to get started with Apache Arrow. I am interested in > using arrow a

Getting started guide

2016-02-26 Thread Vishnu Viswanath
Hi All, I just joined this list, and would like to know if there is any documentation on how to get started with Apache Arrow. I am interested in using arrow along with Spark or Flink. Thanks and Regards, Vishnu Viswanath, *www.vishnuviswanath.com *