Re: Arrow examples

2016-03-03 Thread Dmitriy Morozov
sion code we write right now may end up being temporary. > Hopefully the Spark columnar memory layout will end up being very > nearly the same as the official Arrow layout so that limited or no > conversion will be necessary. > > Thanks > Wes > > On Wed, Feb 24, 2016 at 12:38 PM,

Arrow examples

2016-02-24 Thread Dmitriy Morozov
Hello everyone, I'm just starting with Arrow. I'd like to see how good Arrow at caching when used in conjunction with Allixio (Tachyon). The use case that I'm going to validate involves reading data from Spark's DataFrame, storing in Tachyon in Arrow and then reading back into DataFrame. I checked