IPC with Systems Using Java version of Apache Arrow

Hi, I am planning to do some experiments with cross-system communication between Hbase and Spark, so I wanted to understand if at all IPC between HBase and Spark possible ? Both are in Java. This question because as I don't see anyway of memory sharing IPC in Java library. Thanks, Sanjay

IPC with Java Arrow

Hi, How is the Arrow Buffer memory shared between two Java processes(let's say Hbase and Apache Drill) ? Thanks,Sanjay

RE: Arrow Java Build Failiure

I just checked out the tip > > > of master and was able to build and run the tests with "mvn clean > > > install". > > > > > > Jason Altekruse > > > Software Engineer at Dremio > > > Apache Drill Committer > > > > &

RE: Arrow Java Build Failiure

with "mvn clean install". > > > > Jason Altekruse > > Software Engineer at Dremio > > Apache Drill Committer > > > > On Thu, Sep 1, 2016 at 11:25 AM, Sanjay Rao wrote: > > > > > Hi, > > > I am unable to build Arrow Java version, it's failing with error: package > > > com.google.flatbuffers does not exist > > > Thanks,Sanjay >

RE: Arrow Java Build Failiure

was able to build and run the tests with "mvn clean install". > > Jason Altekruse > Software Engineer at Dremio > Apache Drill Committer > > On Thu, Sep 1, 2016 at 11:25 AM, Sanjay Rao wrote: > > > Hi, > > I am unable to build Arrow Java version, it&#x

RE: Vector Bit Pattern Search

Aug 30, 2016 at 5:15 AM, Sanjay Rao wrote: > > > Hi, > > I am trying to write a sample code where I could write the values into > > Buffer probable read the value from CSV file and store them in-memory and > > later do bit-pattern search, I am doing performance benchmark a

Arrow Java Build Failiure

Hi, I am unable to build Arrow Java version, it's failing with error: package com.google.flatbuffers does not exist Thanks,Sanjay

Vector Bit Pattern Search

Hi, I am trying to write a sample code where I could write the values into Buffer probable read the value from CSV file and store them in-memory and later do bit-pattern search, I am doing performance benchmark as my own study. It would help me if someone could get me the sample code where I coul

Building 64 bit Arrow

Hi, I am in process of building 64 bit Arrow CPP version, I could get all thridparties compiled, now facing below error [ 63%] Built target arrow_benchmark_mainLinking CXX executable ../../debug/column-benchmarkld: warning: file ../../../thirdparty/benchmark-1.0.0/libbenchmark.a(benchmark.cc.o):

RE: Arrow client C++ Samples with Arrow APIs for Research work

Research work > To: dev@arrow.apache.org > > Hi Sanjay, > Arrow is focusing on the format and vectorized access. > For now there is no higher level algorithm in Arrow itself. > > > On Sun, Aug 7, 2016 at 11:13 PM, Sanjay Rao wrote: > > > Hi, > > I am look

RE: Give me pointers where I can start Arrow CPP

Your reply is appreciated. Thanks,Sanjay > From: getsanjay...@live.com > To: dev@arrow.apache.org > Subject: Give me pointers where I can start Arrow CPP > Date: Mon, 8 Aug 2016 11:27:40 + > > Hi, > Looking for some API docs, or any sample programs or let me know how can I do > some basic op

Give me pointers where I can start Arrow CPP

Hi, Looking for some API docs, or any sample programs or let me know how can I do some basic operations like store and stream/search(if supported). Thanks,Sanjay

Arrow client C++ Samples with Arrow APIs for Research work

Hi, I am looking for some C++ Samples which I can get started with, with Arrow APIs. Any samples like Top N AlgorithmComplex Key-Value Pair search. Thanks,Sanjay

RE: Is there plan to support BigEndian Systems like SUN SPARC Hardware ?

but for the most part there haven't > been any problems. > > - Wes > > On Fri, Aug 5, 2016 at 4:39 AM, Sanjay Rao wrote: > > Some places where explicit check for Little Endian is there- > > ./memory/src/main/java/io/netty/buffer/UnsafeDirectLittleEndian.java:if

RE: Is CPP version of Arrow having all modules/functionality as Java version ?

be validated with integration > tests in which data constructed in Java is sent to a C++ process and > pulled back, and vice versa. > > Can you let me know which specific operations you are referring to? > Would be great to create some JIRAs enumerating the missing > functionality. >

RE: Is there plan to support BigEndian Systems like SUN SPARC Hardware ?

field > > > wrote: > > > > > >> Hi Sanjay, > > >> I think we are trying to work that out now. As you've seen with some of > > >> you initial investigation we have no coverage for big-endian machines > > yet. > > >> But i

Is CPP version of Arrow having all modules/functionality as Java version ?

Why this question is I don't see much of Vector operations in CPP. --Sanjay

RE: Core dump while building with CPP

ERS_LITTLEENDIAN=0 to > CMAKE_CXX_FLAGS (you can do this on the command line). > > Since not many of us have access to big endian hardware, it would be > helpful of you could submit a patch indicating what you had to do to > get things working on your platform. > > Thanks > >

Core dump while building with CPP

cmake -DARROW_BUILD_BENCHMARKS=ON .make[ 0%] Running flatc compiler on /u01/hadoop/src/arrow/arrow/cpp/../format/Message.fbsAssertion failed: *reinterpret_cast(&endiantest) == FLATBUFFERS_LITTLEENDIAN, file /u01/hadoop/src/arrow/arrow/cpp/thirdparty/flatbuffers-1.3.0/include/flatbuffers/fl

RE: Is there plan to support BigEndian Systems like SUN SPARC Hardware ?

Hi Wes, Hi Micah, I understood what you meant, so point 2. Arrow working with Big Endian machine to Big Endian shouldn't be an issue right ? Please confirm. Thanks,Sanjay > From: wesmck...@gmail.com > Date: Mon, 1 Aug 2016 11:07:07 -0700 > Subject: Re: Is there plan to support BigEndian Systems li

RE: Is LittleEndian system mandatory for using Apache Arrow ?

we would > need to add byte-swapping logic in the IPC code path to support big > endian systems. > > On Mon, Aug 1, 2016 at 9:31 AM, Sanjay Rao wrote: > > Hi Micah, > > Thanks, I am trying to write Java examples with Java libraries of Apache > > Arrow on Big E

RE: Is LittleEndian system mandatory for using Apache Arrow ?

; > https://mail-archives.apache.org/mod_mbox/arrow-dev/201604.mbox/%3CCAK7Z5T_0T9hOa=mbJ=V30jc_Em169e=qjpyqnsblrakb8dm...@mail.gmail.com%3E > > On Mon, Aug 1, 2016 at 8:57 AM, Sanjay Rao wrote: > > > Hi, > > I read that Integer representation is assumed to LittleEndian in Arrow, > > does this mean we cannot use Arrow in Big Endian Systems like SPARC ? > > > > Thanks,Sanjay

Is there plan to support BigEndian Systems like SUN SPARC Hardware ?

As Apache SPARK supports Big Endian systems. Thanks,Sanjay

Is LittleEndian system mandatory for using Apache Arrow ?

Hi, I read that Integer representation is assumed to LittleEndian in Arrow, does this mean we cannot use Arrow in Big Endian Systems like SPARC ? Thanks,Sanjay

RE: Can someone help me how should I start using Arrow Java Jars ?

rt = 0; > vh.end = bytes.length; > // write string > writer.varChar(name).write(vh); > } > } > // write num > writer.integer("age").writeInt(21); > > list.getWriter().endList(); > > list.clear(); > list.close(); > > allocator.close(); > > > -Kiril > > On 1 August 2016 at 09:54, Sanjay Rao wrote: > > > Awaiting your reply. > > Thanks,Sanjay > > > > > -- > Thanks, > -Kiril > Phone +37126409291 > Riga, Latvia > Skype perimetr122

Can someone help me how should I start using Arrow Java Jars ?

Awaiting your reply. Thanks,Sanjay

Arrow on Ubuntu

Hi,I have built Java version of Apache Arrow on Ubuntu./memory/target/arrow-memory-0.1-SNAPSHOT-tests.jar./memory/target/arrow-memory-0.1-SNAPSHOT.jar./vector/target/vector-0.1-SNAPSHOT-tests.jar./vector/target/vector-0.1-SNAPSHOT.jar I would need documentation on how to run or use Arrow libraries

Arrow on Ubuntu

Hi,I have built Java version of Apache Arrow on Ubuntu./memory/target/arrow-memory-0.1-SNAPSHOT-tests.jar./memory/target/arrow-memory-0.1-SNAPSHOT.jar./vector/target/vector-0.1-SNAPSHOT-tests.jar./vector/target/vector-0.1-SNAPSHOT.jarI would need documentation on how to run or use Arrow libraries