Re: How to create list> structure

2018-08-31 Thread Xu,Wenjian
Thanks a lot, Wes. On Fri, Aug 24, 2018 at 12:17 AM Wes McKinney wrote: > hi Wenjian -- I am not an expert in the Java library. Perhaps Bryan, > Li, Jacques, or Sidd can point you in the right direction. You can > take a look at the Dremio codebase to see more examples of Arrow in > action > > h

Re: How to create list> structure

2018-08-23 Thread Wes McKinney
hi Wenjian -- I am not an expert in the Java library. Perhaps Bryan, Li, Jacques, or Sidd can point you in the right direction. You can take a look at the Dremio codebase to see more examples of Arrow in action https://github.com/dremio/dremio-oss - Wes On Tue, Aug 14, 2018 at 10:08 PM, Xu,Wenji

Re: How to create list> structure

2018-08-14 Thread Xu,Wenjian
Hi Wes, Thank you for your kind help. Actually I am working on the Java UDF iterating the *array* in SQL language. I understand that , in order to represent *array* in Arrow format, I could use ListVector with VarCharVector as the inner list. My question is, how to efficiently access the all the

Re: How to create list> structure

2018-08-14 Thread Wes McKinney
hi Wenjian, In C++ you can use ListBuilder together with UInt8Builder. There are examples of using ListBuilder you can look at in src/arrow/array-test.cc. For Java you might want to have a look at how Spark SQL converts its Array types into Arrow (there should be other examples in the Java unit t

How to create list> structure

2018-08-13 Thread Xu,Wenjian
Hi, If I want to create list> structure (as shown in https://arrow.apache.org/docs/memory_layout.html), what class(es) do I need to use in Java API and C++ API? Any suggestion would be appreciated. Thanks. Best regards, Wenjian