RE: [ext] Re: language independent representation of filter expressions

2020-07-24 Thread Patrick Pai
vided by Gandiva? What are the issues you've seen with it? On Wed, Jul 22, 2020 at 10:24 AM Patrick Pai wrote: > Hi all, > > After some discussion with Steve, we'd like to propose and get > feedback on an alternative to representing expressions entirely with > flatbuf

Re: language independent representation of filter expressions

2020-07-22 Thread Patrick Pai
Hi all, After some discussion with Steve, we'd like to propose and get feedback on an alternative to representing expressions entirely with flatbuffers. To give some context, we thought about how we'd construct flatbuffer expressions in Java or another language if we went down that route. We re

How to autoformat cpp code?

2020-07-16 Thread Patrick Pai
I've written some cpp code and I want to autoformat it so that lint checks pass. I saw the 'clang-format' service on https://arrow.apache.org/docs/developers/integration.html but this doc seems outdated - I can only find the service 'ubuntu-lint' in my docker-compose.yml I tried the following s

Re: [DISCUSS] Ongoing LZ4 problems with Parquet files

2020-07-13 Thread Patrick Pai
I'll volunteer to disable writing/reading LZ4. I'll submit a patch in the next few days. On 2020/07/12 22:11:33, Wes McKinney wrote: > Since there hasn't been other movement on this, we need to disable > writing LZ4-compressed files until this can be investigated more > thoroughly. If someone w

Re: language independent representation of filter expressions

2020-07-10 Thread Patrick Pai
rs are not backed by > > format/Expression.fbs and instead use the types defined in cpp/arrow/type.h > > Do you mean Schema.fbs? > > Thanks, > Micah > > On Thu, Jul 9, 2020 at 1:56 PM Patrick Pai wrote: > > > I'm working with Steve on this issue. C

Re: language independent representation of filter expressions

2020-07-09 Thread Patrick Pai
I'm working with Steve on this issue. Can you please share what you have in mind for something more general than Gandiva's serialized expressions? I'm currently working through a design. I imagine we will have a FlatBuffer schema defining all expression types and have the different cpp expressio