Re: Helping new contributors get started [was Re: Renaming master branch, removing blacklist/whitelist]

Just wanted to share an experience from another project. I am a big fan of dask developer log . It helped me understand what project is currently focusing on and some pointers on past decisions. I understand the current stage and workload may not go in

[jira] [Created] (ARROW-8845) Selective compression on the wire

Amol Umbarkar created ARROW-8845: Summary: Selective compression on the wire Key: ARROW-8845 URL: https://issues.apache.org/jira/browse/ARROW-8845 Project: Apache Arrow Issue Type

Re: IPC body buffer compression

it doesn't seem to be > helping. Feel free to open a JIRA issue about this > > - Wes > > On Sat, May 16, 2020 at 6:39 AM Amol Umbarkar > wrote: > > > > Hello All, > > I was going through dask developer log recently. Dask seems to be > > selectively

IPC body buffer compression

Hello All, I was going through dask developer log recently. Dask seems to be selectively do compression if it is found to be useful. They sort of pick 10kb of sample upfront to calculate compression and if the results are good then the whole batch is compressed. This seems to save de-compression ef

[jira] [Created] (ARROW-8563) Minor change to make newBuilder public

Amol Umbarkar created ARROW-8563: Summary: Minor change to make newBuilder public Key: ARROW-8563 URL: https://issues.apache.org/jira/browse/ARROW-8563 Project: Apache Arrow Issue Type