Re: [DISCUSS] Proposal to add VariableShapeTensor Canonical Extension Type

2023-09-15 Thread Jeremy Leibs
On Fri, Sep 15, 2023 at 8:32 PM Rok Mihevc wrote: > > How about also changing shape and adding uniform_shape like so: > """ > **shape** is a ``FixedSizeList[ndim_ragged]`` of ragged shape > of each tensor contained in ``data`` where the size of the list > ``ndim_ragged`` is equal to the number of

Re: [DISCUSS] Proposal to add VariableShapeTensor Canonical Extension Type

2023-09-15 Thread Rok Mihevc
First, thanks for all the input! On Wed, Sep 13, 2023 at 6:27 AM Alenka Frim wrote: > In the PR you mention that "this [ragged dimensions] would be purely > metadata that would help converting arrow <-> jagged/ragged". Are there any > examples available to better understand this metadata and how

Re: [Java][Discuss]: consensus for JDK 8 deprecation

2023-09-15 Thread Dane Pitkin
> > - As a low level library, users have to add specific flags to use > Java 9 and up with Arrow to resolve issues with java.nio. This has > been annoying for our customers constantly. If this is not resolved, > I would say we may see a lot of complaints in the future. > I filed issue 37739[1] t