Re: Unsupported/Other Type

2024-05-24 Thread David Li
I've put up a draft PR here: https://github.com/apache/arrow/pull/41823 On Wed, Apr 17, 2024, at 23:34, David Li wrote: > Yes, this would be for an extension type. > > On Wed, Apr 17, 2024, at 23:25, Weston Pace wrote: >>> people generally find use in Arrow schemas independently of concrete data.

Policy on access to ursacomputing/crossbow?

2024-05-24 Thread Jonathan Keane
Over my time with the project I've had access to the github repository ursacomputing/crossbow to be able to manually trigger crossbow jobs. I find it incredibly helpful when working on the extended R CI to be able to iterate more quickly than waiting for the comment bot. But also over the time I'v

[Javascript] Issue regarding reading multiple record batches

2024-05-24 Thread Po-Wei Huang
Hello, Is there any one in community could help review the below issue? We found an issue that happens when reading multiple record batches from javascripts. When delta dictionary is disabled, the dictionary should be refetched. But it's not for second record batch. We probably could contribute b

Re: [DISCUSS] Apache Arrow LinkedIn page

2024-05-24 Thread Jacob Wujciak
Great idea, thanks Ian! On 2024/05/24 16:40:17 Ian Cook wrote: > > Is it somehow possible to be a "member" of this account to indicate that > > we have PMC status, or is that not possible within the LinkedIn > > membership/permissions model? > > Yes, Arrow Committers and PMC Members may wish to a

Re: [DISCUSS] Apache Arrow LinkedIn page

2024-05-24 Thread Ian Cook
> Is it somehow possible to be a "member" of this account to indicate that > we have PMC status, or is that not possible within the LinkedIn > membership/permissions model? Yes, Arrow Committers and PMC Members may wish to add Apache Arrow to the Experience section of their LinkedIn profiles. To

Re: [DISCUSS] Apache Arrow LinkedIn page

2024-05-24 Thread Antoine Pitrou
Is it somehow possible to be a "member" of this account to indicate that we have PMC status, or is that not possible within the LinkedIn membership/permissions model? Le 24/05/2024 à 18:04, Ian Cook a écrit : Following the discussion [1] earlier this year about the status of the Apache Ar

Re: [DISCUSS] Apache Arrow LinkedIn page

2024-05-24 Thread Andy Grove
Thanks, Ian. I think this is a great idea. On Fri, May 24, 2024 at 10:05 AM Ian Cook wrote: > Following the discussion [1] earlier this year about the status of the > Apache Arrow Twitter / X account [2], I have seen several news stories > citing declines in use of X and increases in use of Link

[DISCUSS] Apache Arrow LinkedIn page

2024-05-24 Thread Ian Cook
Following the discussion [1] earlier this year about the status of the Apache Arrow Twitter / X account [2], I have seen several news stories citing declines in use of X and increases in use of LinkedIn (for example [3]). Anecdotally I have seen that the types of conversations about open source dat

Re: [DISCUSS] Drop Java 8 support

2024-05-24 Thread Weston Pace
No vote is required from an ASF perspective (this is not a release) No vote is required from Arrow conventions (this is not a spec change and does not impact more than one implementation) I will send a message to the parquet ML to solicit feedback. On Fri, May 24, 2024 at 8:22 AM Laurent Goujon

Re: [DISCUSS] Drop Java 8 support

2024-05-24 Thread Laurent Goujon
I would say so because it is akin to removing a large feature but maybe some PMC can chime in? Laurent On Tue, May 21, 2024 at 12:16 PM Dane Pitkin wrote: > I haven't been active in Apache Parquet, but I did not see any prior > discussions on this topic in their Jira or dev mailing list. > > Do

Re: [DISCUSS] Statistics through the C data interface

2024-05-24 Thread Weston Pace
> I think what we are slowly converging on is the need for a spec to > describe the encoding of Arrow array statistics as Arrow arrays. This has been something that has always been desired for the Arrow IPC format too. My preference would be (apologies if this has been mentioned before): - Agree

Re: [DISCUSS] Statistics through the C data interface

2024-05-24 Thread Sutou Kouhei
Hi, Could you explain more about your idea? Does it propose that we add more callbacks to ArrowArrayStream such as ArrowArrayStream::get_statistics()? Or Does it propose that we define one more Arrow C XXX interface that wraps ArrowArrayStream like ArrowDeviceArray wraps ArrowArray? ArrowDeviceAr

Re: [DISCUSS] Statistics through the C data interface

2024-05-24 Thread Sutou Kouhei
Hi, >I am not sure that I follow why > we are constrained to the ArrowSchema to represent them. Ah, sorry. Using ArrowSchema isn't required. It's just one idea. We can choose another approach like we just define a schema for statistics ArrowArray as I propo