Re: Documentation of Breaking Changes

2023-11-21 Thread Chris Thomas
It's 9:10pm and I should probably check in with my dev team before tossing this off but I'm trying to give them the longest Thanksgiving break I can. I'm fairly sure it was this PR: https://github.com/apache/arrow/pull/35656 Long story short, we didn't know it at the time but we were depending on

Re: Documentation of Breaking Changes

2023-11-21 Thread Bryce Mecum
Hi Chris, this is very much the place to ask a question like this and thanks for doing so. Could we get a little more information on the specific change you were affected by just so we're all on the same page? Was this the bump from Parquet 2.4 to 2.6 [1] that happened in the PyArrow 13 release [2

Re: Documentation of Breaking Changes

2023-11-21 Thread Antoine Pitrou
Hello, Le 21/11/2023 à 22:59, Chris Thomas a écrit : I apologize if this is not the appropriate venue for this request; if that's the case, please let me know where I should be asking: Earlier this month Dependabot flagged a security vulnerability with PyArrow which prompted us to do an upgr

Pyarrow minimal build for lambda layers

2023-11-21 Thread Akshara Sadheesh
Hi, I have been trying to use the minimal_build for python with the provided examples Dockerfile.ubuntu for my lambda layers since it has a 250 MB limit. I am able to run the build and generate a pyarrow library. However, the library does not contain any shared .so files. When in use, it says: `"

Documentation of Breaking Changes

2023-11-21 Thread Chris Thomas
Evening folks, I apologize if this is not the appropriate venue for this request; if that's the case, please let me know where I should be asking: Earlier this month Dependabot flagged a security vulnerability with PyArrow which prompted us to do an upgrade from v10 to v14.1 of the software. Obvi

Re: [DISC][Java]: Migrate Arrow Java to JPMS Java Platform Module System

2023-11-21 Thread James Duong
I’m following up on this topic. David has a PR from last year that’s done much of the heavy lifting for refactoring the codebase to be package-friendly. https://github.com/apache/arrow/pull/13072 What’s changed since and what’s left: * New components have been added (Flight SQL for example)

Re: [DISCUSS] Protocol for exchanging Arrow data over REST APIs

2023-11-21 Thread Dewey Dunnington
I also think a set of best practices for Arrow over HTTP would be a valuable resource for the community...even if it never becomes a specification of its own, it will be beneficial for API developers and consumers of those APIs to have a place to look to understand how Arrow can help improve throug

Arrow community meeting November 22 at 17:00 UTC

2023-11-21 Thread Ian Cook
Our next biweekly Arrow community meeting is tomorrow at 17:00 UTC / 12:00 EDT. Zoom meeting URL: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Meeting ID: 876 4903 3008 Passcode: 958092 Meeting notes will be captured in this Google Doc: https://docs.google.com/document/d/1xr