Re: [ANNOUNCE] New Arrow committer: Jean-Baptiste Onofré

2025-03-10 Thread Laurent Goujon
Congratulations! On Mon, Mar 10, 2025 at 7:36 AM Jean-Baptiste Onofré wrote: > Thanks everyone for your warm welcome ! > > Regards > JB > > On Mon, Mar 10, 2025 at 7:03 AM Sutou Kouhei wrote: > > > > Hi, > > > > On behalf of the Arrow PMC, I'm happy to announce that > > Jean-Baptiste Onofré has

Re: [ANNOUNCE] New Arrow committer: Laurent Goujon

2024-11-25 Thread Laurent Goujon
at 8:12 AM Ian Cook wrote: > Congratulations Laurent! > > On Mon, Nov 25, 2024 at 11:02 AM Jean-Baptiste Onofré > wrote: > > > Congrats Laurent ! > > > > Regards > > JB > > > > On Mon, Nov 25, 2024 at 10:34 AM David Li wrote: > > > >

Re: Query on Memory Leaks with Arrow Flight client

2024-10-25 Thread Laurent Goujon
Yes, the first example was returning an iterator to the caller which would interact with the stream after the client is closed (lazy evaluation). The new code should work but may cause a leak if the iterator is not fully traversed. You may want to return a type which has both the Iterator and AutoC

Re: Query on Memory Leaks with Arrow Flight client

2024-10-25 Thread Laurent Goujon
Haven't tested the code but isn't `FlightStream` a closeable as well? On Fri, Oct 25, 2024 at 3:40 AM Susmit Sarkar wrote: > Hi Team, > > We are seeing the issue often with Memory Leak: > > *JDK 11* > > "org.apache.arrow" % "arrow-flight" % "17.0.0", > "org.apache.arrow" % "arrow-vector" % "17.0

Re: [VOTE] Release Apache Arrow 18.0.0 - RC0

2024-10-21 Thread Laurent Goujon
Hi, I do not see any artifact for the following link -> https://apache.jfrog.io/artifactory/arrow/java-rc/18.0.0-rc0 Cheers, Laurent On Fri, Oct 18, 2024 at 3:25 AM Raúl Cumplido wrote: > Hi, > > I would like to propose the following release candidate (RC0) of Apache > Arrow version 18.0.0. T

Re: [DISCUSS] Drop Java 11 support in Arrow

2024-08-26 Thread Laurent Goujon
lated Java projects (e.g. Spark, Iceberg, Avro) > that have discussed migrating directly from Java 8 to Java 17. Perhaps we > revisit this discussion in 3-6 months to see how the Java ecosystem has > taken to these changes? > > Thanks, > Dane > > On Wed, Aug 21, 2024 at 6:31 PM

Re: [DISCUSS] Drop Java 11 support in Arrow

2024-08-21 Thread Laurent Goujon
endencies are upgrading at a faster pace. For example, ORC v2.0 > > supports Java 17+. > > > > Thanks, > > Dane > > > > > > On Fri, Aug 16, 2024 at 11:51 AM Laurent Goujon > > > wrote: > > > >> I think like last time we should see wh

Re: [DISCUSS] Drop Java 11 support in Arrow

2024-08-16 Thread Laurent Goujon
I think like last time we should see where the community is as a whole on JDK version support? Just looking at Spark may not be enough to get a sense that it is okay to drop Java 11. Overall I think we should at least give 2 major versions before removing support. When I did the migration from Jav

Re: Upgrading Java version in build toolchain

2024-06-25 Thread Laurent Goujon
I'm still working on this and have created a WIP pull request to demonstrate the list of changes: https://github.com/apache/arrow/pull/43050 Laurent On Mon, May 6, 2024 at 9:40 AM Laurent Goujon wrote: > I wanted to share some status updates: I do have a list of changes to > build A

Re: [DISCUSS][Java] Automatic Modules with JPMS

2024-06-13 Thread Laurent Goujon
I don't even think there's even a wide view across the Java ecosystem regarding JPMS. So far all usages of Apache Arrow I've seen do not require JPMS, and amongst the sister projects I checked (Parquet, Iceberg), none of them have added support for JPMS. I don't know how many dependencies used by

Re: [DISCUSS] Drop Java 8 support

2024-05-24 Thread Laurent Goujon
ailing list. > > Do we think a vote is needed before officially moving forward with Java 8 > deprecation? > > On Mon, May 20, 2024 at 12:50 PM Laurent Goujon > > wrote: > > > I also mentioned Apache Parquet and haven't seen someone mentioned > if/when > > Apach

Re: [DISCUSS] Drop Java 8 support

2024-05-20 Thread Laurent Goujon
I also mentioned Apache Parquet and haven't seen someone mentioned if/when Apache Parquet would transition. On Fri, May 17, 2024 at 9:07 AM Dane Pitkin wrote: > Fokko, thank you for these datapoints! It's great to see how other low > level Java OSS projects are approaching this. > > JB, I beli

Re: Upgrading Java version in build toolchain

2024-05-06 Thread Laurent Goujon
would need to find a way to extend the image or create a new one. If people have other options in mind, I'm also all ear. Laurent On Wed, Apr 10, 2024 at 9:07 AM Laurent Goujon wrote: > I can give it a try for sure > > On Fri, Apr 5, 2024 at 10:26 AM Dane Pitkin > wrote: >

Re: [DISCUSS] Drop Java 8 support

2024-05-03 Thread Laurent Goujon
Arrow is used by a couple of projects like Apache Parquet and Apache Iceberg which are still compiled with Java 8. Not a fully OSS project, but Dremio is built with Java 11 and I don't see us migrating to Java 17 until next year. I'm still working on building Arrow with a more recent version of Ja

Re: Upgrading Java version in build toolchain

2024-04-10 Thread Laurent Goujon
; decide on a major Arrow version upgrading the target language version. > > That's what I meant by "consensus". > > > > Regards > > JB > > > > On Tue, Apr 2, 2024 at 5:55 PM Laurent Goujon > > wrote: > > > > > > At code lev

Re: Upgrading Java version in build toolchain

2024-04-02 Thread Laurent Goujon
some features > from Java 17+ (I'm thinking about record, memory API, etc). > I would be more than happy to help on this as soon as we have a consensus. > > Thanks, > Regards > JB > > On Mon, Apr 1, 2024 at 7:48 PM Laurent Goujon > wrote: > > > > Hello Arro

Upgrading Java version in build toolchain

2024-04-01 Thread Laurent Goujon
Hello Arrow Java developers, I would wonder if the community would be okay to change the minimum Java version used by the build toolchain to at least Java 17 or 21 (or even 22). This is different from changing the minimum Java version used at runtime which would still be 8 (following the vote from

Re: [Discussion][C++][FlightRPC] What stage to submit a PR for Flight SQL ODBC driver

2023-12-14 Thread Laurent Goujon
butor-agreements.html#clas > > On Wed, Dec 13, 2023, at 17:56, David Li wrote: > > Yes, I can handle this process on the PMC side. Thanks for the help. > > > > On Wed, Dec 13, 2023, at 16:55, Laurent Goujon wrote: > >> David, would you be the PMC contact for the flights

Re: [Discussion][C++][FlightRPC] What stage to submit a PR for Flight SQL ODBC driver

2023-12-13 Thread Laurent Goujon
g > your help. Please do let us know if there's anything we can do to help as > well. > > [1]: https://github.com/apache/ignite/tree/master/modules/platforms/cpp > > From: Laurent Goujon > Sent: Friday, December 8, 2023 11:01 AM > To: de

Re: [Discussion][C++][FlightRPC] What stage to submit a PR for Flight SQL ODBC driver

2023-12-08 Thread Laurent Goujon
Am I reading the ticket correctly that this is also about importing some of the Dremio code into Arrow project (namely https://github.com/dremio/flightsql-odbc/). If it is the case, let me check how my company can provide the documentation for the project? On Fri, Dec 8, 2023 at 8:41 AM David Li

Re: [DISCUSS] Flight SQL as experimental

2023-12-08 Thread Laurent Goujon
> On Thu, Dec 7, 2023, at 17:14, Joel Lubinitsky wrote: > > > The message types defined in FlightSql.proto are all marked > experimental > > as > > > well. Would this include changes to any of those? > > > > > > On Thu, Dec 7, 2023 at 16:43 Laurent Go

Re: [DISCUSS] Flight SQL as experimental

2023-12-07 Thread Laurent Goujon
we have been using it with Dremio for a while now, and we consider it stable +1 (not binding) Laurent On Wed, Dec 6, 2023 at 4:52 PM Matt Topol wrote: > +1, I agree with everyone else > > On Wed, Dec 6, 2023 at 7:49 PM James Duong > wrote: > > > +1 from me. It's used in a good number of datab

Java code review request

2022-01-06 Thread Laurent Goujon
Hi, I made a small change to the Java Arrow library to support newer versions of Jackson, as more projects use Jackson 2.12 or higher but Arrow still uses Jackson 2.11. Jira ticket link is https://issues.apache.org/jira/browse/ARROW-15192 Pull request link is https://github.com/apache/arrow/pull/

Re: Re: Re: [DISCUSS][Java] Adding GC-Based reference management strategy for buffers

2021-10-07 Thread Laurent Goujon
> > > > > > > > > BufferAllocator root = new RootAllocator( > > > > > > BaseAllocator.configBuilder() > > > > > > .maxAllocation(MAX_ALLOCATION) > > > > > > .memoryChunkManagerFactory(MemoryChunkC

Re: Re: [DISCUSS][Java] Adding GC-Based reference management strategy for buffers

2021-10-06 Thread Laurent Goujon
on it, or I can open a ticket asap? > > > > > Thanks, > > Hongze > > > > > At 2021-10-05 13:39:55, "Laurent Goujon" wrote: > >Hi, > > > >I gave a quick look at your patches but to be honest, it's not easy to > >figure out the

Re: [DISCUSS][Java] Adding GC-Based reference management strategy for buffers

2021-10-04 Thread Laurent Goujon
Hi, I gave a quick look at your patches but to be honest, it's not easy to figure out the problem you're trying to solve in the first place. Or is it simply to discard the use of ref counting to track buffer usages and relying on Java references to keep track of buffers at the expense of creating

[jira] [Created] (ARROW-9000) Java build crashes with JDK14

2020-06-01 Thread Laurent Goujon (Jira)
Laurent Goujon created ARROW-9000: - Summary: Java build crashes with JDK14 Key: ARROW-9000 URL: https://issues.apache.org/jira/browse/ARROW-9000 Project: Apache Arrow Issue Type: Bug

[jira] [Created] (ARROW-3061) headroom does not take into account reservation

2018-08-15 Thread Laurent Goujon (JIRA)
Laurent Goujon created ARROW-3061: - Summary: headroom does not take into account reservation Key: ARROW-3061 URL: https://issues.apache.org/jira/browse/ARROW-3061 Project: Apache Arrow Issue

Re: JDBC Adapter PR - 1759

2018-05-29 Thread Laurent Goujon
Same here. On Tue, May 29, 2018 at 9:59 AM, Siddharth Teotia wrote: > Hi Atul, > > I will take a look today. > > Thanks, > Sidd > > On Tue, May 29, 2018 at 2:45 AM, Atul Dambalkar < > atul.dambal...@xoriant.com> > wrote: > > > Hi Sid, Laurent, Uwe, > > > > Any idea when can someone take a look a

Re: JDBC Adapter for Apache-Arrow

2017-10-31 Thread Laurent Goujon
I really like Julian's idea of unwrapping Arrow objects out of the JDBC ResultSet, but I wonder if the unwrap class has to be specific to the driver and if an interface can be designed to be used by multiple drivers: for drivers based on Arrow, it means you could totally skip the serialization/dese

[jira] [Created] (ARROW-1527) Fix Travis JDK9 build

2017-09-11 Thread Laurent Goujon (JIRA)
Laurent Goujon created ARROW-1527: - Summary: Fix Travis JDK9 build Key: ARROW-1527 URL: https://issues.apache.org/jira/browse/ARROW-1527 Project: Apache Arrow Issue Type: Bug

[jira] [Created] (ARROW-1355) Make arrow buildable with java9

2017-08-15 Thread Laurent Goujon (JIRA)
Laurent Goujon created ARROW-1355: - Summary: Make arrow buildable with java9 Key: ARROW-1355 URL: https://issues.apache.org/jira/browse/ARROW-1355 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-527) clean drill-module.conf file

2017-02-04 Thread Laurent Goujon (JIRA)
Laurent Goujon created ARROW-527: Summary: clean drill-module.conf file Key: ARROW-527 URL: https://issues.apache.org/jira/browse/ARROW-527 Project: Apache Arrow Issue Type: Task

[jira] [Created] (ARROW-385) Refactor metrics system

2016-11-21 Thread Laurent Goujon (JIRA)
Laurent Goujon created ARROW-385: Summary: Refactor metrics system Key: ARROW-385 URL: https://issues.apache.org/jira/browse/ARROW-385 Project: Apache Arrow Issue Type: Improvement

[jira] [Updated] (ARROW-285) Allow for custom flatc compiler

2016-09-08 Thread Laurent Goujon (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Laurent Goujon updated ARROW-285: - Priority: Minor (was: Major) > Allow for custom flatc compi

[jira] [Created] (ARROW-285) Allow for custom flatc compiler

2016-09-08 Thread Laurent Goujon (JIRA)
Laurent Goujon created ARROW-285: Summary: Allow for custom flatc compiler Key: ARROW-285 URL: https://issues.apache.org/jira/browse/ARROW-285 Project: Apache Arrow Issue Type: Improvement

Re: Arrow Java Build Failiure

2016-09-01 Thread Laurent Goujon
I just opened a pull request to make flatc optional + allow for a user-provided flatc: https://github.com/apache/arrow/pull/129 On Thu, Sep 1, 2016 at 3:11 PM, Laurent Goujon wrote: > I should rephrase: there's no flatc binary artifact published on maven > central for windows

Re: Arrow Java Build Failiure

2016-09-01 Thread Laurent Goujon
4:20 PM, Jacques Nadeau wrote: > > I wonder if that means we should check in the generated code so people on > > those platforms can still build the java. > > > > On Thu, Sep 1, 2016 at 1:04 PM, Laurent Goujon > wrote: > > > >> I guess there's no flatc c

Re: Arrow Java Build Failiure

2016-09-01 Thread Laurent Goujon
I guess there's no flatc compiler for windows and solaris (as hinted by https://github.com/vy/flatc) On Thu, Sep 1, 2016 at 12:12 PM, Sanjay Rao wrote: > If I try the same on my Windows with NetBeans IDE I would see similar error > Failed to execute goal org.apache.maven.plugins: > maven-depende

[jira] [Created] (ARROW-208) Add checkstyle policy to java project

2016-05-25 Thread Laurent Goujon (JIRA)
Laurent Goujon created ARROW-208: Summary: Add checkstyle policy to java project Key: ARROW-208 URL: https://issues.apache.org/jira/browse/ARROW-208 Project: Apache Arrow Issue Type: Bug

[jira] [Closed] (ARROW-105) Unit tests fail if assertions are disabled

2016-05-19 Thread Laurent Goujon (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Laurent Goujon closed ARROW-105. Resolution: Fixed This was merged in e316b3f765167fa1f45197061624e73332b095f4 > Unit tests fail

[jira] [Closed] (ARROW-113) TestValueVector test fails if cannot allocate 2GB of memory

2016-05-19 Thread Laurent Goujon (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Laurent Goujon closed ARROW-113. Resolution: Fixed This was merged in c0985a47665f8ce8847a6a0215e6e3c0f1db28f4 > TestValueVec

[jira] [Commented] (ARROW-101) Fix java warnings emitted by java compiler

2016-05-14 Thread Laurent Goujon (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15283610#comment-15283610 ] Laurent Goujon commented on ARROW-101: -- pull request: https://github.com/apache/a

[jira] [Commented] (ARROW-102) travis-ci support for java project

2016-05-14 Thread Laurent Goujon (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15283609#comment-15283609 ] Laurent Goujon commented on ARROW-102: -- pull request: https://github.com/apache/a

[jira] [Commented] (ARROW-198) OutOfMemoryError for vector test case

2016-05-14 Thread Laurent Goujon (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15283603#comment-15283603 ] Laurent Goujon commented on ARROW-198: -- isn't it ARROW-113? > OutOfMem

[jira] [Commented] (ARROW-105) Unit tests fail if assertions are disabled

2016-05-14 Thread Laurent Goujon (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15283604#comment-15283604 ] Laurent Goujon commented on ARROW-105: -- pull request: https://github.com/apache/a

[jira] [Commented] (ARROW-113) TestValueVector test fails if cannot allocate 2GB of memory

2016-05-14 Thread Laurent Goujon (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15283602#comment-15283602 ] Laurent Goujon commented on ARROW-113: -- pull request: https://github.com/apache/a

[jira] [Commented] (ARROW-192) some classes cannot be resolved for vector component

2016-05-07 Thread Laurent Goujon (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15275428#comment-15275428 ] Laurent Goujon commented on ARROW-192: -- The templates are under vector/src/

[jira] [Commented] (ARROW-192) some classes cannot be resolved for vector component

2016-05-06 Thread Laurent Goujon (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15274425#comment-15274425 ] Laurent Goujon commented on ARROW-192: -- These classes are generated by the build

[jira] [Commented] (ARROW-192) some classes cannot be resolved for vector component

2016-05-05 Thread Laurent Goujon (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15272961#comment-15272961 ] Laurent Goujon commented on ARROW-192: -- The maven plugin which generates t

[jira] [Created] (ARROW-113) TestValueVector test fails if cannot allocate 2GB of memory

2016-04-18 Thread Laurent Goujon (JIRA)
Laurent Goujon created ARROW-113: Summary: TestValueVector test fails if cannot allocate 2GB of memory Key: ARROW-113 URL: https://issues.apache.org/jira/browse/ARROW-113 Project: Apache Arrow

[jira] [Commented] (ARROW-105) Unit tests fail if assertions are disabled

2016-04-15 Thread Laurent Goujon (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15243637#comment-15243637 ] Laurent Goujon commented on ARROW-105: -- {{BaseAllocator.java}} is acces

[jira] [Created] (ARROW-105) Unit tests fail if assertions are disabled

2016-04-15 Thread Laurent Goujon (JIRA)
Laurent Goujon created ARROW-105: Summary: Unit tests fail if assertions are disabled Key: ARROW-105 URL: https://issues.apache.org/jira/browse/ARROW-105 Project: Apache Arrow Issue Type

[jira] [Updated] (ARROW-102) travis-ci support for java project

2016-04-13 Thread Laurent Goujon (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Laurent Goujon updated ARROW-102: - Priority: Minor (was: Major) > travis-ci support for java proj

[jira] [Created] (ARROW-102) travis-ci support for java project

2016-04-13 Thread Laurent Goujon (JIRA)
Laurent Goujon created ARROW-102: Summary: travis-ci support for java project Key: ARROW-102 URL: https://issues.apache.org/jira/browse/ARROW-102 Project: Apache Arrow Issue Type: Task

[jira] [Updated] (ARROW-101) Fix java warnings emitted by java compiler

2016-04-13 Thread Laurent Goujon (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Laurent Goujon updated ARROW-101: - Priority: Trivial (was: Major) > Fix java warnings emitted by java compi

[jira] [Updated] (ARROW-101) Fix java warnings emitted by java compiler

2016-04-13 Thread Laurent Goujon (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Laurent Goujon updated ARROW-101: - Summary: Fix java warnings emitted by java compiler (was: Fix java rawtypes warnings emitted by

[jira] [Updated] (ARROW-101) Fix java warnings emitted by java compiler

2016-04-13 Thread Laurent Goujon (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Laurent Goujon updated ARROW-101: - Description: Java compiler emits several warnings regarding the use of rawtypes and unclosed

[jira] [Created] (ARROW-101) Fix java rawtypes warnings emitted by java compiler

2016-04-13 Thread Laurent Goujon (JIRA)
Laurent Goujon created ARROW-101: Summary: Fix java rawtypes warnings emitted by java compiler Key: ARROW-101 URL: https://issues.apache.org/jira/browse/ARROW-101 Project: Apache Arrow Issue