RE: Re: Flight RPC: Add total_records and total_bytes to FlightEndpoint

2024-02-15 Thread Taeyun Kim
2024, at 18:58, 김태연 (Taeyun Kim) wrote: > Hi, > > Currently, FlightInfo has total_records and total_bytes fields, but > FlightEndpoint does not. > It would be great if FlightEndpoint also had these fields. > These fields can be used for: > - identifying the endpoint containi

Flight RPC: Add total_records and total_bytes to FlightEndpoint

2024-02-14 Thread Taeyun Kim
Hi, Currently, FlightInfo has total_records and total_bytes fields, but FlightEndpoint does not. It would be great if FlightEndpoint also had these fields. These fields can be used for: - identifying the endpoint containing a specific record by offset among multiple endpoints. - efficiently dist

RE: Re: Flight 'DoPartialGet' and arrow-rs flight implementation status

2024-02-06 Thread Taeyun Kim
this out, I've raised an issue on the repo for this: https://github.com/apache/arrow-rs/issues/5367 Will track progress there. Cheers, Jeffrey On Tue, 6 Feb 2024 at 13:15, 김태연 (Taeyun Kim) wrote: > Hi, > > I'm currently working on adding the 'DoPartialGet' functional

Flight 'DoPartialGet' and arrow-rs flight implementation status

2024-02-05 Thread Taeyun Kim
Hi, I'm currently working on adding the 'DoPartialGet' functionality in my flight client and server. The flight client is written in Rust, while the flight server is written in Rust and C++. The purpose of 'DoPartialGet' is to enable a client to request a specific part of a flight endpoint wit

RE: Probably an unnecessary copy when outputting join result?

2023-04-13 Thread Taeyun Kim
Oh sorry, I've misread the code. The variable is not returned as a value, instead it is used as an argument. Sorry again. -Original Message- From: Taeyun Kim Sent: Friday, April 14, 2023 8:10 AM To: dev@arrow.apache.org Subject: RE: Probably an unnecessary copy when outputting

RE: Probably an unnecessary copy when outputting join result?

2023-04-13 Thread Taeyun Kim
Hi, According to 'Effective Modern C++' book's item 25, you should not add std::move() to a local variable when returning it as a value. I think it would be better to check the book's content before applying std::move() to the code. Thank you. -Original Message- From: Sutou Kouhei

RE: Arrow Flight SQL JDBC Driver: About supporting endpoints with different location URIs than the initial connect

2023-03-12 Thread Taeyun Kim
this instead of requiring proxying. The contributor still seems to be active - maybe we could discuss reviving the PR, or possibly taking the PR and rebasing it? [1]: https://github.com/apache/arrow/pull/13900 -David On Fri, Mar 10, 2023, at 09:59, Taeyun Kim wrote: > Hi, > > I've

Arrow Flight SQL JDBC Driver: About supporting endpoints with different location URIs than the initial connect

2023-03-10 Thread Taeyun Kim
Hi, I've implemented a test Arrow Flight SQL server which returns different location URIs for the FlightInfo response for CommandPreparedStatementQuery. But the Arrow Flight SQL JDBC Driver seems to ignore the location field and sends DoGet requests to the server that responded for the CommandPrep

RE: [DISCUSS] Flight RPC/Flight SQL/ADBC enhancements

2023-02-14 Thread Taeyun Kim
Hi David, Thank you very much for your proposal. My comments about it are as follows: About PollFlightInfo: Many SQL queries (in fact, almost all OLAP queries?) cannot produce any output records until it completes - because of GROUP BY or ORDER BY clause. In that case, PollFlightInfo can degener