Re: [D] [Format] Inline parent validity bitmap into child validity bitmap [arrow]

GitHub user takaaki7 added a comment to the discussion: [Format] Inline parent validity bitmap into child validity bitmap Accessing Arrow Struct children requires checking both parent and child validity (p[i] && c[i]), which can feel cumbersome. For example, Java's StructVector.getChild(), ne

Re: [D] [Format] Inline parent validity bitmap into child validity bitmap [arrow]

GitHub user takaaki7 edited a comment on the discussion: [Format] Inline parent validity bitmap into child validity bitmap Accessing Arrow Struct children requires checking both parent and child validity (p[i] && c[i]), which can feel cumbersome. For example, Java's StructVector.getChild(), n

Re: [D] [Format] Inline parent validity bitmap into child validity bitmap [arrow]

GitHub user felipecrv added a comment to the discussion: [Format] Inline parent validity bitmap into child validity bitmap > Currently, when struct itself is null, child field's validity is unknown. So > client must compute AND of those bitmaps to know child's validity. That is a feature, not

Arrow Flight Server Querying using SQL Commands

Hi all, Has anybody created an Arrow Flight Server capable of responding to arrow flight sql commands? Arrow flight sql is normally used with databases it seems like, but can you use it with an arrow flight server? For reference, we would like to use an arrow flight client to query specific colu

RE: Arrow Flight Server Querying using SQL Commands

I've ran some POCs for this use case.. For the flight ticket I just used a JSON string which included the SQL query. The flight server executes the SQL query and formats the results into an Arrow table. The flight client receives the arrow table. This was used to benchmark a client calling SQL

Re: Arrow Flight Server Querying using SQL Commands

Hi, To add to what Aldrin said, > query specific columns of batches/tables sitting on an arrow flight server Regardless of what transport you use (gRPC or Arrow Flight or FlightSQL), you need a way to execute a SQL query against the data on your Flight server. Unless you are planning on doing y

Re: [D] Flight RPC functionality in R package without python dependency [arrow]

GitHub user amoeba added a comment to the discussion: Flight RPC functionality in R package without python dependency Hi @vh-d, I don't think there's a technical reason and I think you're right that it was purely a way to provide the functionality to R without writing a first-class R implemen

Re: [D] [JS] Decoding `Dictionary` incorrectly. [arrow]

GitHub user metalmatze edited a discussion: [JS] Decoding `Dictionary` incorrectly. Hey everyone! :wave: We have a problem with decoding a `Dictionary` in arrow-js. We want this array: ```js [ "gke-europe-west3-0-preemptible-t2d-st-ec27d3db-pwwz" "gke-europe-west3-0-preempt

Re: [D] Flight RPC functionality in R package without python dependency [arrow]

GitHub user vh-d added a comment to the discussion: Flight RPC functionality in R package without python dependency Many thanks for the prompt reply. I will have a look and try to estimate what it takes to implement the R flight client and server in R. I would expect it is mostly wrapping the

Re: [D] [JS] Decoding `Dictionary` incorrectly. [arrow]

GitHub user metalmatze edited a discussion: [JS] Decoding `Dictionary` incorrectly. Hey everyone! :wave: We have a problem with decoding a `Dictionary` in arrow-js. We roughly this array: ```js [ "gke-europe-west3-0-preemptible-t2d-st-ec27d3db-pwwz" "gke-europe-west3-0-pree

Re: Arrow Flight Server Querying using SQL Commands

Hello! - Arrow flight sql is normally used with databases it seems like, but can you use it with an arrow flight server? Yes and no. Flight SQL is used to communicate with databases, but I don't think it bypasses a flight server, it's just that the target database is, or uses, a flight ser