[C++] Generating random Date64 & Timestamp arrays

Hi, I’d like to generate random Date64 & Timestamp arrays with artificial max and mins. RandomArrayGenerator::ArrayOf in arrow/testing/random.h does not help. Currently the approach I’d like to take is using RandomArrayGenerator::Int64 to generate a random int64 array and then convert it to a d

Re: [Flight Extension] Request for Comments

> if each payload has two batches with different purposes [...] The purposes of the payloads are slightly different, however they are intended to be applied atomically. If there are guarantees by the table operation generating the updates then those guarantees are only valid on each boundary of a

Re: [Flight Extension] Request for Comments

I'm not an Arrow contributor (perhaps one day!) but as a close follower and user of the project for the last six months (Arrow Flight specifically), I kind of jumped out of my chair when I saw this today. It's *exactly* what my team is looking for and something I have been close to building mysel

Re: [Flight Extension] Request for Comments

Ah okay, thank you for clarifying! In that case, if each payload has two batches with different purposes - might it make sense to just make that two different payloads, and set a flag/enum in the metadata to indicate how to interpret the batch? Then you'd be officially the same as Arrow Flight :

Re: [Flight Extension] Request for Comments

Thanks for the interest =). > However, if I understand right, you're sending data without a fixed schema [...] The dataset does have a known schema ahead of time, which is similar to Flight. However, as you point out, the subscription can change which columns it is interested in without re-acquir

Re: [Flight Extension] Request for Comments

Hey Nate, Thanks for sharing this & for the detailed docs and writeup. I think your use case is interesting, but I'd like to clarify a few things. I would say Arrow Flight doesn't try to impose a particular model, but I agree that Barrage does things that aren't easily doable with Flight. Fligh

[Flight Extension] Request for Comments

Hello, My colleagues at Deephaven Data Labs and I have been addressing problems at the intersection of data-driven applications, data science, and updating (/ticking) data for some years. Deephaven has a query engine that supports updating tabular data via a protocol that communicates precise cha

Re: [JS] Exploring usage of apache arrow at my company for complex table rendering

Hey Weston, Do you have any public code examples I could take a look at? This does sound very related to what I am doing. One particular question I have related to grouping is how you define row-grouping. Column grouping is fairly simple I think you can just define a Struct that tells you how

Re: [Rust] Contributing to Apache Arrow

I filed https://issues.apache.org/jira/browse/ARROW-11852 to add this information to the CONTRIBUTING guide. I plan on making this change myself sometime soon but if somebody else wants to do it (maybe a new contributor) then feel free. On Wed, Mar 3, 2021 at 6:25 AM Ivan Vankov wrote: > Thanks,

Re: [Rust] Contributing to Apache Arrow

Thanks, Antoine. ср, 3 мар. 2021 г. в 12:00, Adam Lippai : > Thank you Antoine > > Best regards, > Adam Lippai > > On Wed, Mar 3, 2021 at 12:28 PM Antoine Pitrou wrote: > > > > > I think one needs to have the "Contributor" role to be assigned issues. > > I've added to both of you (Ivan and Adam)

Re: [Rust] Contributing to Apache Arrow

Thank you Antoine Best regards, Adam Lippai On Wed, Mar 3, 2021 at 12:28 PM Antoine Pitrou wrote: > > I think one needs to have the "Contributor" role to be assigned issues. > I've added to both of you (Ivan and Adam), so you should be able to > auto-assign now. > > Regards > > Antoine. > > > O

Re: [Rust] Contributing to Apache Arrow

I think one needs to have the "Contributor" role to be assigned issues. I've added to both of you (Ivan and Adam), so you should be able to auto-assign now. Regards Antoine. On Wed, 3 Mar 2021 10:46:23 +0100 Adam Lippai wrote: > I can't do it either (when logged in), it's not allowed. > > B

[NIGHTLY] Arrow Build Report for Job nightly-2021-03-03-0

Arrow Build Report for Job nightly-2021-03-03-0 All tasks: https://github.com/ursacomputing/crossbow/branches/all?query=nightly-2021-03-03-0 Failed Tasks: - conda-linux-gcc-py38-aarch64: URL: https://github.com/ursacomputing/crossbow/branches/all?query=nightly-2021-03-03-0-drone-conda-linux

Re: [Rust] Contributing to Apache Arrow

I can't do it either (when logged in), it's not allowed. Best regards, Adam Lippai On Wed, Mar 3, 2021 at 9:53 AM Yibo Cai wrote: > Hi Ivan, > > I guess you didn't log in Jira? Otherwise you will see "Assign to me" link > at the right pane. > You can click "Log In" at the upper right corner, ma

RE: [Rust] Contributing to Apache Arrow

Hi Ivan, I guess you didn't log in Jira? Otherwise you will see "Assign to me" link at the right pane. You can click "Log In" at the upper right corner, maybe "Sign up" an account if you don’t have. Yibo -Original Message- From: Ivan Vankov Sent: Wednesday, March 3, 2021 16:41 To: de

[Rust] Contributing to Apache Arrow

Hello, I decided to try contributing to Apache arrow. Since I'm completely new to this project I've chosen a beginner friendly task ARROW-10903, but I cannot assign it to myself. So, could someone please help with that?