Re: [C++] RandomArrayGenerator::List bugs

A Jira ticket on this bug has been filed: https://issues.apache.org/jira/browse/ARROW-11548 > On Feb 7, 2021, at 3:29 PM, Ying Zhou wrote: > > Hi, > > Recently I found a weird bug in RandomArrayGenerator. > > RandomArrayGenerator::List con

[C++] RandomArrayGenerator::List bugs

Hi, Recently I found a weird bug in RandomArrayGenerator. RandomArrayGenerator::List consistently produces ListArrays with their length 1 below what they should be according to their documentation. Moreover the bitmaps we have are weird. Here is some simple test: TEST(TestAdapterWriteNested,

Re: Bintray sunsetting

FYI: We have a JIRA issue for it: https://issues.apache.org/jira/browse/ARROW-11499 In "Bintray sunsetting" on Sat, 6 Feb 2021 17:15:35 -0600, Wes McKinney wrote: > Appears that JFrog is sunsetting Bintray, so we will need to sort out > alternative hosting for Linux packages for the 4.0.0

Re: Arrow papers

Thanks for sharing these. I was aware of the Microsoft Magpie paper but not the TU Dresden paper. It would be great to see some academic groups engage in adding in-memory compression / encodings to the Arrow format properly in collaboration with the Apache community. On Sun, Feb 7, 2021 at 12:14 P

Arrow papers

A couple of interesting Arrow-related papers have appeared at conferences recently: Integrating Lightweight Compression Capabilities into Apache Arrow [1] Magpie: Python at Speed and Scale using Cloud Backends [2] I’m sharing them so that people are aware of the evolving state-of-the-art. Julian

Re: [Rust] [Discuss] proposal to redesign Arrow crate to resolve safety violations

Hi Jorge, I tried running the code you pasted but it didnt compile. I get the next error: the trait `AsRef<[u8]>` is not implemented for `[i32; 2i32]` I had to change it to this to compile: let buffer = Buffer::from(&[0u8, 2]); > let data = ArrayData::new(DataType::Int64, 10, None, None, 0, >

[Rust] [Discuss] proposal to redesign Arrow crate to resolve safety violations

Hi, Over the past 4 months, I have been growing more and more frustrated by the amount of undefined behaviour that I am finding and fixing on the Rust implementation. I would like to open the discussion of a broader overview about the problem in light of our current knowledge and what Rust enables

[NIGHTLY] Arrow Build Report for Job nightly-2021-02-07-0

Arrow Build Report for Job nightly-2021-02-07-0 All tasks: https://github.com/ursacomputing/crossbow/branches/all?query=nightly-2021-02-07-0 Failed Tasks: - conda-linux-gcc-py36-aarch64: URL: https://github.com/ursacomputing/crossbow/branches/all?query=nightly-2021-02-07-0-drone-conda-linux