On Thu, Oct 10, 2024 at 4:18 PM Felipe Oliveira Carvalho <felipe...@gmail.com> wrote: > > Hi, > > Yi Cao's request comes from a misunderstanding of where the performance of > Arrow comes from. > > Arrow arrays follow the SoA paradigm [1]. The moment you start thinking about > individual objects with an associated ref-count (std::shared_ptr<T>) is the > moment you've given up the SoA approach and you are in the AoS approach to > in-memory data. AoS is the most common approach and most well understood. > Arrow is not that. Arrow is "weird". Arrow is SoA.
This is making assumptions. I don't think the OP's request was specific enough to draw any conclusions about their system needs or design. -- Andrew Bell andrew.bell...@gmail.com