hi Kou -- since we have metadata for tensors/ndarrays and support in C++, having analogous metadata for sparse matrices seems reasonable. Someone else asked me about this in person recently (related to machine learning applications).
While many Arrow implementations will be focused on the in-memory columnar / record batch data model, having these traditional scientific computing memory layouts available for shared memory IPC will open up the Arrow C/C++ libraries to more use cases. We wouldn't necessarily expect other Arrow implementations (like Java) to implement these, though, unless they needed them. Did you want to propose metadata and a memory layout / data structure for these, and we can discuss there? Thanks! Wes On Tue, Apr 18, 2017 at 1:14 AM, Kouhei Sutou <k...@clear-code.com> wrote: > Hi, > > I have a question. > Is there any plan to support sparse matrix in Apache Arrow? > I just want to know whether sparse matrix is out of scope or > not. > > > Thanks, > -- > kou >
