Re: Extensions Type Interface Discussion

2023-03-07 Thread Yevgeny Pats
Hi Andrew, Thanks for the reply! I did exactly that and considered first to see if we can start by only handling it in the application level but that's a no go for us to migrate to arrow (from our own type system) as this basically removes a lot of the benefits such as the built-in csv writer, par

Re: Extensions Type Interface Discussion

2023-03-06 Thread Andrew Lamb
Hi Yevgeny, It is great you are thinking of using Arrow. > - The problems are around the abstraction for the extension types. While I understand that the underlying storage needs to be supported in the library we don't have a way for extensions to provide its own builder which means the user need

Extensions Type Interface Discussion

2023-03-03 Thread Yevgeny Pats
Hey folks, Hopefully this is the right place to ask. As some background I'm Yevgeny Pats , Founder @ CloudQuery . We are very interested in migrating our protocol and Go type system to Apache Arrow. Exte