alamb commented on issue #12644:
URL: https://github.com/apache/datafusion/issues/12644#issuecomment-2629370589
Coming soon (arrow 54.2 in a month), support for Extension Types:
- https://github.com/apache/arrow-rs/issues/4472
- https://github.com/apache/arrow-rs/pull/5822
Courtesy o
alamb commented on issue #12644:
URL: https://github.com/apache/datafusion/issues/12644#issuecomment-2609539786
I started thinking about how the ExtensionType trait would be used in
DataFusion. I think we would need to improve the APIs a bit to be in terms of
`Field` rather than `DataType`.
alamb commented on issue #12644:
URL: https://github.com/apache/datafusion/issues/12644#issuecomment-2607116405
@mbrobbel has a nice proposal to add extension types in arrow-rs (which
would potentially help ExtensionTypes in DataFusion). Would apprecaite any
feedback:
- https://github.
jayzhan211 commented on issue #12644:
URL: https://github.com/apache/datafusion/issues/12644#issuecomment-2594225106
The current status is that we have several changes in branch `logical-types`
for #12622. Where the `Scalar` is introduced and the next step is to complete
the tasks left in #
jayzhan-synnada commented on issue #12644:
URL: https://github.com/apache/datafusion/issues/12644#issuecomment-2594223771
The current status is that we have several changes in branch `logical-types`
for #12622. Where the `Scalar` is introduced and the next step is to complete
the tasks left
tobixdev commented on issue #12644:
URL: https://github.com/apache/datafusion/issues/12644#issuecomment-2592666978
I second @paleolimbot here, as I am also interested in this topic.
First of all, thank you for all your efforts in this area!
To provide some context, we are currently
kylebarron commented on issue #12644:
URL: https://github.com/apache/datafusion/issues/12644#issuecomment-2588301284
> Is support for this blocked by lack of support in arrow-rs?
arrow-rs intentionally doesn't "directly support" extension types through
`DataType`. The alternative (no
paleolimbot commented on issue #12644:
URL: https://github.com/apache/datafusion/issues/12644#issuecomment-2583556751
I'm interested in this as well; however, I'm new to DataFusion development
and I am not sure I have a handle on what the barriers are here (e.g., Is
support for this blocked
findepi commented on issue #12644:
URL: https://github.com/apache/datafusion/issues/12644#issuecomment-2380660813
FYI i touched upon the topic of types on DataFusion meetup in Belgrade
yesterday.
The slides are here if anyone is interested:
https://docs.google.com/presentation/d/1VW_JCGb
kylebarron commented on issue #12644:
URL: https://github.com/apache/datafusion/issues/12644#issuecomment-2379306495
I'm not very knowledgeable about DataFusion internals or database theory, so
it's hard for me to provide feedback on the proposal, but I'm very excited
about the prospect of
findepi opened a new issue, #12644:
URL: https://github.com/apache/datafusion/issues/12644
### Is your feature request related to a problem or challenge?
Currently DataFusion provides a lot of built-in types which are useful when
building applications / query engines on top of DataFus
findepi commented on issue #12644:
URL: https://github.com/apache/datafusion/issues/12644#issuecomment-2378520646
cc @alamb, @andygrove, @jayzhan211, @ozankabak, @notfilippo, @comphead,
@kylebarron, @yukkit, @sunchao, @Folyd, @wjones127, @Xuanwo, @sadboy, @milevin
--
This is an automated
12 matches
Mail list logo
