kosiew commented on issue #14757:
URL: https://github.com/apache/datafusion/issues/14757#issuecomment-3044059050
You're welcome.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comme
alamb commented on issue #14757:
URL: https://github.com/apache/datafusion/issues/14757#issuecomment-3039034005
🚀 -- thank you for your attention to this @kosiew
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
UR
kosiew closed issue #14757: Datafusion can't seem to cast evolving structs
URL: https://github.com/apache/datafusion/issues/14757
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
TheBuilderJR opened a new issue, #14757:
URL: https://github.com/apache/datafusion/issues/14757
### Describe the bug
I'd expect as I add fields to structs, I should be able to cast one into
another. You can see in the repro below this doesn't seem to be allowed:
### To Reproduc
kosiew commented on issue #14757:
URL: https://github.com/apache/datafusion/issues/14757#issuecomment-3026987255
@TheBuilderJR
Sorry, I closed this issue accidentally in #16371
#16583 is the final PR in the series that should close this issue.
--
This is an automated message f
alamb commented on issue #14757:
URL: https://github.com/apache/datafusion/issues/14757#issuecomment-2734594945
Looks like @kosiew took a shot in
- https://github.com/apache/datafusion/pull/15295
--
This is an automated message from the Apache Git Service.
To respond to the message, p
TheBuilderJR commented on issue #14757:
URL: https://github.com/apache/datafusion/issues/14757#issuecomment-2727517528
This PR fixes it but I'm not sure it's the "right way" to do it
https://github.com/apache/datafusion/pull/15259
If anyone wants to take this to the finish line, pleas
alamb commented on issue #14757:
URL: https://github.com/apache/datafusion/issues/14757#issuecomment-2702226794
I think if you look at the code in these two PRs you'll find the relevant
casting:
- https://github.com/apache/datafusion/pull/14384/files#r1937492704
- https://github.com/ap
TheBuilderJR commented on issue #14757:
URL: https://github.com/apache/datafusion/issues/14757#issuecomment-2692420607
@alamb I should have some free cycles soon to do this. Any chance you can
give me some code points or reference PRs that would help with implementation?
Thanks in advance!
TheBuilderJR commented on issue #14757:
URL: https://github.com/apache/datafusion/issues/14757#issuecomment-2685460077
@Lordworms can you share your branch? I'm happy to take a look as well if
you don't have the bandwidth.
--
This is an automated message from the Apache Git Service.
To re
Lordworms commented on issue #14757:
URL: https://github.com/apache/datafusion/issues/14757#issuecomment-2679101365
I forgot to rebase the main branch, but I can refactor it to use arrow-cast
+ specialized case
--
This is an automated message from the Apache Git Service.
To respond to the
alamb commented on issue #14757:
URL: https://github.com/apache/datafusion/issues/14757#issuecomment-2678804904
> [@alamb](https://github.com/alamb) given that the arrow folks don't seem
super motivated to fix this in a timely manner, can we do a fix on the
datafusion side?
Yes, of
TheBuilderJR commented on issue #14757:
URL: https://github.com/apache/datafusion/issues/14757#issuecomment-2677466140
@alamb given that the arrow folks don't seem super motivated to fix this in
a timely manner, can we do a fix on the datafusion side? Maybe the fix is we
can try to do an ar
alamb commented on issue #14757:
URL: https://github.com/apache/datafusion/issues/14757#issuecomment-2676189897
> [@alamb](https://github.com/alamb) how do y'all handle this at influx?
This one comes as quite a shocker to me. Does no one else using datafusion
support struct evolution?
TheBuilderJR commented on issue #14757:
URL: https://github.com/apache/datafusion/issues/14757#issuecomment-2675883560
@alamb how do y'all handle this at influx? This one comes as quite a shocker
to me. Does no one else using datafusion support struct evolution?
--
This is an automated m
zhuqi-lucas commented on issue #14757:
URL: https://github.com/apache/datafusion/issues/14757#issuecomment-2673384556
Can't find a workaround for this, and i think the Schema::try_merge passed
before this error.
So when we map_schema at the end, we should still check the cast error w
TheBuilderJR commented on issue #14757:
URL: https://github.com/apache/datafusion/issues/14757#issuecomment-2669129371
@alamb perhaps a subtask is making Schema::try_merge consistent with
datafusion's ability to query these merged schemas. `Schema::try_merge`
currently happily merges these
alamb commented on issue #14757:
URL: https://github.com/apache/datafusion/issues/14757#issuecomment-2668299534
> cc [@alamb](https://github.com/alamb)
[@zhuqi-lucas](https://github.com/zhuqi-lucas) many of my users can't query
their data because of this evolution. any chance you can take a
TheBuilderJR commented on issue #14757:
URL: https://github.com/apache/datafusion/issues/14757#issuecomment-2667240380
cc @alamb many of my users can't query their data because of this evolution.
any chance you can take a look to see if there's any workaround I can do for
now?
--
This is
TheBuilderJR opened a new issue, #14757:
URL: https://github.com/apache/datafusion/issues/14757
### Describe the bug
I'd expect as I add fields to structs, I should be able to cast one into
another. You can see in the repro below this doesn't seem to be allowed:
### To Reproduc
20 matches
Mail list logo
