tokoko commented on PR #3520: URL: https://github.com/apache/datafusion-comet/pull/3520#issuecomment-3938789730
This turned out to be a bit complicates. arrow classes in common module are shaded, while objects coming from spark aren't, so we can't just pass underlying ValueVectors through. PR uses c data interface split across common and spark modules. spark batches are exported to plain pointers on spark module side (which isn't shading arrow) and imported into CometVector batches in common. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
