milenkovicm commented on issue #1241: URL: https://github.com/apache/datafusion-ballista/issues/1241#issuecomment-2955076088
hey @liurenjie1024, I had a quick look at the delta integration. Looks like delta read mostly work (local and object store). Write/Update/Delete/Merge on the other hand does not. Looking at delta code, I believe there are at least two issues which need to be addressed: - The first one is use of query planner internally by delta, overriding ballista planner. - Second one is extracting metrics from physical plan. This will not work in case of ballista as plan will not have metrics nodes and alternative way of metrics extraction should be found. I guess to progress further with delta integration we would need to work with delta community. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
