parthchandra opened a new pull request, #2346: URL: https://github.com/apache/datafusion-comet/pull/2346
## Which issue does this PR close? Part of https://github.com/apache/datafusion-comet/issues/2060 ## Rationale for this change Current Iceberg integration does not support deleted rows ## What changes are included in this PR? This PR introduces a Comet selection vector that provides a logical mapping to the physical arrow vector. A selection indices array describes the rows in the physical vector that are valid. This representation allows us to map Icebergs deleted rows implementation to Comet. The PR also adds some JNI interfaces to export the logical mapping (selection indices) to the native side. The native scan operator has also been updated to filter out rows that are not selected (i.e. deleted) ## How are these changes tested? Enabled deleted rows support in the iceberg diff and that enabled all iceberg tests in ci -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
