parthchandra commented on PR #1724: URL: https://github.com/apache/datafusion-comet/pull/1724#issuecomment-2869176308
> > I thought the plan was to fix this by falling back to Spark? We can check if the schema has a field name matching `FileFormat.ROW_INDEX_TEMPORARY_COLUMN_NAME` and fall back to Spark > > My understanding is that the column name for row index can be arbitrary in Parquet (defined in the metadata). At least that’s what the tests implied to me. I believe the schema we get at planning time will have the temporary name to indicate that this is the column where the row index should be populated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
