yihua commented on PR #20029: URL: https://github.com/apache/hudi/pull/20029#issuecomment-5784467233
non-blocking: once nested filters reach the reader again, they also flow through `ParquetSchemaEvolutionUtils.rebuildFilterFromParquet` when `hoodie.schema.on.read.enable` is set. That path calls `InternalSchemaUtils.reBuildFilterName`, which throws `IllegalArgumentException` if `querySchema.findIdByName(name)` misses, and Spark hands nested columns over as the dotted multipart name (`item.name`, backtick-quoted only if a part is not a plain identifier). Avro naming rules should keep Hudi field names quote-free so I expect the dotted form to resolve, but it would be good to add a leg to the new test with schema-on-read enabled and a renamed nested column, to confirm the filter is rewritten to the file-side name rather than dropped to `AlwaysTrue` or thrown. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
