AjayBoddeda4 commented on issue #648:
URL: https://github.com/apache/wayang/issues/648#issuecomment-4074327261
Hi, I am Ajay Boddeda, a GSoC 2026 applicant working on the DataFrames API
proposal for Wayang.
I came across this issue while studying the codebase. This is directly
related to the select() operation I am planning to implement in the DataFrame
API — where users specify which columns they need and only those should be
queried.
My understanding is that the fields array in WayangTableScan stores the
projected column indices, but these are never passed down to the actual query
execution. This means even when a user does df.select('name', 'age'), all
columns are fetched which is inefficient.
I would love to investigate this further and potentially contribute a fix.
Could anyone guide me on where the fields array should be used in the execution
flow?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
