the-other-tim-brown commented on PR #10975: URL: https://github.com/apache/hudi/pull/10975#issuecomment-2042932190
> > > Can you explain why? > > > > > > Because it represents an "File", the partition notion kind of belongs to table, which is firstly introduced by Hive to resolve the scalability issues. > > Ok why does it contain commit and file group? The logic presented here does not seem to apply to the existing class. This class contains metadata relevant to grouping the files with other relevant files. > > If the issue this is too big a change to introduce, I can look for other options but I think there needs to be some consistency in what is added to these classes. @nsivabalan and @yihua let me know what you would prefer as well. I can also put up a draft where I limit the changes to the `AbstractTableFileSystemView` and some of the supporting utils which will decrease the size of the PR if we want to punt on this discussion -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
