Hello, I wanted to circle back to this topic and make sure there's a decision by the community. Although there was sporadic discussion over jira[1], the PR[2], and this list[3] in the past, the messaging across these channels changed over time. E.g. while the PR comment is negative, the much more recent Jira comment suggests a way forward - is this feature likely to gain consensus if following those comments? I'd like to avoid wasted effort.
An upside not explicitly mentioned before is that while appending to a multi-file Parquet dataset is already possible, as Weston mentioned, being able to append row groups and rewrite the footer would enable the file's (dataset's) overall metadata to be maintained as new data is added. Thanks, Balazs --- [1] https://issues.apache.org/jira/browse/ARROW-11465 [2] https://github.com/apache/arrow/pull/8130 [3] https://lists.apache.org/thread/k5nv310yp315fttcz213l8o0vmnd7vyw
