Re: Additional indexes for data files

2023-06-07 Thread Micah Kornfield
able (only encoded size). [1] is aimed at addressing this. Thanks, Micah [1] https://github.com/apache/parquet-format/pull/197 On Tue, Jun 6, 2023 at 11:18 AM Jack Ye wrote: > Hi everyone, > > I would like to know what people think about adding additional indexes for > data files in ma

Additional indexes for data files

2023-06-06 Thread Jack Ye
Hi everyone, I would like to know what people think about adding additional indexes for data files in manifests. I remember we talked about this topic multiple times in the past but never got to any conclusion. There are 2 use cases we are thinking about at this moment: 1. *NDV sketch*: we have