Support Parquet page skipping

Hi all, In the last sync meeting, we discussed several options to integrate the Parquet page skipping feature to Iceberg. I put them into a Google doc . Comments are welcome. -- Xinli Sha

Re: AvroIO Reflection Question

Hi John, The issue looks similar to https://github.com/apache/iceberg/issues/1654, a bug which we came across in avro when using s3a. The fix/workaround is mentioned in the link as well. Best, Mouli On Tue, Nov 17, 2020 at 4:24 AM John Clara wrote: > Hi, > > I was wondering if someone could gi

Re: [ANNOUNCE] Apache Iceberg release 0.10.0

Thanks to everyone that contributed! It is great to see so many useful changes going in. On Mon, Nov 16, 2020 at 9:24 PM Anton Okolnychyi wrote: > Here are the release notes: > http://iceberg.apache.org/releases/#0100-release-notes > > Here is the milestone: https://github.com/apache/iceberg/mil

Re: User defined properties

Invite Link to ASF Slack https://join.slack.com/t/the-asf/shared_invite/zt-ei391t4y-47FbOeNfu8SVA8BmSrtm8A I believe the warning there is just to know it may have collisions in the future or may be locked down, but I think it's pretty safe to actually add your own properties there imho On Mon, N

AvroIO Reflection Question

Hi, I was wondering if someone could give me some pointers on this line: https://github.com/apache/iceberg/blob/master/core/src/main/java/org/apache/iceberg/avro/AvroIO.java#L53 Some threads keep getting stuck trying to read the manifest list on commit. From debug logs, it looks like we're re