Re: Proposal: Introduce deletion vector file to reduce write amplification

2023-10-08 Thread Renjie Liu
Hi, Ryan: Thanks for your reply. 1. What is the exact file format for these on disk that you're proposing? > Even if you're saying that it is what is produced by roaring bitmap, we > need more information. Is that a portable format? Do you wrap it at all in > the file to carry extra metadata? For

Re: Migration of PyIceberg to iceberg-python repository

2023-10-08 Thread Ryan Blue
+1 for removing it. Now that we're working in iceberg-python, it is just going to get stale and confusing. On Sun, Oct 8, 2023 at 12:07 PM Fokko Driesprong wrote: > Hey everyone, > > It has been a week since PyIceberg migrated to its own repository. Should > we move forward by removing the Pytho

Re: Migration of PyIceberg to iceberg-python repository

2023-10-08 Thread Fokko Driesprong
Hey everyone, It has been a week since PyIceberg migrated to its own repository. Should we move forward by removing the Python codebase from the main repository? Ajantha already raised a pull-request to do this (thank you for that 🙌). Kind regards, Fo

Re: Proposal: Introduce deletion vector file to reduce write amplification

2023-10-08 Thread Ryan Blue
Thanks, Renjie. I went through and made some comments about what is still not clear. Here's a summary: 1. What is the exact file format for these on disk that you're proposing? Even if you're saying that it is what is produced by roaring bitmap, we need more information. Is that a portable format?