Re: [PROPOSAL] Apache Iceberg 1.4.3 release

2023-12-02 Thread Jean-Baptiste Onofré
Hi Fokko, I know we have some fixes on the fly. So, let me do a new pass on issues and backports and I will send an update on the mailing list (early next week). Thanks ! Regards JB On Sun, Dec 3, 2023 at 1:40 AM Fokko Driesprong wrote: > > Hey JB, > > I think there is no harm in doing a patch

Re: Is there a way to distcp iceberg table from hadoop?

2023-12-02 Thread Wing Yew Poon
Aren't we forgetting about position delete files? If the table has position delete files, then those contain absolute file paths as well. We cannot add them to the table as-is. We need to rewrite them. This, I think, is the most painful part of replicating an Iceberg table. - Wing Yew On Sat, Dec

Re: Is there a way to distcp iceberg table from hadoop?

2023-12-02 Thread Fokko Driesprong
Hi Dongjun, Thanks for reaching out on the mailinglist. Another option might be to copy the data, and then use a Spark procedure, called add_files to add the files to the table. Let me know if this works for you. Kind regards, F

Re: [PROPOSAL] Apache Iceberg 1.4.3 release

2023-12-02 Thread Fokko Driesprong
Hey JB, I think there is no harm in doing a patch release. There was another request to backport an issue, I've created a PR: https://github.com/apache/iceberg/pull/8969#issuecomment-1837286383 Kind regards, Fokko Op wo 22 nov 2023 om 18:50 schreef Jean-Baptiste Onofré : > Hi guys > > Quick up