Re: Pagination for List APIs in the REST spec

2023-12-17 Thread Renjie Liu
+1 for this approach. I agree that the streaming approach requires that http client and servers have http 2 streaming support, which is not compatible with old clients. I share the same concern with Micah that only start/limit may not be enough in a distributed environment where modification happe

Proposed new StreamingUpdate API

2023-12-17 Thread Jason Fine
Hi all, I would like to propose the following PR to be potentially included in an upcoming version of Iceberg. https://github.com/apache/iceberg/pull/9323 Essentially it's a new API that offers improved performance for committing sequential batches of upserts. I have written a detailed explanati