Re: Proposal for REST APIs for Iceberg table scans

2023-12-12 Thread Renjie Liu
Hi, Rahi and Jack: Thanks for raising this. My question is that the pagination and sharding will make the rest server stateful, e.g. a sequence of calls is required to go to the same server. In this case, how do we ensure the scalability of the rest server? On Wed, Dec 13, 2023 at 4:09 AM Fokko

Re: Proposal for REST APIs for Iceberg table scans

2023-12-12 Thread Fokko Driesprong
Hey Rahil and Jack, Thanks for bringing this up. Ryan and I also discussed this briefly in the early days of PyIceberg and it would have helped a lot in the speed of development. We went for the traditional approach because that would also support all the other catalogs, but now that the REST cata