Re: [Discuss] Iceberg community maintaining the docker images

2024-10-10 Thread Ajantha Bhat
Thanks for the discussions. I will just focus on Docker image of the REST catalog TCK first. These are related PRs for the same. https://github.com/apache/iceberg/pull/11279 https://github.com/apache/iceberg/pull/11283 We still need Apache infra help for publishing the image in the Apache docker

Re: [Discuss] Iceberg community maintaining the docker images

2024-10-10 Thread rdb...@gmail.com
I was specifically replying to this suggestion to add docker images for Trino and Spark: > I also envision the Iceberg community maintaining some quick-start Docker images, such as spark-iceberg-rest, Trino-iceberg-rest, among others. It sounds like we're mostly agreed that the Iceberg project it

Re: [Discuss] Iceberg community maintaining the docker images

2024-10-10 Thread Jean-Baptiste Onofré
It's actually what I meant by REST Catalog docker image for test. Personally, I would not include any docker images in the Iceberg project (but more in the "iceberg" ecosystem, which is different from the project :)). However, if the community has a different view on that, no problem. Regards JB

Re: [Discuss] Iceberg community maintaining the docker images

2024-10-10 Thread Daniel Weeks
I think we should focus on the docker image for the test REST Catalog implementation. This is somewhat different from the TCK since it's used by the python/rust/go projects for testing the client side of the REST specification. As for the quickstart/example type images, I'm open to discussing wha

Re: [Discuss] Iceberg community maintaining the docker images

2024-10-10 Thread Ajantha Bhat
Yes, the PRs I mentioned are about running TCK as a docker container and keeping/maintaining that docker file in the Iceberg repo. I envisioned maintaining other docker images also because I am not sure about the roadmap of the ones in our quickstart

Re: [Discuss] Iceberg community maintaining the docker images

2024-10-10 Thread Jean-Baptiste Onofré
Hi I think there's context missing here. I agree with Ryan that Iceberg should not provide any docker image or runtime things (we had the same discussion about REST server). However, my understanding is that this discussion is also related to the REST TCK. The TCK validation run needs a runtime,

Re: [Discuss] Iceberg community maintaining the docker images

2024-10-09 Thread rdb...@gmail.com
I think it's important for a project to remain focused on its core purpose, and I've always advocated for Iceberg to remain a library that is easy to plug into other projects. I think that should be the guide here as well. Aren't projects like Spark and Trino responsible for producing easy to use D

[Discuss] Iceberg community maintaining the docker images

2024-10-08 Thread Ajantha Bhat
Hello everyone, Now that the test fixtures are in [1],we can create a runtime JAR for the REST catalog adapter [2] from the TCK. Following that, we can build and maintain the Docker image based on it [3]. I also envision the Iceberg community maintaining some quick-start Docker images, such as sp