Re: [Discussion] Maintain vendor neutrality on the quickstart page

2025-01-02 Thread Yong Zheng
I also think that is a good idea and interested to take this up. But before I do so, here are couple clarifications i would like. Based on what I recalled from tabulario/spark-iceberg, it has couple additional things are not there compared to official spark image: 1. couple additional python lib

Re: [Discussion] Maintain vendor neutrality on the quickstart page

2024-12-10 Thread Fokko Driesprong
Yes, that's exactly my motivation (sorry for not stating this explicitly earlier). Looking at the fact that the quickstart is currently outdated, I would be reluctant to introduce additional Docker images and/or repositories, since we need to update those as well. Kind regards, Fokko Op di 10 dec

Re: [Discussion] Maintain vendor neutrality on the quickstart page

2024-12-10 Thread Ajantha Bhat
That's a good suggestion Fokko. It would avoid maintaining one more docker image. We can update the quickstart to use the docker image provided by Spark. - Ajantha On Tue, Dec 10, 2024 at 4:08 PM Fokko Driesprong wrote: > Hey Ajantha, > > Thanks for bringing this up, we should both remove the v

Re: [Discussion] Maintain vendor neutrality on the quickstart page

2024-12-10 Thread Fokko Driesprong
Hey Ajantha, Thanks for bringing this up, we should both remove the vendor reference and bring this back up to date. My preference would be to rely on the Spark image provided by the Apache Spark project, similar to what we do for the Hive