Discussion/Improvements of ConfigMap creations for Spark on K8s

2023-05-18 Thread xianjin
Hi dev, I'd like to start a discussion of ConfigMap creations for Spark on K8S and get more people involved, it's originally discussed on Github https://github.com/apache/spark/pull/31428#issuecomment-1552531182 .Any comments/suggestions are welcome. To summarize, ConfigMap is an object on K8S, i

Re: Remove protobuf 2.5.0 from Spark dependencies

2023-05-18 Thread Steve Loughran
On Thu, 18 May 2023 at 03:45, Cheng Pan wrote: > Steve, thanks for the information, I think HADOOP-17046 should be fine for > the Spark case. > > Hadoop put the protobuf 3 into the pre-shaded hadoop-thirdparty, and the > hadoop-client-runtime shades protobuf 2 during the package, which results >