> On 5 Nov 2015, at 00:12, Lan Jiang <ljia...@gmail.com> wrote: > > I have used protobuf 3 successfully with Spark on CDH 5.4, even though Hadoop > itself comes with protobuf 2.5. I think the steps apply to HDP too. You need > to do the following
Protobuf.jar has been so brittle in the past that the entire hadoop stack has effectively frozen @ 2.5, at least until another mass-coordinated update across as many projects as possible. If you do update it locally, you are highly likely to find linkage problems. I would strongly advise staying with 2.5 unless there is some pressing need and you are happy to take on all the pain yourself --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
