Hi Jeremiah, We're in the process of upgrading Samza to use Kafka clients version 2.0, and YARN client version 2.9. This should be available in the next release (version 1.2). In the mean time, Kafka 0.11 and YARN 2.6 / 2.7 are the recommended versions.
Can you clarify what you mean about hard requirements for Zookeeper since checkpointing? Thanks, Prateek On Fri, Mar 8, 2019 at 11:27 AM Jeremiah Adams <jad...@helixeducation.com> wrote: > I am in the process of updating our stack. I’m not seeing documentation on > what versions of Kafka, Zookeeper and Yarn Samza 1.0.0 should be run on. > Best I can tell is a 2.6.1 dependency on Hadoop jars and 0.11.0.2 kafka > jars. If these jars are meant to match versions of the software, they are > dated. Hadoop is up to version 3.2.0 Kafka is up to version 2.1.1 > > Any advice concerning versions of the components? Also we are planning on > moving all Samza jobs to standalone and eliminating the Yarn dependencies. > I prefer taking iterative steps so want to get the updates done before > moving to containers. > > Also, does Samza have any hard requirements for Zookeeper since > checkpointing was implemented? > > > Jeremiah Adams > Software Engineer > www.helixeducation.com<http://www.helixeducation.com/> > Blog<http://www.helixeducation.com/blog/> | Twitter< > https://twitter.com/HelixEducation> | Facebook< > https://www.facebook.com/HelixEducation> | LinkedIn< > http://www.linkedin.com/company/3609946> > >
