Guides, examples, etc beyond hello-samza

2016-02-12 Thread Avi Flax
Hi all, I’m trying to implement my first set of Samza jobs, and I’m a little frustrated in trying to find some guidance or examples on how to structure a project, how to approach unit testing, integration tests, etc. Hello-samza is useful for getting something up and running quickly and seeing wor

Alternatives to YARN for running Samza Jobs at Scale

2016-02-12 Thread Ramesh Bhojan
Hi All, For running Samza jobs on scale, are there other ways (if we are not using YARN yet), to configure a samza job/task to run on multiple containers to achieve parallelism? Regards, Ramesh

Re: Alternatives to YARN for running Samza Jobs at Scale

2016-02-12 Thread Jagadish Venkatraman
Hi Ramesh, Currently the only way to run in Distributed mode is to use Yarn. But, we're working on re-designing the JobCoordinator to be pluggable so that we can put in multiple implementations. After the re-design I expect users to be able to run Samza with Yarn, Mesos, ECS (containerized environ

Review Request 43550: SAMZA-836: fix unit test failure w/ FlushOptions() in rocksdbjni-3.13.1

2016-02-12 Thread Yi Pan (Data Infrastructure)
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/43550/ --- Review request for samza. Bugs: SAMZA-836 https://issues.apache.org/jira/br

Re: Review Request 43550: SAMZA-836: fix unit test failure w/ FlushOptions() in rocksdbjni-3.13.1

2016-02-12 Thread Tao Feng
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/43550/#review119113 --- Ship it! Ship It! - Tao Feng On Feb. 13, 2016, 12:13 a.m., Y

Re: Review Request 43550: SAMZA-836: fix unit test failure w/ FlushOptions() in rocksdbjni-3.13.1

2016-02-12 Thread Navina Ramesh
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/43550/#review119118 --- Ship it! Ship It! - Navina Ramesh On Feb. 13, 2016, 12:13 a.

Re: Review Request 43550: SAMZA-836: fix unit test failure w/ FlushOptions() in rocksdbjni-3.13.1

2016-02-12 Thread Jake Maes
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/43550/#review119120 --- Ship it! Ship It! - Jake Maes On Feb. 13, 2016, 12:13 a.m.,

Re: Alternatives to YARN for running Samza Jobs at Scale

2016-02-12 Thread Ramesh Bhojan
Thanks Jagadish. Regards, Ramesh On Fri, Feb 12, 2016 at 4:03 PM, Jagadish Venkatraman < jagadish1...@gmail.com> wrote: > Hi Ramesh, > > Currently the only way to run in Distributed mode is to use Yarn. But, > we're working on re-designing the JobCoordinator to be pluggable so that we > can put