Re: ThreadJobFactory in production

2016-03-05 Thread José Barrueta
Hi all, I just added the updated patch to SAMZA-41 . We have been testing all week in our SAMZA Jobs and is looking good. Hope is helpful and can be committed to t

Re: ThreadJobFactory in production

2016-03-03 Thread Yi Pan
Hi, Jose, Great! I am looking forward to the patch! Could you open an RB to the JIRA? Thanks a lot! -Yi On Wed, Mar 2, 2016 at 2:31 PM, José Barrueta wrote: > Hi guys, > > At Stormpath, we made a custom samza 10 version merging SAMZA-41 into it, > it's working well, so we are thinking to upda

Re: ThreadJobFactory in production

2016-03-02 Thread Robert Crim
Thanks for the clarification -- very helpful. I'll take a look at those tickets! On Wed, Mar 2, 2016 at 2:11 PM, Yi Pan wrote: > Hi, Robert, > > The main reason that ThreadJobFactory and ProcessJobFactory are not > considered "production-ready" is that there is only one container for the > job

Re: ThreadJobFactory in production

2016-03-02 Thread Roger Hoover
Jose, It would be great if you could share it. I'm interested in trying to use it as well. Thanks, Roger On Wed, Mar 2, 2016 at 2:31 PM, José Barrueta wrote: > Hi guys, > > At Stormpath, we made a custom samza 10 version merging SAMZA-41 into it, > it's working well, so we are thinking to up

Re: ThreadJobFactory in production

2016-03-02 Thread Jagadish Venkatraman
Hi Jose, Thanks for your inputs! It would be great if you could give your inputs on SAMZA-881. SAMZA-881 ensures that we make it easy to integrate with resource managers. If you could add a comment there on how you are currently using (a patched version) of Samza, we 'd love to align that with SA

Re: ThreadJobFactory in production

2016-03-02 Thread José Barrueta
Hi guys, At Stormpath, we made a custom samza 10 version merging SAMZA-41 into it, it's working well, so we are thinking to update that patch later this week so it can be added to the main project. HTH, Jose Luis Barrueta On Wed, Mar 2, 2016 at 2:11 PM, Yi Pan wrote: > Hi, Robert, > > The mai

Re: ThreadJobFactory in production

2016-03-02 Thread Yi Pan
Hi, Robert, The main reason that ThreadJobFactory and ProcessJobFactory are not considered "production-ready" is that there is only one container for the job and all tasks are assigned to the single container. Hence, it is not easy to scale out of a single host. As Rick mentioned, Netflix has put

Re: ThreadJobFactory in production

2016-03-02 Thread Rick Mangi
There was an interesting thread a while back from I believe the netflix guys about running ThreadJobFactory in production. > On Mar 2, 2016, at 4:20 PM, Robert Crim wrote: > > Hi, > > We're currently working on a solution that allows us to run Samza jobs on > Mesos. This seems to be going wel