Re: Production deployement

Thank you very much for taking time and answering all my questions! Alex On Wed, Jan 13, 2016 at 10:18 PM, Yi Pan wrote: > Hi, Alex, > > I apologize for the late reply. Let me try to give some feedbacks/comments > below: > > On Thu, Jan 7, 2016 at 3:59 PM, Alexander Filipchik > wrote: > > > >

Re: Docker-Image for 'hello-samza'

Hey Yi, as you can see within the github repo I explore software stacks by tackle them with docker. Quite fun, but challenging from times to times. Especially if it’s handled by layers of Java - not per se a problem, but my Java knowledge lacks experience. But to the topic… I checked the logs o

Re: Docker-Image for 'hello-samza'

The kafka error seems not to be the important piece… https://issues.apache.org/jira/browse/KAFKA-2251 I created an image that holds all services needed to rule out that somehow the job assumes ‘localhost’ connections somewhere: https://hub.docker.com/r/qnib/samza-mono/builds/

Samza Join example

If anyone interested, I did a quick PoC attempting to join two data sets using hello-samza as a starting point. Points to note, I did it in Scala. Our target was to keep at least 1 hour window of resent data at any given point in time, i.e ~200,000,000 records/h throughput for the first data set (

Same error when using an ubuntu (15.10) image

Hey guys, to rules out that my OS choice had a big effect I followed the steps on the tutorial and created an ubuntu version. The README provides my step in detail: https://github.com/qnib/u-samza I was not able to execute the gradlew command, maybe that’s my problem? Furthermore, when installe

Re: Samza Join example

Hi, Stanislov, That's awesome! It would be great to have this integrated w/ Samza tutorial. Would you mind to create a tutorial page for the join job implementation in Samza? Thanks a lot! -Yi On Thu, Jan 14, 2016 at 7:28 AM, Stanislav Los wrote: > If anyone interested, I did a quick PoC atte

Re: Same error when using an ubuntu (15.10) image

Hi, Christian, Which local directory are you running ./gradlew publishToMavenLocal from? The command needs to be executed from the directory under which the Samza project is checked out, *not* where the hello-samza project is checked out. -Yi On Thu, Jan 14, 2016 at 7:53 AM, Christian Kniep wro

Re: Same error when using an ubuntu (15.10) image

Here is the line from the tutorial: {noformat} NOTE: if you are building from the latest branch of hello-samza project, make sure that you run the following step from your local Samza project first: ./gradlew publishToMavenLocal Then, you can continue w/ the following command in hello-samza proj

Re: Question on zero downtime deployment of Samza jobs

Sorry for the long delay (I was trying to find the design doc we made). Please see attachment for the design doc. I'm also CC'ing Peter Huang (the intern) who worked on this. Disclaimer: Given this was an internship project, we've cut some corners. We plan to come up with an improved version in so

Re: Docker-Image for 'hello-samza'

Hi, Christian, >From the logs I can find on github, I only saw the job is submitted successfully, which means that the Kafka systems are working fine. I don't see the following information: a) How do you determine that the job failed? b) There should be an userlogs under ${HELLO-SAMZA}/deploy/yarn

Re: Question on zero downtime deployment of Samza jobs

Hi, Chinmay, Did you forget to attach? I did not see the attachment in your last email. Or is it due to the mail list restriction? On Thu, Jan 14, 2016 at 10:12 AM, Chinmay Soman wrote: > Sorry for the long delay (I was trying to find the design doc we made). > Please see attachment for the des

Re: Question on zero downtime deployment of Samza jobs

It shows as attached in my sent email. That's weird. On Thu, Jan 14, 2016 at 10:14 AM, Yi Pan wrote: > Hi, Chinmay, > > Did you forget to attach? I did not see the attachment in your last email. > Or is it due to the mail list restriction? > > On Thu, Jan 14, 2016 at 10:12 AM, Chinmay Soman > >

Re: Question on zero downtime deployment of Samza jobs

It might be the mail list restriction. Could you try to my personal email (i.e. nickpa...@gmail.com)? On Thu, Jan 14, 2016 at 10:15 AM, Chinmay Soman wrote: > It shows as attached in my sent email. That's weird. > > On Thu, Jan 14, 2016 at 10:14 AM, Yi Pan wrote: > > > Hi, Chinmay, > > > > Did

Re: Question on zero downtime deployment of Samza jobs

FYI: I've forwarded it to Yi's personal email. Yi: please feel free to email Peter (CC'ed) or me about any questions. FYI: the real solution would be to implement standby containers. This solution is an attempt to do the same. On Thu, Jan 14, 2016 at 10:17 AM, Yi Pan wrote: > It might be the mai

Re: Question on zero downtime deployment of Samza jobs

Hi Chinmay and Pan, Thanks Chinmay for initialize the conversation. Pan, please feel free to give comments on the design, specially suggestions about improving efficiency of fault handling. Best Regards Peter Huang On Thu, Jan 14, 2016 at 10:24 AM, Chinmay Soman wrote: > FYI: I've forwarded