[GitHub] samza pull request #296: SAMZA-1416 : Better logging around the exception wh...

2017-09-15 Thread dnishimura
GitHub user dnishimura opened a pull request: https://github.com/apache/samza/pull/296 SAMZA-1416 : Better logging around the exception where class loading failed in initializing the SystemFactory for a input/output system Also added test coverage for the Util.getObj method. @ni

Re: [VOTE] SEP-8: Add in-memory system consumer & producer

2017-09-15 Thread Bharath Kumarasubramanian
Thanks for your feedback. Answers inline On 9/14/17, 1:23 AM, "Yi Pan" wrote: Hi, Bharath, Overall looks good! I have the following comments: i) Question on the Type of IME + data partition: How do we enforce that user adds IME w/ the expected partition id to the

Re: Deploying Samza Jobs Using S3 and YARN on AWS

2017-09-15 Thread Jagadish Venkatraman
Thank you Xiaochuan for your question! You should ensure that *every machine in your cluster* has the S3 jar file in its YARN class-path. From your error, it looks like the machine you are running on does not have the JAR file corresponding to *S3AFileSystem*. >> Whats the right way to set this u

Deploying Samza Jobs Using S3 and YARN on AWS

2017-09-15 Thread XiaoChuan Yu
Hi, I'm trying to deploy a Samza job using YARN and S3 where I upload the zip package to S3 and point yarn.package.path to it. Does anyone know what kind of set up steps is required for this? What I've tried so far is to get Hello Samza to be run this way in AWS. However I ran into the following