RE: [DISCUSS] SAMZA-1141 - Apache Samza Development Process Improvements

2017-03-15 Thread Garry Turkington
Very much in favour of the proposed SEP process -- strong +1 from me. -Original Message- From: Navina Ramesh (Apache) [mailto:nav...@apache.org] Sent: Tuesday, March 14, 2017 10:16 PM To: dev@samza.apache.org Subject: [DISCUSS] SAMZA-1141 - Apache Samza Development Process Improvements H

RE: [DISCUSS] [VOTE] Apache Samza 0.10.1 RC0

2016-08-01 Thread Garry Turkington
@samza.apache.org Subject: Re: [DISCUSS] [VOTE] Apache Samza 0.10.1 RC0 @Garry: Yeah. I wasn't very clear about it either. @Yi: Do you know if it is a part of the release process to add my keys to the KEYS file in git repo? Navina On Mon, Aug 1, 2016 at 12:47 PM, Garry Turkington < g

RE: [DISCUSS] [VOTE] Apache Samza 0.10.1 RC0

2016-08-01 Thread Garry Turkington
+1 (binding) Built the source ran all tests and tried a sample test job. All looks good. One question - the key used to sign isn't in the KEYS file in the git repo -- is this a convenieence mechanism or does the release process mean it should be there? Garry -Original Message- From:

RE: One task sending payload to multiple output streams

2015-09-02 Thread Garry Turkington
Hi, How many input streams does this task consume and how are they partitioned? Garry -Original Message- From: Balusamy, Elangovan [mailto:elangovan.balus...@altisource.com] Sent: 02 September 2015 08:19 To: dev@samza.apache.org Cc: Chandra, Saurabh Subject: One task sending payload to

RE: Thoughts and obesrvations on Samza

2015-07-02 Thread Garry Turkington
Hi all, I think the question below re does Samza become a sub-project of Kafka highlights the broader point around migration. Chris mentions Samza's maturity is heading towards a v1 release but I'm not sure it feels right to launch a v1 then immediately plan to deprecate most of it. From a sel

RE: No tasks found. Likely due to no input partitions. Can't run a job with no tasks.

2015-06-04 Thread Garry Turkington
Hi Venkat, Could you share your job config file please? Garry From: Venkat Nannapaneni [mailto:vnannapan...@metistream.com] Sent: 04 June 2015 17:12 To: dev@samza.apache.org Subject: No tasks found. Likely due to no input partitions. Can't run a job with no tasks. Hi, I am trying to run a simp

RE: Yarn scheduling

2015-05-29 Thread Garry Turkington
Hi Roger, I've seen unbalanced container assignment across hosts but never one being maxed out before any others get any containers. So I'd look to the YARN config to start with. I believe though there will be a risk of this type of thing until YARN implements anti-affinity: https://issues.a

RE: Number of partitions

2015-05-21 Thread Garry Turkington
Hi, The other variable to think about here is the task to container mapping. Each job will indeed have 1 task per input partition in the underlying topic but you can then spread those 500 instances across multiple containers in your Yarn grid: http://samza.apache.org/learn/documentation/0.9/co

RE: Errors and hung job on broker shutdown

2015-05-04 Thread Garry Turkington
oker shutdown Garry, Just wondering, does this error not exist with Gzip compression? Or you could see it with any compression schemes? Guozhang On Sun, May 3, 2015 at 2:32 AM, Garry Turkington < g.turking...@improvedigital.com> wrote: > Hi, > > Just to add another data point

RE: Errors and hung job on broker shutdown

2015-05-03 Thread Garry Turkington
Hi, Just to add another data point, I've been occasionally seeing the first error with a non-Samza app using the new Kafka producer with Snappy compression. I was going to post to the Kafka list but I haven't really narrowed down the situations yet. It sort of looks like it most often happens t

RE: Execute a Task Periodically rather than through a stream of events

2015-03-27 Thread Garry Turkington
Hi Phill, So to understand you want the ability to have a task method executed based on a variable timer for each stored message? There isn't direct support for that type of processing. One way of getting close may be to have your task implement WindowableTask(1) and in the window() method lo

RE: Versioning beyond 0.9.0

2015-01-31 Thread Garry Turkington
+1 -Original Message- From: sriram [mailto:sriram@gmail.com] Sent: 30 January 2015 23:29 To: dev@samza.apache.org Subject: Re: Versioning beyond 0.9.0 +1 On Fri, Jan 30, 2015 at 10:40 AM, Yi Pan wrote: > +1. > > On Fri, Jan 30, 2015 at 9:22 AM, Chris Riccomini > > wrote: > > > H