Re: Tracing the Samza+YARN startup process

2019-05-22 Thread Malcolm McFarland
Hey rayman, What it looks like is that the AM has started, the container has started, but, ie, here will be the last messages I see in the Samza logs: 2019-05-23T05:10:45.048ZINFOMaking a request for ANY_HOST 2019-05-23T05:10:45.057ZINFOStarting the container allocator thr

Re: Tracing the Samza+YARN startup process

2019-05-22 Thread rayman preet
Hi Malcolm, This figure (attached) gives an overview of the flow. Is this something you were looking for? Also, by "don't fully start up" do you mean that applications are missing some containers (but the ApplicationMaster is running)? Or the application is missing entirely. -- thanks rayman [im

[GitHub] [samza-hello-samza] weisong44 merged pull request #63: Fixed build failure due to changes in Samza project

2019-05-22 Thread GitBox
weisong44 merged pull request #63: Fixed build failure due to changes in Samza project URL: https://github.com/apache/samza-hello-samza/pull/63 This is an automated message from the Apache Git Service. To respond to the mess

[GitHub] [samza-hello-samza] weisong44 opened a new pull request #63: Fixed build failure due to changes in Samza project

2019-05-22 Thread GitBox
weisong44 opened a new pull request #63: Fixed build failure due to changes in Samza project URL: https://github.com/apache/samza-hello-samza/pull/63 This is an automated message from the Apache Git Service. To respond to th

Canceled. [VOTE] Apache Samza 1.2.0 RC0

2019-05-22 Thread Boris S
-- Forwarded message - From: Bharath Kumara Subramanian Date: Wed, May 22, 2019 at 12:53 PM Subject: Re: [VOTE] Apache Samza 1.2.0 RC0 To: -1 disapprove. We have a bug fix for Async API. The fix has been committed to master an

Re: [VOTE] Apache Samza 1.2.0 RC0

2019-05-22 Thread Bharath Kumara Subramanian
-1 disapprove. We have a bug fix for Async API. The fix has been committed to master and we need to include it in 1.2. The commit hash c087f8 to cherry pick. Thank

Re: [DISCUSS] 1.2 release

2019-05-22 Thread Bharath Kumara Subramanian
We have a critical bug fix for Async high level API. The changes have been committed to master. Can we include that as part of 1.2? Thanks, Bharath On Mon, May 20, 2019 at 3:38 PM Jake Maes wrote

[VOTE] Apache Samza 1.2.0 RC0

2019-05-22 Thread Boris Shkolnik
Hi, This is a call for a vote on a release of Apache Samza 1.2.0. Thanks to everyone who has contributed to this release. The release candidate can be downloaded from here: http://home.apache.org/~boryas/samza-1.2.0-rc0/ The release candidate is signed with pgp key 0x7D74D0CD5B5EB041, which can

Re: Samza tasks aren't starting in YARN containers

2019-05-22 Thread Malcolm McFarland
Hey Jeremiah, That's basically what I mean by "all at once"; ie, a script to submits multiple tasks in sequence without breaks. I'd be surprised if YARN couldn't handle that, but just thought I'd ask. It really looks like it's a problem with the way our infrastructure is configured. I think I nee

Re: Samza tasks aren't starting in YARN containers

2019-05-22 Thread Jeremiah Adams
I have had no issues in running multiple tasks with the same tarball. I had four discrete Task implementations in the same jar running in production for months. Like you say - I had different inputs and configs for each Task but I don't imagine that this is necessary as far as Yarn is concerned