Re: Running Samza with YARN Node label support

2019-12-18 Thread Yang Zhang
Hi Debraj Manna, The app-def in previous email is just an example where you can configure node labels. Yarn node labels is a general feature (not specific to Samza), and it depends on the configuration system your

Re: [DISCUSS] SEP 25: PR Title and Description Guidelines

2019-12-18 Thread Prateek Maheshwari
Thanks for the feedback folks. Since the feedback is positive, I'll start a VOTE for the SEP. @Jagadish Venkatraman , will add a link to this SEP to the contributor's corner in the appropriate place. Thanks, Prateek On Mon, Dec 16, 2019 at 12:09 PM Yi Pan wrote: > +1 (binding). lgtm. Thanks! >

[VOTE] SEP 25: PR Title and Description Guidelines

2019-12-18 Thread Prateek Maheshwari
Hi folks, This is a call for a vote on SEP 25: PR Title and Description Guidelines. Thanks to everyone who helped review the proposal and provided feedback. Feedback from the discussion is positive: http://mail-archives.apache.org/mod_mbox/samza-dev/201912.mbox/%3CCAMja7KeQr9C048UVZwfSC46h%3DEX_9

Re: [VOTE] SEP 25: PR Title and Description Guidelines

2019-12-18 Thread Bharath Kumara Subramanian
+1 (non-binding). Thanks, Bharath On Wed, Dec 18, 2019 at 10:42 AM Prateek Maheshwari wrote: > Hi folks, > > This is a call for a vote on SEP 25: PR Title and Description Guidelines. > Thanks to everyone who helped review the proposal and provided feedback. > > Feedback from the discussion is p

Re: Running Samza with YARN Node label support

2019-12-18 Thread Debraj Manna
I understood how I can assign labels to yarn nodes. But it is still not clear to me how can I specify the node label for a samza application. I am referring to the section "Specifying node label for application" in the link

Re: Running Samza with YARN Node label support

2019-12-18 Thread Bharath Kumara Subramanian
Hi Debraj, To get the node label working, set the label configurations[1] pointed out by Yang in your application config. Samza will take care of embedding the node label in the resource request automatically if it notices the label configuration inside your application. Samza framework respects n

Re: Running Samza with YARN Node label support

2019-12-18 Thread Bharath Kumara Subramanian
Hi Debraj, I forgot to call this out earlier. Some distribution of YARN doesn't support node label and rack combination as part of the same request. If you were to use node labels along with host affinity feature in

[DISCUSS] SEP-26: Add SystemProducer for Azure Blob Storage

2019-12-18 Thread Lakshmi Manasa
Hi all, We created SEP-26: Add SystemProducer for Azure Blob Storage. Please find SEP here ( https://cwiki.apache.org/confluence/display/SAMZA/SEP-26%3A+Azure+Blob+Storage+Producer ) Please take a look and provide feedback. thanks, Manasa

Re: Running Samza with YARN Node label support

2019-12-18 Thread Debraj Manna
Thanks Bharath and Yang. It is clear now. On Thu, 19 Dec 2019, 04:04 Bharath Kumara Subramanian, < codin.mart...@gmail.com> wrote: > Hi Debraj, > > I forgot to call this out earlier. Some distribution of YARN doesn't > support node label and rack combination as part of the same request. If you >

Re: [VOTE] SEP 25: PR Title and Description Guidelines

2019-12-18 Thread Yi Pan
+1 (binding) On Wed, Dec 18, 2019 at 10:49 AM Bharath Kumara Subramanian < codin.mart...@gmail.com> wrote: > +1 (non-binding). > > Thanks, > Bharath > > On Wed, Dec 18, 2019 at 10:42 AM Prateek Maheshwari > wrote: > > > Hi folks, > > > > This is a call for a vote on SEP 25: PR Title and Descript

Re: [VOTE] SEP 25: PR Title and Description Guidelines

2019-12-18 Thread Daniel Nishimura
+1 non-binding > On Dec 18, 2019, at 7:09 PM, Yi Pan wrote: > > +1 (binding) > > On Wed, Dec 18, 2019 at 10:49 AM Bharath Kumara Subramanian < > codin.mart...@gmail.com> wrote: > >> +1 (non-binding). >> >> Thanks, >> Bharath >> >> On Wed, Dec 18, 2019 at 10:42 AM Prateek Maheshwari >> wrot

Re: [VOTE] SEP 25: PR Title and Description Guidelines

2019-12-18 Thread Jagadish Venkatraman
+1 (binding) On Thursday, December 19, 2019, Daniel Nishimura wrote: > +1 non-binding > > > On Dec 18, 2019, at 7:09 PM, Yi Pan wrote: > > > > +1 (binding) > > > > On Wed, Dec 18, 2019 at 10:49 AM Bharath Kumara Subramanian < > > codin.mart...@gmail.com> wrote: > > > >> +1 (non-binding). > >> >