Re: How are samza.container.id generated in yarn?

2021-04-23 Thread Debraj Manna
Thanks Jagadish for replying. Yes I am treating it as a opaque durable I'd to execute some code on a container specific container. Just for my understanding can you please provide a bit more details or point me to the code how samza is mapping yarn container id to durable sequential integers? On

Re: How are samza.container.id generated in yarn?

2021-04-23 Thread Jagadish Venkatraman
Hi Debraj, Clarifying a bit on Yi’s response, since it was referring to the physical Yarn container id.. If there are N Yarn containers, samza.container.ids are generated sequentially from 0 to N-1. This ID is meant to be durable - ie., if a particular container fails, the Samza AM will restart i

Re: How are samza.container.id generated in yarn?

2021-04-23 Thread Debraj Manna
Thanks, Yi for replying. I also checked that class. But Container#getId().toString() returna s string like container_e02_1619095810959_0006_10_04. But I am seeing samza.container.id is an integer like 0, 1 that is getting set as system var. Can you let me know how Container#getId().toString()

CFP for ApacheCon 2021 closes in ONE WEEK

2021-04-23 Thread Rich Bowen
[You are receiving this because you're subscribed to one or more dev@ mailing lists for an Apache project, or the ApacheCon Announce list.] Time is running out to submit your talk for ApacheCon 2021. The Call for Presentations for ApacheCon @Home 2021, focused on Europe and North America time zo