Re: How are samza.container.id generated in yarn?

Anyone any thoughts on my below query? Can you please provide a bit more details or point me to the code how samza > is mapping yarn container id to durable sequential integers? On Sat, Apr 24, 2021 at 10:45 AM Debraj Manna wrote: > Thanks Jagadish for replying. Yes I am treating i

Re: How are samza.container.id generated in yarn?

intend to use this? > > On Friday, April 23, 2021, Debraj Manna wrote: > > > Thanks, Yi for replying. > > > > I also checked that class. But Container#getId().toString() > > returna s string like container_e02_1619095810959_0006_10_04. But I > am > > s

Re: How are samza.container.id generated in yarn?

er in YARN and Container#getId().toString() is > the container ID string we set to samza.container.id. > > Best, > > -Yi > > On Wed, Apr 21, 2021 at 11:28 PM Debraj Manna > wrote: > > > The same has been asked in stackoverflow > > < > > > https://s

Re: How are samza.container.id generated in yarn?

d-when-the-application-is-deployed-in-yar On Wed, Apr 21, 2021 at 6:08 PM Debraj Manna wrote: > Hi > > Can someone let me know how is "samza.container.id" generated when a > samza app is running in yarn? > > Thanks, > >

How are samza.container.id generated in yarn?

Hi Can someone let me know how is "samza.container.id" generated when a samza app is running in yarn? Thanks,

Re: Samza jdk11 support

t; > Best! > > -Yi > > On Mon, Jun 1, 2020 at 9:09 AM Jordan Messec > wrote: > > > This is a pressing issue for our team as well. > > > > Jordan > > > > > On May 31, 2020, at 7:15 PM, Debraj Manna > > wrote: > > > > > > Than

Re: Samza jdk11 support

ync up with the team and get back to you. > > -Yi > > On Mon, May 25, 2020 at 9:53 AM Debraj Manna > wrote: > > > Hi > > > > I have seen a few earlier discussions on the email group which > > suggested that samza officially does not support jdk11. But tho

Samza jdk11 support

Hi I have seen a few earlier discussions on the email group which suggested that samza officially does not support jdk11. But those discussions seem to be old. Do the latest samza support jdk11? Thanks,

Samza on Kubernetes

Hi Any update on Samza on kubernetes? I can see https://issues.apache.org/jira/browse/SAMZA-2067 has fixed version as 1.1 but the issue is still open and I could not find anything related to Kubernetes in the release notes of Samza 1.1 ?

Re: Reduce kafka partition for a topic samza is using

titionCountMonitor.java > [2] - > > https://github.com/apache/samza/blob/beb5e1b40c07c092bc6e14aafc131d96eda5fcd4/samza-core/src/main/java/org/apache/samza/clustermanager/ClusterBasedJobCoordinator.java#L370 > > > > On Mon, Jan 6, 2020 at 4:31 AM Debraj Manna > wrote: > &g

Re: Reduce kafka partition for a topic samza is using

Anyone any thoughts on this? On Sat, Jan 4, 2020 at 5:16 PM Debraj Manna wrote: > I am using samza on yarn with Kafka. I need to reduce the number of > partitions in kafka. I am ok with some data loss. Can someone suggest what > should be the recommended way of doing this? > > S

Reduce kafka partition for a topic samza is using

I am using samza on yarn with Kafka. I need to reduce the number of partitions in kafka. I am ok with some data loss. Can someone suggest what should be the recommended way of doing this? Samza Job Config looks like this - job.factory.class = org.apache.samza.job.yarn.YarnJobFactory task.class =

Re: Running Samza with YARN Node label support

guration table. I have created SAMZA-2422 > > <https://issues.apache.org/jira/browse/SAMZA-2422> to track this work > > item. > > > > Let us know if you run into any issues. > > > > Thanks, > > Bharath > > > > [1] - > > *yarn.container.

Re: Running Samza with YARN Node label support

oop-yarn-site/NodeLabel.html> you shared in your last email. On Wed, Dec 18, 2019 at 11:17 PM Yang Zhang wrote: > Hi Debraj Manna, > > The app-def in previous email is just an example where you can configure > node labels. Yarn node labels > < > https://hadoop.apache.org/doc

Re: Running Samza with YARN Node label support

ect. >3. > >Add the label to *application.src* for your job. The *hdd* label will >assign your containers to machines with spinning disks instead of solid >state disks. > >name="my-application"> > > > &g

Running Samza with YARN Node label support

Hi I am seeing running samza with yarn node label is resolved in 0.12. https://issues.apache.org/jira/browse/SAMZA-1013?page=com.atlassian.jira.plugin.system.issuetabpanels%3Aall-tabpanel But I am not able to locate the relevant documentation in samza-yarn documentation

Re: Samza with OpenJDK 11

use some of our dependencies at the time, such as YARN, do not support > 11. However if you or others in the community are willing to take on this > endeavor, I'm sure it would be of great benefit to others. > > Best, > Dan > > On Thu, Oct 24, 2019 at 8:03 PM Debraj Manna

Re: Samza with OpenJDK 11

Anyone any update on this? On Thu 24 Oct, 2019, 7:41 PM Debraj Manna, wrote: > Hi > > Can someone let me know if apache samza 1.0 works with OpenJDK 11 ? > > Thanks, >

Samza with OpenJDK 11

Hi Can someone let me know if apache samza 1.0 works with OpenJDK 11 ? Thanks,

Re: Change log level in samza application

; change the log levels for running containers in YARN? > > -Yi > > > On Mon, Sep 17, 2018 at 7:14 AM Debraj Manna > wrote: > > > Hi > > > > Can someone let me know how can I change the log level for a samza > > application running inside YARN? > > > > Samza Version - 0.13.1 > > >

Change log level in samza application

Hi Can someone let me know how can I change the log level for a samza application running inside YARN? Samza Version - 0.13.1

Re: Samza 0.14.1 not correctly handling OffsetOutOfRangeException exception?

Uploaded Gaurav Agarwala's patch as discussed in this email thread to https://issues.apache.org/jira/browse/SAMZA-1822 . On Sat, Aug 25, 2018 at 4:21 PM Debraj Manna wrote: > https://issues.apache.org/jira/browse/SAMZA-1822 is filed for this. > > On Sat, Aug 25, 2018 at 5:56 AM

Re: Samza 0.14.1 not correctly handling OffsetOutOfRangeException exception?

t; > Thank you all! > > On Fri, Aug 24, 2018 at 4:33 AM, Debraj Manna > wrote: > > > It seems the above issue is coming because of KIP-35 > > <https://cwiki.apache.org/confluence/display/KAFKA/KIP- > > 109%3A+Old+Consumer+Deprecation> > > & &

Re: Samza 0.14.1 not correctly handling OffsetOutOfRangeException exception?

It seems the above issue is coming because of KIP-35 & its related PR (KAFKA-3264 ). Filed https://issues.apache.org/

Re: NoClassDefFoundError TopicExistxException Samza 0.14.2 and Kafka 0.10

; > Hi, Debraj, > > > > For Samza 0.14.1, we have moved to Kafka 0.11.0.2. Please try to use the > > new Kafka version and let us know whether you have problem upgrading or > not. > > > > Thanks a lot! > > > > -Yi > > > > On Fri, Jun 15, 2018 at

Re: NoClassDefFoundError TopicExistxException Samza 0.14.2 and Kafka 0.10

Just to add everything is working fine with samza 0.12 . I am now trying to upgrade to latest samza 0.14.1 which is causing this issue. On Fri, Jun 15, 2018 at 8:14 PM, Debraj Manna wrote: > Hi > > I am trying to use samza 0.14.2 with Kafka Client 0.10.0 . I am getting > the below e

NoClassDefFoundError TopicExistxException Samza 0.14.2 and Kafka 0.10

Hi I am trying to use samza 0.14.2 with Kafka Client 0.10.0 . I am getting the below exception. Is this related to https://issues.apache.org/jira/browse/SAMZA-1509. ? Is samza 0.14.2 not compatible with 0.10 Kafka ? 2018-06-15 13:47:29.228 [main] ZooKeeper [INFO] Session: 0x164031c68f3030a closed

Re: Running apache samza with Kafka Client 1.0 - JIRA - SAMZA - 1418

Debraj, > > Makes sense. I have opened a ticket to upgrade Samza's Kafka client > libraries to 0.11 (SAMZA-1509). If you have concerns/suggestions, please > add comments to that ticket. > > Thanks! > > -Yi > > On Wed, Nov 22, 2017 at 10:04 AM, Debraj Manna >

Re: [DISCUSS] Samza 0.14.0 release

+1 On Mon, Nov 27, 2017 at 11:32 PM, xinyu liu wrote: > +1. > > Very happy to see a lot of important features added in this release. > > Thanks, > Xinyu > > On Mon, Nov 27, 2017 at 10:00 AM, Jagadish Venkatraman < > jagad...@apache.org> > wrote: > > > +1 from my side. > > > > Thank you Bharath f

Re: Running apache samza with Kafka Client 1.0 - JIRA - SAMZA - 1418

Samza. It would require a lot of testing on Samza side to make sure: > 1) > > back-compat w/ older version of brokers; 2) performance test. We already > > have a PR to include Kafka 0.11 under review. > > > > Thanks! > > > > -Yi > > > > On Wed, Nov 22,

Running apache samza with Kafka Client 1.0 - JIRA - SAMZA - 1418

Hi I am facing the same below issue when trying to use kafka client 1.0 with samza https://issues.apache.org/jira/browse/SAMZA-1418 I could not find any related ticket with a fix. How are we supposed to run apache samza with the latest Kafka Client 1.0? It looks like I have to use kafka-client