Samza 13.1 and Kafka 1.0

Hi, Does anyone know if Samza 13.1 is compatible with Kafka 1.0? Thanks, Xiaochuan Yu

Exit code 248 from YARN and InterruptedException

ever seen exit code 248? Could a problem with Kafka cause something like this? Thanks, Xiaochuan Yu

Re: Samza Job Slow to Restart

into it. Thanks, Xiaochuan Yu On Sat, Sep 23, 2017 at 6:17 PM XiaoChuan Yu wrote: > >> How long does it take? > It took around 10 minute from "Got offset 0 for topic > ..." to init() being called on the Task. > > >> Have you measured which parts of the s

Historical container logs in YARN UI

timeline server in YARN. I know there's a history server implementation for Map Reduce. Is there a similar history server implementation available for Samza? Thanks, Xiaochuan Yu

Re: Deploying Samza Jobs Using S3 and YARN on AWS

ths by copying those relevant JARs, it should just work. > > Please let us know if you need more assistance. > > -- > Jagdish > > > On Fri, Sep 15, 2017 at 11:07 AM, XiaoChuan Yu > wrote: > > > Hi, > > > > I'm trying to deploy a Samza job using YARN a

Re: Samza Job Slow to Restart

s to take a look? > > >> 3. Any ideas on how to fix this? > > We can perhaps, try to narrow down where the time is spent in startup from > the logs? Depending on that, I can suggest a fix :-) > > Thanks, > Jagadish > > On Wed, Sep 20, 2017 at 11:21 AM, XiaoChuan Yu

Samza Job Slow to Restart

and make requests for each. Questions: 1. What does that loop do exactly? 2. Is this an expected behaviour? Is "Got offset 0 for topic ..." normal? 3. Any ideas on how to fix this? Thanks, Xiaochuan Yu

Deploying Samza Jobs Using S3 and YARN on AWS

for S3AFileSystem. Whats the right way to set this up? Should I just copy over the required AWS jars to the Hadoop conf directory (2.)? Should I be editing run-job.sh or run-class.sh? Thanks, Xiaochuan Yu

Re: Kafka 0.10.2 compatibility with Samza 0.13.1

success. The testing was done on AWS EC2 instances running RedHat 7. We also found out that running against CDH YARN required various dependency overrides such as the ones in Hello Samza's "cdh5" build profile <https://github.com/apache/samza-hello-samza/blob/master/pom.xml#L282-L297>

Kafka 0.10.2 compatibility with Samza 0.13.1

ka versions. Cloudera Kafka version table: https://www.cloudera.com/documentation/kafka/latest/topics/kafka_packaging.html . Thanks, Xiaochuan Yu

Re: Custom ordering when using async

e key are processed serially. Thanks, Xiaochuan Yu On Thu, Aug 10, 2017 at 11:28 PM Jagadish Venkatraman < jagadish1...@gmail.com> wrote: > Hi XiaoChuan, > > Are you setting task.max.concurrency > 1 that allows multiple messages > in-flight? (The "keyed executor poo

Custom ordering when using async

on user IDs in parallel using processAsync but would like each user's event be processed in order. Does this then require custom ordering logic mentioned in the article? Thanks, Xiaochuan Yu

Re: Steps to Upgrading Samza (0.9 to 0.12)

; > > > > believe > > > > > you > > > > > > > > > > > > > > > > > >will be fine. (but I'm not sure) > > > > > > > > > > > > *Kafka version: * > > > > >

Steps to Upgrading Samza (0.9 to 0.12)

think installation of Kafka and YARN were managed through Puppet. I'm extremely new to Samza in terms of operations aspect. I'm not sure what information would be relevant in this case so please ask away. Thanks, Xiaochuan Yu