Re: How to partition a topic into multiple and how to create multiple Samza Containers

Hi, Im trying to create more than one container in my application(Single machine). I have 1,00,000 records in one kafka topic.How to partition it into two and process it in parallel. I configured my job properties as below but i didnt get multiple containers.Kindly reply me as soon as possibl

Re: Review Request 44920: Remove tight coupling of Samza with Yarn. Define APIs for resource manager integration

> On March 16, 2016, 8:48 p.m., Chris Pettitt wrote: > > samza-core/src/main/java/org/apache/samza/clustermanager/SamzaAppState.java, > > line 36 > > > > > > Agreed. This is a bit mix of atomic and mutable state. Eit

Review Request 45063: SAMZA-903

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/45063/ --- Review request for samza. Repository: samza Description --- As a part of

Re: Review Request 44405: SAMZA-882 - Detect partition count changes in input streams

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/44405/ --- (Updated March 19, 2016, 2:30 a.m.) Review request for samza, Boris Shkolnik, J

Send a msg to all partitions

Hi, I'm new to Samza and I'm trying to do this: >From my standalone app, I'm writing some ActionEvents to a Kafka topic with 5 partitions >From Samza, I want to process those events but I need to send some filters information on how to process those events. For example, I want to keep all message

Re: How to partition a topic into multiple and how to create multiple Samza Containers

You can use the kafka-topics.sh tool to create a Kafka topic with your desired umber of partitions. You can also use the tool to repartition topics On Friday, March 18, 2016, Milinda Pathirage wrote: > Hi Mohan, > > Samza maps Kafka topic partitions to containers. So if your topic has only > 1 p

Re: Review Request 44405: SAMZA-882 - Detect partition count changes in input streams

> On March 18, 2016, 5:07 p.m., Yi Pan (Data Infrastructure) wrote: > > samza-core/src/main/scala/org/apache/samza/coordinator/StreamPartitionCountMonitor.scala, > > line 77 > > > > > > Can we make sure that either a

Re: Send a msg to all partitions

The incoming message envelope that you receive has methods to look up what system or stream partition it is from. So you can choose to react differently if this message is from a broadcast stream. Let us know if you need more help! On Friday, March 18, 2016, Jagadish Venkatraman wrote: > Broa