Re: How to partition a topic into multiple and how to create multiple Samza Containers

2016-03-19 Thread Milinda Pathirage
Hi Mohan, Samza maps Kafka topic partitions to containers. So if your topic has only 1 partition, only 1 container will be spawned even if you configure Samza job to use more than 1 container. So please partition the input topic first. The "Tasks" section of [1] contains more information on this

Re: How to partition a topic into multiple and how to create multiple Samza Containers

2016-03-18 Thread mohanraj v
Hi, Im trying to create more than one container in my application(Single machine). I have 1,00,000 records in one kafka topic.How to partition it into two and process it in parallel. I configured my job properties as below but i didnt get multiple containers.Kindly reply me as soon as possibl

Re: How to partition a topic into multiple and how to create multiple Samza Containers

2016-03-18 Thread Jagadish Venkatraman
You can use the kafka-topics.sh tool to create a Kafka topic with your desired umber of partitions. You can also use the tool to repartition topics On Friday, March 18, 2016, Milinda Pathirage wrote: > Hi Mohan, > > Samza maps Kafka topic partitions to containers. So if your topic has only > 1 p