Re: Input stream partition to task mapping

2015-05-12 Thread Susan Luong
Hi Yan, We are looking for a solution for a similar problem. Currently, we have 2 input streams, one transactions stream (5 partitions) and one rules stream (one partition). I have a custom SystemStreamPartitionGrouper that assigns the SSPs like so:. taskName0: Trx stream partition 0, Rules stre

Questions about partitioning

2015-04-24 Thread Susan Luong
Hi there, I'm new to Samza/Kafka and we're evaluating Samza to see whether it would be a good fit for our application. I just had a few questions about how partitioning works. I understand there is a limitation on the number of topics we can create [1], and I was wondering, if we need more than, s